0.19.33-v1

UI

Dev environments

You can now configure and provision dev environments directly from the user interface.

create-dev-environment-2.mp4

Note

CLI version 0.19.33 or later is required to attach to runs created from the UI.

GCP

Reservations

You can now configure specifically-targeted GCP reservations in fleet configurations to leverage reserved compute capacity:

type: fleet
nodes: 4
placement: cluster
backends: [gcp]
reservation: my-reservation

For reservations shared between projects, use the full syntax:

type: fleet
nodes: 4
placement: cluster
backends: [gcp]
reservation: projects/my-proj/reservations/my-reservation

dstack will automatically locate the specified reservation, match offers to the reservation's properties, and provision instances within the reservation. If there are multiple reservations with the specified name, all of them will be considered for provisioning.

Note

Using reservations requires the compute.reservations.list permission in the project that owns the reservation.

G4 preview

If your GCP project has access to the preview G4 instance type, you can now try it out with dstack.

> dstack offer -b gcp --gpu RTXPRO6000

 #  BACKEND            RESOURCES                                      INSTANCE TYPE   PRICE
 1  gcp (us-central1)  cpu=48 mem=180GB disk=100GB RTXPRO6000:96GB:1  g4-standard-48  $0

To use G4, enable its preview in the backend settings.

projects:
- name: main
  backends:
  - type: gcp
    project_id: my-project
    creds:
      type: default
    preview_features: [g4]

AMD

Kubernetes

The kubernetes backend now allows you to run workloads on AMD GPU-enabled Kubernetes clusters.

> dstack offer -b kubernetes

 #  BACKEND         RESOURCES                                   INSTANCE TYPE         PRICE    
 1  kubernetes (-)  cpu=19 mem=225GB disk=628GB MI300X:192GB:1  pool-iqg23mp4v-po04e  $0
 1  kubernetes (-)  cpu=19 mem=225GB disk=628GB MI300X:192GB:1  pool-iqg23mp4v-po04g  $0

Hot Aisle

The hotaisle backend now supports 8x MI300X instances too.

> dstack offer -b hotaisle --gpu 8:MI300X                         

 #  BACKEND                   RESOURCES                                       INSTANCE TYPE                      PRICE    
 1  hotaisle (us-michigan-1)  cpu=104 mem=1792GB disk=12288GB MI300X:192GB:8  8x MI300X 104x Xeon Platinum 8470  $15.92

Docker

Default image

The default Docker image now uses CUDA 12.8 (updated from 12.1).

What's changed

• Fix version descriptions on Sky index page by @jvstme in dstackai/dstack#3153
• [Internal] Minor just improvements by @peterschmidt85 in dstackai/dstack#3173
• [Docker] Update the CUDA version in the default Docker image to 12.8 (from 12.1) by @peterschmidt85 in dstackai/dstack#3166
• [HotAisle] 4x MI300X 52x Xeon Platinum 8470 is skipped by @peterschmidt85 in dstackai/dstack#3175
• [Internal] Updated amd-smi CI/CD by @peterschmidt85 in dstackai/dstack#3179
• Make kubeconfig filename optional in server/config.yml by @r4victor in dstackai/dstack#3189
• [HotAisle] Support 8xMI300X instances by @peterschmidt85 in dstackai/dstack#3188
• [GCP] Support G4 preview instance type by @peterschmidt85 in dstackai/dstack#3181
• [UX] Improved UX of the project settings CLI section by @peterschmidt85 in dstackai/dstack#3183
• [UI] A prototype of the "Connect" section to show on the running dev environment page (WIP) by @peterschmidt85 in dstackai/dstack#3184
• Support GCP reservations by @jvstme in dstackai/dstack#3186
• [Feature]: Store user SSH key on the server by @peterschmidt85 in dstackai/dstack#3176
• [Internal] Extend _CREATE_USER_HOOKS with an optional config by @peterschmidt85 in dstackai/dstack#3192
• Run wizzard by @olgenn in dstackai/dstack#3191
• fix(VastAICompute): filter region before offer by @DragonStuff in dstackai/dstack#3193
• Kubernetes: add AMD GPU support by @un-def in dstackai/dstack#3178
• Fix CLI incompatibility with older /get_my_user by @jvstme in dstackai/dstack#3198

Full changelog: dstackai/dstack@0.19.32...0.19.33