Skip to content

Use DLAMI on AWS#2782

Merged
r4victor merged 1 commit intomasterfrom
issue_2781_dlami
Jun 10, 2025
Merged

Use DLAMI on AWS#2782
r4victor merged 1 commit intomasterfrom
issue_2781_dlami

Conversation

@r4victor
Copy link
Copy Markdown
Collaborator

@r4victor r4victor commented Jun 10, 2025

Closes #2781

All AWS GPU instances except p3. are provisioned with DLAMI instead of dstack-cuda to make EFA work out-of-the box. dstack-cuda is still used for p3. p3 should be deprecated.

Tested running NCCL tests on 2x p4d.24xlarge.

Checked that DLAMI is supported in all regions supported in dstack.

Each Region supports a different range of instance types and often an instance type has a slightly different cost in different Regions. DLAMIs are not available in every Region, but it is possible to copy DLAMIs to the Region of your choice.

@r4victor r4victor merged commit 6200522 into master Jun 10, 2025
25 checks passed
@r4victor r4victor deleted the issue_2781_dlami branch June 10, 2025 10:55
haydnli-shopify pushed a commit to haydnli-shopify/dstack that referenced this pull request Jun 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use DLAMI as a default GPU image on AWS

1 participant