Skip to content

Commit eb9aede

Browse files
authored
Update available SM DLCs documentation with latest vLLM (#2360)
1 parent cd4a108 commit eb9aede

1 file changed

Lines changed: 4 additions & 2 deletions

File tree

docs/sagemaker/source/dlcs/available.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,13 @@
11
# Available DLCs on AWS
22

3-
Below you can find a listing of all the Deep Learning Containers (DLCs) available on AWS.
3+
Below you can find a listing of our latest Deep Learning Containers (DLCs) available on AWS.
44

55
For each supported combination of use-case (training, inference), accelerator type (CPU, GPU, Neuron), and framework (PyTorch, TGI, TEI) containers are created.
66

77
Neuron DLCs for training and inference on AWS Trainium and AWS Inferentia instances can be found in the [Optimum Neuron documentation](https://huggingface.co/docs/optimum-neuron/en/containers).
88

9+
If you want to keep track of all our available DLCs, you can also check the [AWS Deep Learning Containers releases](https://aws.github.io/deep-learning-containers/reference/available_images#huggingface-pytorch-training) page.
10+
911
## Training
1012

1113
For training, the DLCs are available for PyTorch via Transformers. They include GPUs and AWS AI chips support, with libraries such as TRL, Sentence Transformers, or Diffusers.
@@ -36,7 +38,7 @@ In case you want to serve text generation models with vLLM, there are specific D
3638

3739
| vLLM version | Container URI | Accelerator |
3840
| -------------- | -------------------------------------------------------------------------------------------------------------------------------- | ----------- |
39-
| 0.14.0 | 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-vllm:0.14-gpu-py312-cu129-ubuntu22.04-v1 | GPU |
41+
| 0.17.0 | 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-vllm:0.17.0-transformers4.57.5-gpu-py312-cu129-ubuntu22.04 | GPU |
4042
| 0.11.0 | 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-vllm-inference-neuronx:0.11.0-optimum0.4.5-neuronx-py310-sdk2.26.1-ubuntu22.04 | Neuron |
4143

4244
### Hugging Face SGLang Inference DLC

0 commit comments

Comments
 (0)