You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For the sake of environment isolation and simplicity, we recommend preparing the vLLM environment by pulling the official, pre-built vLLM Docker image.
52
-
> Note: v0.11.0 is newly supported (replace the tag with v0.11.0 if needed).
53
52
54
53
```bash
55
-
docker pull vllm/vllm-openai:v0.11.0
54
+
docker pull vllm/vllm-openai:<vllm_version>
56
55
```
57
56
Use the following command to run your own container:
Refer to [Set up using docker](https://docs.vllm.ai/en/latest/getting_started/installation/gpu.html#set-up-using-docker) for more information to run your own vLLM container.
0 commit comments