We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
2 parents d0ca7bd + f7a881c commit aa633daCopy full SHA for aa633da
2 files changed
core/scripts/vllm-quickstart/README.md
@@ -116,7 +116,7 @@ The `models.json` file contains all configuration:
116
```json
117
{
118
"docker": {
119
- "image": "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.11.2",
+ "image": "vllm/vllm-openai-cpu:v0.24.0",
120
"port": "8000:8000",
121
"environment": { ... },
122
"volumes": [ ... ]
core/scripts/vllm-quickstart/models.json
@@ -1,6 +1,6 @@
1
2
3
4
5
"environment": {
6
"VLLM_CPU_SGL_KERNEL": "1",
0 commit comments