You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
TensorRT-LLM requires `pip` due to a transitive Git URL dependency that
89
-
`uv` doesn't resolve. We recommend using the TensorRT-LLM container for
90
-
broader compatibility. See the [TRT-LLM backend guide](../backends/trtllm/README.md)
91
-
for details.
92
-
93
82
**vLLM**
94
83
95
84
```bash
@@ -207,9 +196,10 @@ The default model `Qwen/Qwen3-0.6B` requires ~2GB of GPU memory. Larger models n
207
196
208
197
Start with a small model and scale up based on your hardware.
209
198
210
-
**Python 3.11 with TensorRT-LLM**
199
+
**TensorRT-LLM**
211
200
212
-
TensorRT-LLM does not support Python 3.11. If you see installation failures with TensorRT-LLM, check your Python version with `python3 --version`. Use Python 3.10 or 3.12 instead.
201
+
TensorRT-LLM is not supported via a local PyPI install. Use the
Copy file name to clipboardExpand all lines: docs/reference/release-artifacts.md
+6-4Lines changed: 6 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -37,7 +37,8 @@ Release history in this document begins at v0.6.0.
37
37
38
38
### Python Wheels
39
39
40
-
We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtllm]` wheel. See the [NGC container collection](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo) for supported images.
40
+
For TensorRT-LLM, use the NGC container — not the `ai-dynamo[trtllm]` PyPI extra.
41
+
See the [NGC container collection](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo).
0 commit comments