docs(trtllm): Update the trtllm installation instructions#11066
Merged
Conversation
This comment has been minimized.
This comment has been minimized.
Contributor
Contributor
WalkthroughDocumentation updates across three files remove TensorRT-LLM from the PyPI installation path (Option B), restricting it to vLLM and SGLang only. TensorRT-LLM users are redirected to the NGC ChangesTensorRT-LLM container-only redirect
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Comment |
Contributor
There was a problem hiding this comment.
Actionable comments posted: 2
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@docs/getting-started/local-installation.md`:
- Around line 203-204: The TensorRT-LLM fallback note in the local installation
guide still suggests Python 3.10 or 3.12 as a valid option, but the updated flow
should be container-only. Update the affected paragraph in the
local-installation guidance to remove any local Python/PyPI fallback language
and keep only the `tensorrtllm-runtime` container path (Option A), making sure
the surrounding Option B wording is consistent with the `TensorRT-LLM` install
flow.
In `@docs/getting-started/local-installation.zh-CN.md`:
- Around line 203-204: The local-installation guidance still suggests Python
3.10 or 3.12 as a TensorRT-LLM fallback, but the updated flow should be
container-only. Update the note in the TensorRT-LLM section of the
getting-started local installation doc so it no longer mentions any local Python
version workaround, and make the wording around the TensorRT-LLM install path
consistent with the option that uses the tensorrtllm-runtime container.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Path: .coderabbit.yaml
Review profile: CHILL
Plan: Enterprise
Run ID: b3c442de-4702-45bb-b7ec-33f6b5478968
📒 Files selected for processing (3)
docs/getting-started/local-installation.mddocs/getting-started/local-installation.zh-CN.mddocs/reference/release-artifacts.md
Remove the local Python 3.10/3.12 fallback suggestion from the TensorRT-LLM troubleshooting note, keeping only the tensorrtllm-runtime container path (Option A) for consistency with the Option B install flow. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
nv-anants
approved these changes
Jun 30, 2026
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
rmccorm4
approved these changes
Jul 2, 2026
dagil-nvidia
added a commit
that referenced
this pull request
Jul 2, 2026
Regenerate the mirror from latest main so the TRT-LLM installation changes from #11066 carry into the translated page, and update the dynamo-docs skill's translation convention to the fern/translations mirror layout. Signed-off-by: Dan Gil <dagil@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview:
Updates the installation instructions for TRTLLM. The tensorrt-llm pip installation is fragile and might not work OOTB. We are also not exercising the
ai-dynamo[trtllm]in our CI which makes instructions in our documentation in regards to trtllm inaccurate.Related Issues
🚫 This PR is NOT linked to an issue:
Summary by CodeRabbit