Skip to content

Commit 0d8d1f9

Browse files
[Klaud Cold] Update dsr1-fp4-b200-trt (+mtp) TRT-LLM image to v1.3.0rc14 (#1489)
* Update dsr1-fp4-b200-trt (+mtp) TRT-LLM image to v1.3.0rc14 Update TensorRT-LLM image (off: v1.2.0rc6.post2 104d / mtp: v1.2.0rc6.post3 101d) to v1.3.0rc14 (latest pre-release) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore: fill pr-link for #1489 --------- Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent f3dbc40 commit 0d8d1f9

2 files changed

Lines changed: 9 additions & 2 deletions

File tree

.github/configs/nvidia-master.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1873,7 +1873,7 @@ dsr1-fp4-b300-sglang:
18731873
- { tp: 8, ep: 8, conc-start: 4, conc-end: 16 }
18741874

18751875
dsr1-fp4-b200-trt:
1876-
image: nvcr.io#nvidia/tensorrt-llm/release:1.2.0rc6.post2
1876+
image: nvcr.io#nvidia/tensorrt-llm/release:1.3.0rc14
18771877
model: nvidia/DeepSeek-R1-0528-FP4-V2
18781878
model-prefix: dsr1
18791879
runner: b200
@@ -1906,7 +1906,7 @@ dsr1-fp4-b200-trt:
19061906
- { tp: 8, ep: 8, dp-attn: true, conc-start: 128, conc-end: 256 }
19071907

19081908
dsr1-fp4-b200-trt-mtp:
1909-
image: nvcr.io#nvidia/tensorrt-llm/release:1.2.0rc6.post3
1909+
image: nvcr.io#nvidia/tensorrt-llm/release:1.3.0rc14
19101910
model: nvidia/DeepSeek-R1-0528-FP4-V2
19111911
model-prefix: dsr1
19121912
runner: b200

perf-changelog.yaml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2869,3 +2869,10 @@
28692869
- "1k1k and 8k1k STP low-latency and max-throughput srt-slurm recipes under benchmarks/multi_node/srt-slurm-recipes/sglang/glm5/b200-fp8/"
28702870
- "Use the B200 local model alias glm5-fp8 mapped to /scratch/fsw/models/GLM-5-FP8"
28712871
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1372
2872+
2873+
- config-keys:
2874+
- dsr1-fp4-b200-trt
2875+
- dsr1-fp4-b200-trt-mtp
2876+
description:
2877+
- "Update TensorRT-LLM image (off: v1.2.0rc6.post2 104d / mtp: v1.2.0rc6.post3 101d) to v1.3.0rc14 (latest pre-release)"
2878+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1489

0 commit comments

Comments
 (0)