cp: test: add vLLM deployment tests into r0.4.0#1745
Merged
Conversation
* test: add vLLM deployment tests for checkpoint robustness vLLM deployment verification tests that load consolidated checkpoints and compare greedy output token-for-token against HuggingFace. Supports both full comparison and smoke test mode. Depends on checkpoint robustness PR #1606. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: adil-a <adil.asif2000@hotmail.com> * Create deploy-test dependency group Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Revert deploy test group Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Move configs to recipes and create vllm_launcher Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Setup deploy environment Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Remove duplicate keys Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Add scope to vllm deploy test Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Drop needs dependency Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Use finetune test name for ckpt dir Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Make ckpt checking more robust Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Pass arguments correctly Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Update arguments Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> * Remove unused file Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> --------- Signed-off-by: adil-a <adil.asif2000@hotmail.com> Signed-off-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: Dong Hyuk Chang <9426164+thomasdhc@users.noreply.github.com> Co-authored-by: Alexandros Koumparoulis <153118171+akoumpa@users.noreply.github.com> Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Contributor
Author
|
/ok to test 04bbd69 |
svcnvidia-nemo-ci
requested review from
HuiyingLi,
ZhiyuLi-Nvidia,
hemildesai and
pthombre
as code owners
akoumpa
changed the title
test: add vLLM deployment tests for checkpoint robustness (1656) into r0.4.0test: add vLLM deployment tests into r0.4.0
akoumpa
approved these changes
Apr 9, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
beep boop [🤖]: Hi @adil-a 👋,