[NVIDIA] Add DSR1 MTP#53
Conversation
|
I'm not sure the mtp-mode: on actually triggers the dsr1_b200_fp4/fp8_trt_mtp.sh scripts. |
|
@kimbochen can you please guide how to add logic in runner/launch b200 to account for mtp flag? |
|
Can we add a variable called |
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
|
Thanks @csahithi . i have made changes accordingly. ran several sample sweeps: https://github.com/InferenceMAX/InferenceMAX/actions/runs/18050118322 |
|
stale |
As per guidance we've recvd, wanted to add MTP ON configs for single node after GB200 is merged.
Only TRT MTP for now.
Changes: