File tree Expand file tree Collapse file tree
examples/auto_deploy/model_registry/configs
tests/integration/test_lists Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -7,6 +7,9 @@ trust_remote_code: true
77kv_cache_config :
88 enable_block_reuse : false
99 free_gpu_memory_fraction : 0.7
10+ # H20 shows an MMLU accuracy drop with the default BF16 recurrent SSM cache.
11+ # Keep SSM state in FP32 for stable Triton SSM generation.
12+ mamba_ssm_cache_dtype : float32
1013
1114# Keep max_batch_size as in the PyTorch test to avoid OOM
1215max_batch_size : 128
Original file line number Diff line number Diff line change @@ -241,9 +241,6 @@ full:GH200/unittest/trt/model_api/test_model_quantization.py SKIP (https://nvbug
241241full:H100/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-gpt_oss_120b_cutlass_stress] SKIP (https://nvbugs/6222480)
242242full:H100/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-gpt_oss_120b_eagle_stress] SKIP (https://nvbugs/6222480)
243243full:H100_PCIe/unittest/llmapi/test_llm_pytorch.py::test_llama_7b_multi_lora_evict_and_reload_lora_gpu_cache SKIP (https://nvbugs/5682551)
244- full:H20/accuracy/test_llm_api_autodeploy.py::TestNemotronV2::test_auto_dtype[False] SKIP (https://nvbugs/6185173)
245- full:H20/accuracy/test_llm_api_autodeploy.py::TestNemotronV2::test_auto_dtype[True] SKIP (https://nvbugs/6185173)
246- full:H20/accuracy/test_llm_api_autodeploy.py::TestNemotronV2::test_fp8[True] SKIP (https://nvbugs/6185173)
247244full:H20/accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_chunked_prefill[triton-auto] SKIP (https://nvbugs/6026676)
248245full:RTX/accuracy/test_llm_api_pytorch.py::TestGemma3_1BInstruct::test_auto_dtype SKIP (https://nvbugs/5569696)
249246full:RTXPro6000D/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_nvfp4_4gpus[moe_backend=CUTLASS-mtp_nextn=0-ep4-fp8kv=True-attention_dp=True-cuda_graph=True-overlap_scheduler=True-low_precision_combine=False-torch_compile=False] SKIP (https://nvbugs/5948435)
You can’t perform that action at this time.
0 commit comments