Skip to content

Commit a50b5e2

Browse files
[https://nvbugs/6143787][fix] Add kv_cache_config = KvCacheConfig(free_gpu_memory_fraction=0.6) to TestQwen3 (#13852)
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
1 parent 8e5d9e2 commit a50b5e2

2 files changed

Lines changed: 3 additions & 1 deletion

File tree

tests/integration/defs/accuracy/test_llm_api_pytorch_multimodal.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -480,6 +480,8 @@ class TestQwen3VL(LlmapiAccuracyTestHarness):
480480
max_tokens=MAX_NUM_TOKENS, truncate_prompt_tokens=MMMU.MAX_INPUT_LEN, stop="<|endoftext|>"
481481
)
482482

483+
kv_cache_config = KvCacheConfig(free_gpu_memory_fraction=0.6)
484+
483485
@pytest.mark.parametrize(
484486
"enable_chunked_prefill,max_num_tokens",
485487
[
@@ -493,6 +495,7 @@ def test_auto_dtype(self, enable_chunked_prefill, max_num_tokens):
493495
self.MODEL_PATH,
494496
enable_chunked_prefill=enable_chunked_prefill,
495497
max_num_tokens=max_num_tokens,
498+
kv_cache_config=self.kv_cache_config,
496499
) as llm:
497500
task = MMMU(self.MODEL_NAME)
498501
task.evaluate(llm, sampling_params=self.sampling_params)

tests/integration/test_lists/waives.txt

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -147,7 +147,6 @@ accuracy/test_llm_api_pytorch_multimodal.py::TestExaone4_5_33B::test_auto_dtype[
147147
accuracy/test_llm_api_pytorch_multimodal.py::TestGemma3_27BInstruct::test_fp8_prequantized SKIP (https://nvbugs/6215689)
148148
accuracy/test_llm_api_pytorch_multimodal.py::TestMistralLarge3_675B::test_nvfp4_4gpus[latency_moe_trtllm] SKIP (https://nvbugs/6181383)
149149
accuracy/test_llm_api_pytorch_multimodal.py::TestNemotron_Nano_12B_V2_VL::test_auto_dtype[forced_chunked_prefill] SKIP (https://nvbugs/6248744)
150-
accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3VL::test_auto_dtype[forced_chunked_prefill] SKIP (https://nvbugs/6143787)
151150
accuracy/test_llm_api_pytorch_ray.py::TestLlama3_1_8BInstruct::test_pp2_ray SKIP (https://nvbugs/6094070)
152151
cpp/test_e2e.py::test_benchmarks[bart-90] SKIP (https://nvbugs/5550689)
153152
cpp/test_e2e.py::test_benchmarks[gpt-80] SKIP (https://nvbugs/5550689)

0 commit comments

Comments
 (0)