Skip to content

Commit 252f57c

Browse files
authored
Arm backend: Relax Qwen3 VL BF16 tolerance on Arm64 (#20450)
Increase the TOSA BF16 atol for the Qwen3 VL full vision-model test on aarch64 only. Signed-off-by: Zingo Andersen <Zingo.Andersen@arm.com>
1 parent 1d598ab commit 252f57c

1 file changed

Lines changed: 9 additions & 2 deletions

File tree

backends/arm/test/models/Qwen3_VL/test_qwen3_vl_model.py

Lines changed: 9 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -246,15 +246,22 @@ def test_qwen3_vl_full_models_tosa_FP(test_case: Qwen3VLModelTestCase):
246246
def test_qwen3_vl_full_models_tosa_FP_bf16(test_case: Qwen3VLModelTestCase):
247247
model, inputs = test_case.model_cls.prepare_model_and_inputs()
248248
model, inputs = _to_bfloat16_model_and_floating_inputs(model, inputs)
249+
# Slightly higher atol for TOSA BF16 on aarch64 (MLETORCH-2048: numeric mismatch)
250+
atol = (
251+
0.4
252+
if common.is_aarch64_host()
253+
and test_case.model_cls is LowerableVisionModelWrapper
254+
else 0.1
255+
)
249256
with torch.no_grad():
250257
pipeline = TosaPipelineFP[input_t](
251258
model,
252259
inputs,
253260
aten_op=[],
254261
exir_op=[],
255262
tosa_extensions=["bf16"],
256-
atol=1e-1,
257-
rtol=1e-1,
263+
atol=atol,
264+
rtol=0.1,
258265
)
259266
pipeline.run()
260267

0 commit comments

Comments
 (0)