Search results

[Bug] run.py: LOCAL_RANK defaults to 1 instead of 0

Status: Open.

#1589 In open-compass/VLMEvalKit;

· Irisicy4 opened on Jun 28, 2026

[Bug] Thyme: sandbox image fed in assistant turn + KV-cache reused across re-encoded turns corrupts multi-round vision context

Status: Open.

#1590 In open-compass/VLMEvalKit;

· Irisicy4 opened on Jun 28, 2026

Adding [BenchCAD]: would you accept execution-based image→CadQuery-code tasks (heavier deps)?

Status: Open.

#1582 In open-compass/VLMEvalKit;

· HaozheZhang6 opened on Jun 25, 2026

[Bug] CharXiv_descriptive_val DATASET_MD5 appears to be incorrect after #1555

Status: Open.

#1580 In open-compass/VLMEvalKit;

· kail8 opened on Jun 23, 2026

Qwen 3.5支持

Status: Open.

#1562 In open-compass/VLMEvalKit;

· identzz-ai opened on Jun 1, 2026

SEEDBench_IMG & MMStar: option text "None" parsed as NaN by pandas

Status: Open.

#1559 In open-compass/VLMEvalKit;

· identzz-ai opened on May 28, 2026

Ovis2.6-80B-A3B 评测模型预计什么时候可以支持？

Status: Open.

#1553 In open-compass/VLMEvalKit;

· 1359347500cwc opened on May 25, 2026

RFC: Ascend NPU device support

Status: Open.

#1549 In open-compass/VLMEvalKit;

· pjgao opened on May 17, 2026

是否能发布pypi源

Status: Open.

#1537 In open-compass/VLMEvalKit;

· zq1134241486-beep opened on May 8, 2026

model：llava-1.5-7b，data：mmebench

Status: Open.

#1529 In open-compass/VLMEvalKit;

· waowaocyj opened on Apr 27, 2026

Confirm whether Polygon3 is still required

Status: Open.

#1528 In open-compass/VLMEvalKit;

· gchlebus opened on Apr 27, 2026

About MMBench Evaluation

Status: Open.

#1516 In open-compass/VLMEvalKit;

· cfmaXT opened on Apr 16, 2026