Search results

Update together dedicated endpoints to v2.0

Status: Open.

#1576 In mlcommons/modelbench;

· bkorycki opened on Jul 17, 2026

Security running in Candela

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#1574 In mlcommons/modelbench;

· wpietri opened on Jul 14, 2026

Security (jailbreak) 1.1 benchmark

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#1572 In mlcommons/modelbench;

· bollacker opened on Jul 13, 2026

Proposal: RL-specific reward-hacking safety benchmark / methodology contribution

Status: Open.

#1571 In mlcommons/modelbench;

· Aarav500 opened on Jul 10, 2026

Investigate huggingface failures / consistency check failures

Status: Open.

#1569 In mlcommons/modelbench;

· superdosh opened on Jul 2, 2026

Fairer together calling from cheval

Status: Open.

#1568 In mlcommons/modelbench;

· superdosh opened on Jul 2, 2026

Benchmark stalling issues

Status: Open.

#1565 In mlcommons/modelbench;

· superdosh opened on Jun 30, 2026

Option to run uncalibrated benchmarks

Status: Open.

#1564 In mlcommons/modelbench;

· bkorycki opened on Jun 29, 2026

Security tests put extra information in test items for annotator

Status: Open.

#1561 In mlcommons/modelbench;

· bkorycki opened on Jun 25, 2026

Update security benchmark test item construction to include side information

Status: Open.

#1560 In mlcommons/modelbench;

· superdosh opened on Jun 25, 2026

Together dynamic sut factory can create dedicated endpoint suts

Status: Open.

#1559 In mlcommons/modelbench;

· bkorycki opened on Jun 24, 2026

Decide how to pass side information to evaluators

Status: Open.

#1555 In mlcommons/modelbench;

· superdosh opened on Jun 24, 2026