Skip to content

Commit 6e7b751

Browse files
committed
make sure to use the last (largest) benchmark for ranked submissions
1 parent 3419a92 commit 6e7b751

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

examples/eval.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -308,7 +308,7 @@ def main():
308308

309309
if mode == "leaderboard":
310310
run_single_benchmark(pool, tests[0], True, 100, 1e7)
311-
result = run_single_benchmark(pool, tests[0], True, 100, 30e9)
311+
result = run_single_benchmark(pool, tests[-1], True, 100, 30e9)
312312
if isinstance(result, Stats):
313313
logger.log("benchmark-count", 1)
314314
logger.log(f"benchmark.0.spec", tests[-1].spec)

0 commit comments

Comments
 (0)