Skip to content

Commit e0a1efb

Browse files
committed
gaia: baseline_floor off (feedback #1)
The floor gates a ship on a validation comparison while gaia's reward is on the test partition (different distributions), so keep it opt-in / off. Now that the harbor default is false this is explicit-for-clarity.
1 parent 9e8c1fb commit e0a1efb

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

harness-engineering-bench/gaia/baseline/build.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ objective:
3838
metric: score
3939
direction: maximize
4040
reward_mode: submit # agent picks; falls back to auto_best, then current version
41-
baseline_floor: true
41+
baseline_floor: false # gates on validation while reward is on test; opt-in only
4242
score_baseline: true
4343
rescore_top_k: 3
4444
rescore_attempts: 1

0 commit comments

Comments
 (0)