You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: configs/mini/default.yaml
+10-1Lines changed: 10 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -32,7 +32,14 @@ instance_template: |
32
32
- `trajs/`: History of your edits
33
33
- and a lot more. It's up to you to explore and utilize these resources.
34
34
35
-
The game is played in rounds. You won't remember past rounds.
35
+
The game is played in rounds and you will be evaluated on the performance over all the rounds. You won't remember past rounds.
36
+
37
+
In every round, you have a limit of {{step_limit}} steps and a cost limit of {{cost_limit}} dollars.
38
+
We will show you the number of steps and cost used so far after every response in the `<limit_note>` tag.
39
+
After you've reached the step or cost limit, you cannot continue working on this task, and we will play the game with your codebase.
40
+
This means that it's fine to reach the step or cost limit while working on documentation or testing, but you shouldn't
41
+
reach the limit while working on the actual game logic to avoid submitting an invalid codebase.
42
+
36
43
So if you want to carry knowledge forward — leave tools, notes, or strategies in the codebase.
37
44
Good documentation means you (and others) can pick up right where you left off.
38
45
@@ -112,6 +119,7 @@ instance_template: |
112
119
</example_response>
113
120
114
121
If you need to run multiple commands, either:
122
+
115
123
1. Combine them in one block using && or ||
116
124
```bash
117
125
command1 && command2 || echo "Error occurred"
@@ -179,6 +187,7 @@ instance_template: |
179
187
This command will submit your work.
180
188
You cannot continue working (reading, editing, testing) in any way on this task after submitting.
181
189
action_observation_template: |
190
+
<limit_note>This is the output of step {{n_model_calls}} ({{step_limit}} limit). You've used {{model_cost | round(2)}} USD ({{cost_limit}} USD limit).</limit_note>
0 commit comments