You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/Marathon Match Setup and Management.md
+19-6Lines changed: 19 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -285,22 +285,35 @@ Use this flow when the tester source changes after the challenge is active.
285
285
3. Create the new version with the updated Java source.
286
286
4. Wait until compilation reaches `SUCCESS`.
287
287
5. Save the scorer config so the challenge points at the new tester ID.
288
-
6. Trigger a rerun of latest submissions using the `Rerun scores` button on the UI.
289
-
7. Monitor the rerun ECS tasks, runner logs, artifacts, and review scores.
288
+
6. Trigger a rerun of latest submissions for the open Submission/Provisional phase using the Work app rerun control or `POST /v6/marathon-match/challenge/:challengeId/rerun`.
289
+
7. If Review/System scores also need to be regenerated, call `POST /v6/marathon-match/challenge/:challengeId/rerun/system`.
290
+
8. Monitor the rerun ECS tasks, runner logs, artifacts, and review scores.
290
291
291
292
292
-
Rerun behavior:
293
+
Submission/Provisional rerun behavior:
293
294
294
295
- Requires the challenge to be `ACTIVE`.
295
296
- Requires at least one open challenge phase.
296
297
- Requires the scorer config to be active.
297
298
- Requires the selected tester to be compiled successfully.
298
-
- Requires a `PROVISIONAL`phase config.
299
+
- Requires a phase config that matches the currently open challenge phase.
299
300
- Fetches `isLatest=true` submissions from Submission API.
300
301
- Queues one ECS task for the latest submission per member.
301
-
- Uses the current `PROVISIONAL`seeds and test count.
302
+
- Uses the current open phase's scorer seeds and test count. During Submission this is normally the `PROVISIONAL` config.
302
303
303
-
The response includes the queued submission IDs and ECS task IDs or per-submission errors. Because the standard rerun endpoint is provisional-oriented, coordinate separately if a late tester change also needs Review/System scores regenerated.
304
+
The response includes the queued submission IDs and ECS task IDs or per-submission errors.
305
+
306
+
System rerun behavior:
307
+
308
+
- Requires the challenge to be `ACTIVE`.
309
+
- Requires the scorer config to be active.
310
+
- Requires the selected tester to be compiled successfully.
311
+
- Requires a `SYSTEM` phase config.
312
+
- Fetches existing non-cancelled Review API reviews for the challenge that match the configured Marathon Match review scorecard.
313
+
- Queues one SYSTEM scorer task per matching review and passes the existing `reviewId` to the runner.
314
+
- Uses the current `SYSTEM` seeds, test count, per-test timeout, and `systemTestTimeout`.
315
+
316
+
Use the SYSTEM rerun endpoint after lowering timings or changing a tester while Review is open. It restarts the existing review records instead of creating duplicate reviews.
Copy file name to clipboardExpand all lines: docs/marathon-match-setup.md
+7-1Lines changed: 7 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -160,7 +160,13 @@ To switch an active challenge to a newer tester:
160
160
3. Update the challenge config with `PUT /v6/marathon-match/challenge/:challengeId` and the new `testerId`
161
161
4. Trigger a rescore of current competitors with `POST /v6/marathon-match/challenge/:challengeId/rerun`
162
162
163
-
The rerun endpoint selects `isLatest` submissions for the challenge in received order and launches ECS scorer tasks for them in parallel. This does not happen automatically when `testerId` changes, so the rerun call is the operational step that recalculates scores.
163
+
The standard rerun endpoint selects `isLatest` submissions for the challenge in received order and launches ECS scorer tasks for them in parallel using the scorer config for the currently open challenge phase. This does not happen automatically when `testerId` changes, so the rerun call is the operational step that recalculates Submission/Provisional scores.
The SYSTEM rerun endpoint reuses existing non-cancelled Review API review records that match the challenge's configured Marathon Match scorecard and dispatches each one through SYSTEM scoring with its existing `reviewId`.
164
170
165
171
Reruns can be requested by admins, M2M tokens with `update:marathon-match`, or the `Copilot` resource assigned to the challenge.
-`systemTestTimeout` controls the total SYSTEM scoring timeout per submission. It defaults to 24 hours and causes the API to stop a still-active ECS runner and write a failed SYSTEM summation with `metadata.timed_out = true`.
113
+
-`POST /v6/marathon-match/challenge/:challengeId/rerun/system` restarts existing non-cancelled SYSTEM reviews with the current `testTimeout`, `systemTestTimeout`, SYSTEM seed, and SYSTEM test count settings.
113
114
114
115
The default values supplied by `marathon-match-api-v6` are environment-configurable. If not overridden in service configuration, the API defaults are:
Copy file name to clipboardExpand all lines: docs/review-phase-scoring.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,6 +10,8 @@ When the Review phase opens for a Marathon Match challenge, `autopilot-v6` route
10
10
11
11
Manual phase changes are supported through the same path. If Review is opened directly in challenge-api, autopilot's challenge-update handling replays the phase-open work; startup recovery also replays already-open Review phases so missed update events still create and dispatch SYSTEM reviews.
12
12
13
+
Existing SYSTEM reviews can be restarted through `POST /v6/marathon-match/challenge/:challengeId/rerun/system`. This endpoint is intended for operator reruns after lowering timing settings or changing the tester while Review is open. It finds non-cancelled Review API reviews matching the challenge's configured Marathon Match scorecard, then dispatches SYSTEM scorer tasks with each existing `reviewId`.
This endpoint selects the latest submission for each member in received order and launches ECS scorer tasks in parallel using the challenge's `PROVISIONAL` phase config. Use it after changing the tester or when current latest submissions need to be rescored without waiting for new submission events.
121
+
This endpoint selects the latest submission for each member in received order and launches ECS scorer tasks in parallel using the scorer config that matches the currently open challenge phase. During Submission this is normally the challenge's `PROVISIONAL` phase config. Use it after changing the tester or when current latest submissions need to be rescored without waiting for new submission events.
The SYSTEM rerun endpoint restarts existing non-cancelled Review API reviews that match the challenge's configured Marathon Match review scorecard and passes each existing `reviewId` into the SYSTEM scorer.
122
128
123
129
Rerun access is limited to admins, M2M tokens with `update:marathon-match`, and the `Copilot` resource assigned to the challenge.
0 commit comments