Skip to content

Commit 840e5b3

Browse files
committed
skills: allow single-attempt Tier 3 validation
Disable early stopping so the NVSkills canonical Tier 3 override can run with one attempt instead of being rejected before agent evaluation. Preserve the normal two-attempt configuration and Mitch's evaluator image-mode fixes. Signed-off-by: Thomas Alexander <talexander@nvidia.com>
1 parent bea5679 commit 840e5b3

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

skills/develop-cudaq-pass/evals/config.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,9 @@ harbor:
1111
base_image_mode: reuse
1212
n_attempts: 2
1313
pass_threshold: 0.60
14-
stop_on_pass: true
14+
# NVSkills validates canonical Tier 3 coverage with a single-attempt
15+
# override, which is incompatible with early stopping.
16+
stop_on_pass: false
1517
n_concurrent: 2
1618
max_agents: 2
1719
# Generated tasks default to 300 seconds. Preserve a 900-second ceiling for

0 commit comments

Comments
 (0)