Skip to content

Improve active_learning density and checkpoint quality in 08b-interpret-your-run.md#1786

Merged
pelikhan merged 3 commits into
mainfrom
copilot/curriculum-eval-fix-active-learning-another-one
Jul 21, 2026
Merged

Improve active_learning density and checkpoint quality in 08b-interpret-your-run.md#1786
pelikhan merged 3 commits into
mainfrom
copilot/curriculum-eval-fix-active-learning-another-one

Conversation

Copilot AI commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

08b-interpret-your-run.md scored below benchmark on active_learning (density 0.88 vs ≥3.0/100 words) and checkpoint_quality (3 items vs ≥4 minimum), making it a passive reading exercise with no structured verification.

Changes

  • Structured fill-in exercise — replaces the vague "write one short note" prompt with a labeled code-fence template including example values, giving learners a concrete scaffold to verify they read the log correctly:

    First Tool call I saw:         [tool name, e.g. github.list_issues]
    What it was trying to do:      [one sentence description]
    
  • Failed run log example — adds a second text code block in the error-patterns section showing a 403 Forbidden failure signature, with a context sentence explaining it helps distinguish permission errors from vague-brief errors at a glance

  • Checkpoint expanded to 4 items — adds: "I can identify whether a run failed due to a permission error, a vague brief, or a missing output", directly anchoring the three error patterns listed above it

File stays at 571 words (limit: 600).

Copilot AI and others added 2 commits July 21, 2026 09:26
…run.md

- Convert 'write one short note' into a structured fill-in code fence exercise
- Add a second code block showing a failed run log (403 permission error) for comparison
- Expand checkpoint from 3 to 4 items: add 'I can identify whether a run failed due to a permission error, a vague brief, or a missing output'
- File stays under 600 words (561 words total)

Closes #1776

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
…un context sentence

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix active learning density and checkpoint items in 08b-interpret-your-run.md Improve active_learning density and checkpoint quality in 08b-interpret-your-run.md Jul 21, 2026
Copilot AI requested a review from pelikhan July 21, 2026 09:28
@pelikhan
pelikhan marked this pull request as ready for review July 21, 2026 09:29
@pelikhan
pelikhan merged commit e08298b into main Jul 21, 2026
22 checks passed
@pelikhan
pelikhan deleted the copilot/curriculum-eval-fix-active-learning-another-one branch July 21, 2026 09:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[curriculum-eval] 08b-interpret-your-run.md: active_learning — activity density 0.88, only 1 code block and 3 checklist items

2 participants