Skip to content

[curriculum-eval] 08b-interpret-your-run.md: active_learning — activity density 0.88, only 1 code block and 3 checklist items #1776

Description

@github-actions

File: workshop/08b-interpret-your-run.md
Overall Score: 8.08 / 10.0 (corpus mean: 8.80)

Flagged Dimensions:

Dimension Score Benchmark Delta
active_learning 2.9 ≥ 10.0 (density ≥ 3.0/100 words) -7.1
checkpoint_quality 7.5 10.0 (≥ 4 checklist items) -2.5

Root Cause (≤ 2 sentences):
The page has only 1 code block and 3 checklist items across 456 words (density 0.88), making it primarily a reading exercise rather than an applied task. The checkpoint has only 3 items — one below the 4-item minimum — so learners cannot fully verify their understanding.

Evidence (quoted from the file):

"The important question is not 'Can I read every line?' It is 'Can I tell where the agent decided, where it acted, and whether it finished?' Find the first Tool call in your own run and write one short note about what it was trying to do."

Learning Science Rationale:
Sweller's Cognitive Load Theory distinguishes between germane load (effort that builds schemas) and extraneous load (unproductive effort). A step that asks learners to "find the first Tool call and write one short note" without a structured activity or verification checklist fails to create germane load — learners have no scaffold to confirm they understood the log structure correctly.

Improvement Prompt (for an agent):

In workshop/08b-interpret-your-run.md, improve active_learning density and checkpoint quality by:
1. Converting the "write one short note" suggestion into a structured exercise with a code fence showing where to fill in the answer.
2. Adding a second short code block showing an example of a failed run log for comparison.
3. Expanding the checkpoint to 4 items: add a fourth item like "I can identify whether a run failed due to a permission error, a vague brief, or a missing output."
Keep the file under 600 words total.

Expected Score After Fix: 9.0 / 10.0

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔬 Curriculum Quality Evaluator · 80.1 AIC · ⌖ 6.65 AIC · ⊞ 6.2K ·

  • expires on Jul 22, 2026, 9:10 AM UTC

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions