Skip to content

Commit a3ed551

Browse files
authored
workflow: convert dense simulation setup prose to numbered steps (#1948)
1 parent 787c729 commit a3ed551

2 files changed

Lines changed: 6 additions & 2 deletions

File tree

.github/workflows/workshop-student-simulator.lock.yml

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

.github/workflows/workshop-student-simulator.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -255,7 +255,11 @@ The profiles are generated from `.github/skills/micro-environment-simulator/work
255255

256256
For each student in the generated cohort, simulate their experience step-by-step using the following rules:
257257

258-
First read the baseline Monte Carlo output that was already written to `/tmp/gh-aw/agent/sim/data/monte-carlo-replay.json`, then read both `curriculum.json` and `curriculum-quality-metrics.json`. Build a candidate set from the five highest-dropout steps and the five lowest-scoring curriculum steps. Semantically score and rank every candidate using the `stateReadiness`, `pathClarity`, and `recoverySupport` dimensions defined below, then select the three highest-risk steps for detailed analysis. Inspect every workshop page mapped to each selected step, plus the preceding activities that produce its required state, before writing `/tmp/gh-aw/agent/sim/data/agent-step-insights.json`. A simulated step may map to several pages; do not treat a file limit as a step limit. For example, inspect the learner's Step 7 authoring path (Terminal, GitHub UI, or GitHub Copilot) and the shared Step 7d model-access activity before adjusting Step 8.
258+
1. Read the baseline Monte Carlo output that was already written to `/tmp/gh-aw/agent/sim/data/monte-carlo-replay.json`, then read both `curriculum.json` and `curriculum-quality-metrics.json`.
259+
2. Build a candidate set from the five highest-dropout steps and the five lowest-scoring curriculum steps.
260+
3. Semantically score and rank every candidate using the `stateReadiness`, `pathClarity`, and `recoverySupport` dimensions defined below, then select the three highest-risk steps for detailed analysis.
261+
4. Inspect every workshop page mapped to each selected step, plus the preceding activities that produce its required state, before writing `/tmp/gh-aw/agent/sim/data/agent-step-insights.json`.
262+
5. A simulated step may map to several pages; do not treat a file limit as a step limit. For example, inspect the learner's Step 7 authoring path (Terminal, GitHub UI, or GitHub Copilot) and the shared Step 7d model-access activity before adjusting Step 8.
259263

260264
Evaluate content assumptions semantically instead of inferring state from keyword counts. Use one focused yes/no question per assumption, answer only `YES`, `NO`, or `UNKNOWN`, and cite `file:line` evidence. Copy each step's `contentHash` from the baseline output into `evaluatedContentHash`. The simulator ignores evaluations when that hash does not match the current mapped page content, so page edits require fresh evaluations.
261265

0 commit comments

Comments
 (0)