Start spec-based-ecps-rewire: v6 post-mortem + calibrator decision#3

Merged

MaxGhenis merged 62 commits into

mainfrom

spec-based-ecps-rewire

Apr 25, 2026

Commits on Apr 17, 2026

Add v6 post-mortem and calibrator decision for spec-based-ecps-rewire

MaxGhenis
and
claude
committed
Amend calibrator-decision with sparse_coverage evidence; add scale-up plan

MaxGhenis
and
claude
committed
Add MicrocalibrateAdapter as mainline calibration backend

MaxGhenis
and
claude
committed
Diagnose PSID coverage = 0 in benchmark_multi_seed.json

MaxGhenis
and
claude
committed
Add ScaleUpRunner harness for synthesizer scale-up benchmark

MaxGhenis
and
claude
committed
Fix peak RSS reporting on macOS (ru_maxrss is bytes, not kilobytes)

MaxGhenis
and
claude
committed
Add stage-1 pilot results doc (pilot complete, full run in progress)

MaxGhenis
and
claude
committed
Persist scale-up results incrementally as JSONL

MaxGhenis
and
claude
committed
Add __main__ entry point for bakeoff package + incremental-JSONL test

MaxGhenis
and
claude
committed
Stage 1 scale-up results: small-benchmark ordering inverts at real scale

MaxGhenis
and
claude
committed
Run stage 1 at full 77k; cap PRDC samples to fix OOM

MaxGhenis
and
claude
committed
Stage 1 apples-to-apples 40k re-run + overnight session summary

MaxGhenis
and
claude
committed
Add per-column zero-rate breakdown + embedding-PRDC validation script

MaxGhenis
and
claude
committed
Wire MicrocalibrateAdapter into us.py pipeline (G1 unblocker)

MaxGhenis
and
claude
committed
Test zero_rate_per_column breakdown is populated on every stage result

MaxGhenis
and
claude
committed
Update overnight session summary with G1 unblocker + follow-on additions

MaxGhenis
and
claude
committed
Expose per-method hyperparameter overrides via method_kwargs

MaxGhenis
and
claude
committed
Add quickstart doc walking through rewire tooling end-to-end

MaxGhenis
and
claude
committed
Add calibrate-on-synthesizer experiment script

MaxGhenis
and
claude
committed
ZI-MAF hyperparameter tuning result: 10x gap to ZI-QRF not closeable

MaxGhenis
and
claude
committed
Embedding-PRDC validation: stage-1 ordering is not a metric artifact

MaxGhenis
and
claude
committed
Calibrate-on-synthesizer result: weighting doesn't rescue bad synthesis

MaxGhenis
and
claude
committed
Snap categorical shared cols in harness post-generation

MaxGhenis
and
claude
committed
Post-snap stage-1 results: ZI-QRF 0.928 coverage at 77k × 50

MaxGhenis
and
claude
committed
Note upstream PR #5 (microplex fix/shared-col-categorical-noise) in session summary

MaxGhenis
and
claude
committed
Expose --calibration-backend and --calibration-max-iter via checkpoint CLI

MaxGhenis
and
claude
committed

Commits on Apr 18, 2026

Commits on Apr 20, 2026

Precompute constraint metadata once; avoid 3× coefficient-array rescans

MaxGhenis
and
claude
committed

Commits on Apr 21, 2026

Commits on Apr 22, 2026

Commits on Apr 23, 2026

Make downstream aggregate weighting explicit; seed regime-aware imputer

MaxGhenis
and
claude
committed

Commits on Apr 25, 2026