Skip to content

Add Stage 2 input artifact bundles#1067

Merged
anth-volk merged 1 commit into
mainfrom
agent/stage-2/pr-2b-input-artifact-bundles
May 22, 2026
Merged

Add Stage 2 input artifact bundles#1067
anth-volk merged 1 commit into
mainfrom
agent/stage-2/pr-2b-input-artifact-bundles

Conversation

@anth-volk
Copy link
Copy Markdown
Collaborator

@anth-volk anth-volk commented May 20, 2026

Fixes #1065

Summary

  • add Stage2InputBundle, CalibrationPackageOutputBundle, and run-scoped Stage 2 build context specs
  • resolve Stage 2 inputs from dataset_build_output.json when available, while keeping filename fallback marked as compatibility-only
  • validate Stage 1 contract-declared input checksum and size before package work starts
  • wire pipeline and remote package construction through the input/output bundles before package work starts
  • add structured input validation material to the Stage 2 manifest identity and update pipeline docs metadata

Validation

  • uv run --no-sync --with pyyaml python scripts/extract_pipeline_docs.py
  • ruff check modal_app/pipeline.py modal_app/remote_calibration_runner.py policyengine_us_data/calibration_package/__init__.py policyengine_us_data/calibration_package/specs.py tests/unit/calibration_package/test_specs.py tests/unit/test_pipeline_docs_extractor.py tests/unit/test_pipeline_source_contracts.py
  • ruff format --check modal_app/pipeline.py modal_app/remote_calibration_runner.py policyengine_us_data/calibration_package/__init__.py policyengine_us_data/calibration_package/specs.py tests/unit/calibration_package/test_specs.py tests/unit/test_pipeline_docs_extractor.py tests/unit/test_pipeline_source_contracts.py
  • uv run --no-sync --with pyyaml python scripts/run_quality_guards.py
  • uv run --no-sync pytest tests/unit/calibration_package/test_specs.py tests/unit/test_pipeline.py tests/unit/test_pipeline_doc_guards.py tests/unit/test_pipeline_docs_extractor.py tests/unit/test_pipeline_source_contracts.py tests/unit/test_remote_calibration_runner.py (42 passed, 1 skipped)
  • make lint
  • git diff --check origin/main...HEAD
  • git diff --check

@anth-volk anth-volk force-pushed the agent/stage-2/pr-2a-specs-explicit-identity branch 3 times, most recently from 0d0734b to 66cb8c5 Compare May 22, 2026 14:27
@anth-volk anth-volk force-pushed the agent/stage-2/pr-2b-input-artifact-bundles branch from 5f4be4c to 25cf067 Compare May 22, 2026 15:44
@anth-volk anth-volk changed the base branch from agent/stage-2/pr-2a-specs-explicit-identity to main May 22, 2026 15:44
@anth-volk anth-volk force-pushed the agent/stage-2/pr-2b-input-artifact-bundles branch from 25cf067 to 5d9cde6 Compare May 22, 2026 16:18
@anth-volk anth-volk force-pushed the agent/stage-2/pr-2b-input-artifact-bundles branch from 5d9cde6 to 7c1c3e5 Compare May 22, 2026 16:54
@anth-volk anth-volk marked this pull request as ready for review May 22, 2026 19:17
@anth-volk anth-volk merged commit e16fcf9 into main May 22, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Stage 2 input and output bundles

1 participant