Skip to content

Commit 1ed7e24

Browse files
fix(proof-bundle): non-vacuous fixtures so reconcile reports complete (#67)
## Summary Fixes the pre-existing **"Proof assistant bundle checks"** CI failure (the one flagged on #65 as unrelated to that PR). The `proof-assistant-bundle` job runs `test/ci/proof_bundle_reconciliation.jl` + `scripts/proof-bundle-evidence.jl`; both failed because `reconcile_proof_bundle` returned `"incomplete"` where they expected `"complete"`. ## Root cause — stale test fixtures, not a logic bug This is the honesty machinery working *correctly*. Both fixtures wrote proof artifacts whose theorem proves bare **`True`**: ```lean theorem ci_bundle_complete : True := by trivial ``` `proof_export.jl`'s `_vacuous_statement` / `_assistant_has_substantive_statement` (added to stop false "verified" claims) correctly treats a `True`-only tautology as **vacuous** — it proves nothing about the model — so the artifact reconciles to `"incomplete"`. The fixtures were stale relative to that check. ## Fix Replace the vacuous `True` statements with a real, non-vacuous claim (`1 + 1 = 2`) in the Lean/Coq/Isabelle fixtures of **both** files, exercising the substantive-statement path so reconciliation reports `"complete"` / `"assistant_completed"` as intended. No production logic changed — only the test/evidence fixtures. ## Verification - `test/ci/proof_bundle_reconciliation.jl` → **12/12** pass. - `scripts/proof-bundle-evidence.jl` → exit 0, writes `build/proof_bundle_evidence.json`. 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_01UPFC9YQ7g9gc3VnRox42Q1 --- _Generated by [Claude Code](https://claude.ai/code/session_01UPFC9YQ7g9gc3VnRox42Q1)_ Co-authored-by: Claude <noreply@anthropic.com>
1 parent 815e66b commit 1ed7e24

2 files changed

Lines changed: 8 additions & 10 deletions

File tree

scripts/proof-bundle-evidence.jl

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -54,8 +54,7 @@ function main()
5454
-- AXIOM_PROOF_METHOD: pattern
5555
-- AXIOM_OBLIGATION_ID: $(expected_id)
5656
57-
theorem proof_bundle_complete : True := by
58-
trivial
57+
theorem proof_bundle_complete : 1 + 1 = 2 := by decide
5958
""",
6059
)
6160

@@ -67,9 +66,9 @@ function main()
6766
(* AXIOM_PROOF_METHOD: pattern *)
6867
(* AXIOM_OBLIGATION_ID: $(expected_id) *)
6968
70-
Theorem proof_bundle_complete : True.
69+
Theorem proof_bundle_complete : 1 + 1 = 2.
7170
Proof.
72-
exact I.
71+
reflexivity.
7372
Qed.
7473
""",
7574
)
@@ -86,7 +85,7 @@ function main()
8685
(* AXIOM_PROOF_METHOD: pattern *)
8786
(* AXIOM_OBLIGATION_ID: $(expected_id) *)
8887
89-
theorem proof_bundle_complete: "True"
88+
theorem proof_bundle_complete: "(1::nat) + 1 = 2"
9089
by simp
9190
9291
end

test/ci/proof_bundle_reconciliation.jl

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -56,8 +56,7 @@ end
5656
-- AXIOM_PROOF_METHOD: pattern
5757
-- AXIOM_OBLIGATION_ID: $(expected_id)
5858
59-
theorem ci_bundle_complete : True := by
60-
trivial
59+
theorem ci_bundle_complete : 1 + 1 = 2 := by decide
6160
""",
6261
)
6362

@@ -69,9 +68,9 @@ end
6968
(* AXIOM_PROOF_METHOD: pattern *)
7069
(* AXIOM_OBLIGATION_ID: $(expected_id) *)
7170
72-
Theorem ci_bundle_complete : True.
71+
Theorem ci_bundle_complete : 1 + 1 = 2.
7372
Proof.
74-
exact I.
73+
reflexivity.
7574
Qed.
7675
""",
7776
)
@@ -88,7 +87,7 @@ end
8887
(* AXIOM_PROOF_METHOD: pattern *)
8988
(* AXIOM_OBLIGATION_ID: $(expected_id) *)
9089
91-
theorem ci_bundle_complete: "True"
90+
theorem ci_bundle_complete: "(1::nat) + 1 = 2"
9291
by simp
9392
9493
end

0 commit comments

Comments
 (0)