Skip to content

Commit 5760495

Browse files
authored
Update README.md for formatting and content clarity
Signed-off-by: Jonathan Harrison <145727918+Raiff1982@users.noreply.github.com>
1 parent 61299d1 commit 5760495

1 file changed

Lines changed: 14 additions & 11 deletions

File tree

README.md

Lines changed: 14 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -3,13 +3,13 @@
33
This repository provides a governance-first benchmark for evaluating AI systems, with a focus on truth anchoring, ethical resilience, determinism, and transparency.
44
It includes 30 tasks across three sets (Adversarial Fact Verification, Multi-Step Tool-Augmented Reasoning, Constrained Policy Generation), with structured traces, metrics, and harnesses in both Python and TypeScript.
55

6-
Transparency & Development History
6+
# Transparency & Development History
77

88
This repo intentionally preserves earlier iterations (see the /archive/ folder) to document the full development trail.
99
Governance benchmarking requires not only results, but proof of how they were reached.
1010
Dead-ends, fixes, recovery attempts, and experimental variants are logged here for reproducibility and auditability.
1111

12-
Canonical files for current usage:
12+
# Canonical files for current usage:
1313

1414
run_harness.py (Python reference runner)
1515

@@ -27,7 +27,7 @@ trace_schema.yaml (execution trace schema)
2727

2828
Historical versions are archived under /archive/ for transparency.
2929

30-
Contents
30+
# Contents:
3131

3232
tasks.jsonl — 30 tasks (10 per set), with authoritative_source in AFV tasks for source prioritization
3333

@@ -45,22 +45,22 @@ Codette_Governance_Benchmark_Scores.csv — sample scores
4545

4646
fairness_metrics.py — fairness/bias checks
4747

48-
Task Sets
49-
1. Adversarial Fact Verification (AFV)
48+
# Task Sets:
49+
- 1. Adversarial Fact Verification (AFV)
5050

5151
Stress-tests truth anchoring with mixed-reliability sources.
5252

5353
Each task includes an authoritative_source field identifying the correct reference.
5454

55-
2. Multi-Step Tool-Augmented Reasoning (MSR)
55+
- 2. Multi-Step Tool-Augmented Reasoning (MSR)
5656

5757
Evaluates deterministic execution with structured inputs and calculations.
5858

59-
3. Constrained Policy Generation (CPG)
59+
- 3. Constrained Policy Generation (CPG)
6060

6161
Tests ethical adherence and recovery under explicit red-lines.
6262

63-
Metrics
63+
# Metrics:
6464

6565
Determinism Index — stability across identical runs (% identical outputs).
6666

@@ -76,7 +76,8 @@ Error Recovery Pattern — behavior on near-violations or ambiguous inputs.
7676

7777
Fairness Metrics — bias and distribution checks (fairness_metrics.py).
7878

79-
Usage
79+
# Usage:
80+
8081
Python
8182
python run_harness.py --tasks tasks.jsonl --runs 10 --out results.jsonl
8283
python score_results.py results.jsonl
@@ -99,17 +100,19 @@ Merged Enhanced instructions into this unified README
99100

100101
Added fairness_metrics.py
101102

102-
Full details: see CHANGELOG.md
103+
# Full details: see CHANGELOG.md
103104
.
104105

105-
Notes
106+
# Notes
106107

107108
Ground truths are synthetic anchors. Replace/augment with live sources for production.
108109

109110
The benchmark is deliberately small (30 items) for reproducibility. Extend as needed.
110111

111112
Historical versions are preserved in /archive/ for transparency.
112113

114+
#
115+
{
113116
Citation
114117
@misc{codette_governance_benchmark,
115118
title = {Governance Benchmark Package (Codette ↔ SIM-ONE)},

0 commit comments

Comments
 (0)