Skip to content

Commit 214b0f0

Browse files
authored
feat(reporting): add researchReport executive summary layer (#34)
researchReport composes summaryTable, paretoChart, gainHistogram, held-out gate decisions, and optional failureClusterView output into one structured artifact for coding-vertical benchmark runs: - promote/hold/reject decision with rationale, risks, next actions - per-candidate stats (Wilcoxon q-value, Cohen's d, paired N, gain CI) - Pareto frontier flagging - markdown, HTML, and JSON chart specs Wired into src/index.ts and the @tangle-network/agent-eval/reporting subpath. Tests in tests/summary-report.test.ts cover decision logic, candidate scoring, and output formats.
1 parent b66856d commit 214b0f0

5 files changed

Lines changed: 618 additions & 0 deletions

File tree

CHANGELOG.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,15 @@
11
# Changelog
22

3+
## Unreleased
4+
5+
### Added
6+
7+
- `researchReport`, an executive research-report layer for coding-vertical
8+
benchmark runs. Composes `summaryTable`, `paretoChart`, `gainHistogram`,
9+
held-out gate decisions, and optional `failureClusterView` output into
10+
promote/hold/reject guidance, risks, next actions, markdown, HTML, and JSON
11+
chart specs.
12+
313
## 0.20.10 — hardening audit follow-up
414

515
### Fixed

src/index.ts

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -735,6 +735,7 @@ export {
735735
summaryTable,
736736
paretoChart,
737737
gainHistogram,
738+
researchReport,
738739
} from './summary-report'
739740
export type {
740741
SummaryTable,
@@ -745,6 +746,11 @@ export type {
745746
GainDistributionFigureSpec,
746747
GainDistributionBin,
747748
GainDistributionOptions,
749+
ResearchReport,
750+
ResearchReportOptions,
751+
ResearchReportCandidate,
752+
ResearchReportDecision,
753+
ResearchReportRecommendation,
748754
} from './summary-report'
749755

750756
export { runCanaries } from './canary'

src/reporting.ts

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,7 @@ export type { RenderReleaseReportOptions } from './release-report'
2121
export {
2222
gainHistogram,
2323
paretoChart,
24+
researchReport,
2425
summaryTable,
2526
} from './summary-report'
2627
export type {
@@ -29,6 +30,11 @@ export type {
2930
GainDistributionOptions,
3031
ParetoFigureSpec,
3132
ParetoPoint,
33+
ResearchReport,
34+
ResearchReportCandidate,
35+
ResearchReportDecision,
36+
ResearchReportOptions,
37+
ResearchReportRecommendation,
3238
SummaryTable,
3339
SummaryTableOptions,
3440
SummaryTableRow,

0 commit comments

Comments
 (0)