Quality report: dimensions, correction analysis, execution traces, golden-Q&A grounding, and version filtering#174

Merged

haiyuan-eng-google merged 30 commits into

GoogleCloudPlatform:mainfrom

evekhm:feat/quality-dimensions

Jun 15, 2026

Commits on May 27, 2026

Add quality dimensions, multi-turn metrics, and streamlined report format
evekhm
committed
Add correction/verification inference and multi-turn conversation extraction
evekhm
committed
Improve scope-aware eval accuracy with conditional declined category and ground truth support
evekhm
committed
Add scope config example, remove in_scope_topics, update README
evekhm
committed
Remove ground truth from scope context, update sample reports with fresh eval run
evekhm
committed
Add --conversations-file for local JSON scoring without BigQuery
evekhm
committed
Update quality report format (as a goal)
evekhm
committed
Add per-category sample control for report sections
evekhm
committed
Make correction inference concurrent with asyncio.gather
evekhm
committed
Allow --help/-h without env vars in quality_report.sh
evekhm
committed
Add dynamic low-dimension sections and report metadata
evekhm
committed
Fix help text, enable --tag-turns for BQ, and fix --env loading
evekhm
committed
Add correction analysis with trajectory segmentation, routing failure detection, and parroting detection
evekhm
committed
Add parroting penalty to eval and auto-discover eval_config.json
evekhm
committed
Add per_session_context support for golden eval
evekhm
committed
Auto-fetch execution trace for single-session quality report
evekhm
committed
Address PR #174 review: fix dimension scoring, TOOL_ERROR counting, and module constants
evekhm
committed

Commits on May 28, 2026

Commits on May 29, 2026

Address PR #174 review: tool_usage no_tool_needed, --dimensions flag, and hardening
evekhm
committed

Commits on May 31, 2026

Add eval-spec grounding (scope + golden Q&A) and failure-cause taxonomy
evekhm
committed

Commits on Jun 2, 2026

Apply autoformat (isort + pyink) to fix format check
evekhm
committed

Commits on Jun 8, 2026

Merge branch 'GoogleCloudPlatform:main' into feat/quality-dimensions
evekhm
authored

Commits on Jun 12, 2026

Merge branch 'main' into feat/quality-dimensions
haiyuan-eng-google
authored

Commits on Jun 15, 2026

Merge branch 'main' into feat/quality-dimensions
haiyuan-eng-google
authored