Commit fc3e021
committed
Squash PR 122 and PR123 and address reviewer feedback
This commit squashes PR 122 (Context Cache Hit Rate) and PR 123 (PerformanceEvaluator unification) rebased onto PR 121.
- Added context cache hit rate metric to SystemEvaluator and CLI.
- Unified one-sided and side-by-side performance metrics in PerformanceEvaluator.
- Decoupled system and performance modules cleanly.
- Preserved backward-compatible LLMAsJudge wrapper, restored deprecated SQL-batch path symbols in evaluators.py, and restored LLMAsJudge support in Client.evaluate().
- Added live integration test for PerformanceEvaluator LLM judge path.
- Fixed notebook demos to use the new SystemEvaluator and PerformanceEvaluator.
- Updated Client.evaluate docstring to reflect the new performance evaluation path.
- Reformatted dashboard/app.py, tools.py, and improver_agent.py using pyink (no logic changes).
- Verified notebook diffs are minimal format sync (cell IDs and JSON escaping, no execution outputs).
TAG=agy
CONV=7051de01-a124-4d4a-b178-81af860027bc1 parent 0016418 commit fc3e021
107 files changed
Lines changed: 5088 additions & 5892 deletions
File tree
- dashboard
- deploy
- remote_function
- streaming_evaluation
- docs
- examples
- agent_improvement_cycle
- agent_improvement
- agent
- eval
- decision_lineage_demo
- scripts
- src
- bigquery_agent_analytics
- bigquery_ontology
- tests
- bigquery_ontology
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
955 | 955 | | |
956 | 956 | | |
957 | 957 | | |
| 958 | + | |
| 959 | + | |
| 960 | + | |
| 961 | + | |
| 962 | + | |
| 963 | + | |
| 964 | + | |
| 965 | + | |
| 966 | + | |
| 967 | + | |
| 968 | + | |
| 969 | + | |
958 | 970 | | |
959 | 971 | | |
960 | 972 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
32 | 31 | | |
33 | 32 | | |
34 | 33 | | |
| |||
123 | 122 | | |
124 | 123 | | |
125 | 124 | | |
126 | | - | |
127 | | - | |
128 | | - | |
129 | | - | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
130 | 129 | | |
131 | 130 | | |
132 | 131 | | |
| |||
0 commit comments