Commit 2b980ae
committed
test(bench-orchestrator): replace golden matrix snapshots with targeted assertions
The golden files pinned every field of all nine profiles, so any intentional
matrix change meant regenerating nine JSON snapshots -- churn with the standard
snapshot failure mode of blind regeneration. Drop them in favor of targeted
assertions on the load-bearing fields (selection and engine/format targets), a
structural smoke check that every profile resolves to well-formed entries, and a
check on the secondary fields CI depends on (remote_key, scale_factor). The
develop/nightly behavior-preservation tests are unchanged.
Signed-off-by: Connor Tsui <connor@spiraldb.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PQg1cgPLKJg4QVJvE2xa3Q1 parent 521a932 commit 2b980ae
11 files changed
Lines changed: 35 additions & 1427 deletions
File tree
- bench-orchestrator
- tests
- golden
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
235 | 235 | | |
236 | 236 | | |
237 | 237 | | |
238 | | - | |
| 238 | + | |
239 | 239 | | |
240 | | - | |
241 | | - | |
242 | | - | |
243 | | - | |
| 240 | + | |
| 241 | + | |
| 242 | + | |
| 243 | + | |
| 244 | + | |
244 | 245 | | |
245 | 246 | | |
246 | 247 | | |
| |||
This file was deleted.
0 commit comments