Commit 3e16c69
feat(bench): v2 republish — post-SQLR-23 pinned-host run + headline update (SQLR-25) (#114)
Reruns the full 12-workload suite (SQLRite + SQLite + DuckDB on Group B)
on the canonical Apple M1 Pro / macOS 23.5.0 host after SQLR-23 (parser
plan cache + bound `?` params + `Value::Vector`) bumped every workload
from `v1 → v2` and SQLR-28 took W10 → `v3`. The v1 numbers in
`docs/benchmarks.md` were dominated by per-iter SQL parsing on the bench
driver's SQLRite path; v2 measures the post-binding reality.
Headline: **W10 HNSW: 126.81 ms → 2.40 ms (~53× faster)**, with
brute-force-vs-HNSW gap now ~50× at 10k corpus (was ~1.1× in v1, masked
by parser tax + L2-only probe). Other parser-tax-dominated paths
tightened: W1 read-by-PK ~2.5×, W6 secondary-index ~2.6×, W3 bulk insert
~1.7×, W11 BM25 top-10 ~2.2× faster than v1. Compute-bound paths (W4
single-row insert, W5 mixed OLTP, W7 SUM, W8 GROUP BY) moved a few
percent — parser cost was a small slice of total time there.
Changes:
- `benchmarks/results/2026-05-08-apple-ac84d560.json` — canonical v2
envelope, 35 samples (Group A SQLRite+SQLite + Group B
SQLRite+SQLite+DuckDB + Group C SQLRite-only).
- `docs/benchmarks.md` — Headline numbers now reflect v2; v1 retained
in a "Historical (v1, retired)" section so the methodology shift is
visible. "Parser tax" sidebar updated to point at the new run.
- `benchmarks/README.md` — adds W10.v3 result table (the v1 retired
table stays alongside) + status banner bumped to 2026-05-08.
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>1 parent ac84d56 commit 3e16c69
3 files changed
Lines changed: 461 additions & 24 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
| 5 | + | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| |||
172 | 172 | | |
173 | 173 | | |
174 | 174 | | |
175 | | - | |
| 175 | + | |
176 | 176 | | |
177 | 177 | | |
178 | 178 | | |
| |||
183 | 183 | | |
184 | 184 | | |
185 | 185 | | |
186 | | - | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
187 | 195 | | |
188 | 196 | | |
189 | 197 | | |
| |||
0 commit comments