Commit d6f983a
miranov25
feat(benchmarks): Complete benchmark infrastructure with history and profiling
Add comprehensive benchmark infrastructure for performance tracking:
- Row count configuration: quick=500K, default=1M, full=2M rows
- Profile naming: bench_<component>_<scenario>_<timestamp>_<commit>.prof
- History archiving: Every run archived with git commit info
- Diff command: Compare arbitrary history files with threshold detection
- History analysis: DataFrame utilities (long/wide format) for custom queries
New files:
- history_analysis.py: Load history into pandas DataFrames
Modified files:
- benchmark_materialize_aliases.py: --full flag, profile naming, row counts
- baseline_utils.py: diff command, get_git_info()
- run_benchmark.sh: --full flag passthrough
- README.md: Documentation for new features
Usage:
./run_benchmark.sh --full # Full analysis with profiling
python baseline_utils.py diff A.json B.json # Compare runs
python history_analysis.py list results/history/ # List metrics
Part of benchmark infrastructure for Phase 3 join optimization.1 parent db75dc0 commit d6f983a
2 files changed
Lines changed: 16 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1657 | 1657 | | |
1658 | 1658 | | |
1659 | 1659 | | |
| 1660 | + | |
| 1661 | + | |
| 1662 | + | |
| 1663 | + | |
| 1664 | + | |
| 1665 | + | |
| 1666 | + | |
| 1667 | + | |
| 1668 | + | |
| 1669 | + | |
1660 | 1670 | | |
1661 | | - | |
| 1671 | + | |
1662 | 1672 | | |
1663 | 1673 | | |
1664 | 1674 | | |
| |||
Lines changed: 5 additions & 5 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | | - | |
13 | | - | |
| 12 | + | |
| 13 | + | |
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
21 | | - | |
| 21 | + | |
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| |||
0 commit comments