Commit 6867eed
test: add comprehensive JVM shuffle benchmarks
Add jvm_shuffle.rs benchmark that covers the full range of data types
processed by `process_sorted_row_partition()` in JVM shuffle:
- Primitive columns (100 Int64 columns)
- Struct (flat with 5/10/20 fields)
- Nested struct (2 levels deep)
- Deeply nested struct (3 levels deep)
- List<Int64>
- Map<Int64, Int64>
This replaces the old row_columnar.rs which only tested primitive columns.
These benchmarks help measure the performance of the row-to-columnar
conversion used by CometColumnarShuffle when writing shuffle data.
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>1 parent 3fcebd3 commit 6867eed
3 files changed
Lines changed: 842 additions & 114 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
122 | 122 | | |
123 | 123 | | |
124 | 124 | | |
125 | | - | |
| 125 | + | |
126 | 126 | | |
127 | 127 | | |
128 | 128 | | |
| |||
0 commit comments