Skip to content

Commit 55566e5

Browse files
dfa1claude
andcommitted
docs: add Parquet vs Vortex benchmark results (3× faster, scalar-vs-scalar)
Also fix CLI import subcommand description to mention Parquet support. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
1 parent 84b4a75 commit 55566e5

1 file changed

Lines changed: 12 additions & 1 deletion

File tree

README.md

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -138,7 +138,7 @@ java -jar cli/target/vortex.jar <subcommand> [args]
138138
| `export` | `export <file.vortex>` | Write all columns to CSV on stdout |
139139
| `select` | `select <file.vortex> <col> [col2 ...]` | Project specific columns to CSV on stdout |
140140
| `filter` | `filter <file.vortex> <expr>` | Filter rows to CSV (e.g. `"price >= 100"`) |
141-
| `import` | `import <file.csv> [out.vortex]` | Convert CSV to Vortex (output defaults to `<input>.vortex`) |
141+
| `import` | `import <file.csv\|file.parquet> [out.vortex]` | Convert CSV or Parquet to Vortex (output defaults to `<input>.vortex`) |
142142

143143
Filter operators: `>`, `>=`, `<`, `<=`, `=`, `==`. Values are parsed as integer, double, boolean, or string.
144144

@@ -278,6 +278,17 @@ JMH throughput (ops/s = full-file scans per second). Higher is better.
278278
|-----------|--------------|------------------|--------------|
279279
| scan | 20.4 ± 0.9 | 5.7 ± 0.6 | **3.6×** |
280280
281+
### Parquet vs Vortex read — NYC Yellow Taxi 2024-01, 3M rows, 3 columns
282+
283+
Source: 47.6 MB Parquet → 12.0 MB Vortex (4× compression). Both sides scalar decode
284+
(Hardwood disables SIMD on JDK 25; Vortex Java uses FFM scalar reads throughout).
285+
286+
| Benchmark | ops/s | vs Parquet |
287+
|---|---|---|
288+
| `parquetRead` — Hardwood, single col (`trip_distance`) | 66.96 ± 1.99 | baseline |
289+
| `vortexRead` — single col (`trip_distance`) | 201.61 ± 1.63 | **3.0×** |
290+
| `vortexReadMultiColumn` — two cols (`fare_amount` + `PULocationID`) | 140.31 ± 5.42 | **2.1×** |
291+
281292
### Why fewer layers = faster
282293
283294
This is my hypothesis:

0 commit comments

Comments
 (0)