Commit a380a41
docs: document >2GB file advantage over Parquet; add TODO for large-file test
Vortex uses uint64 offsets in the footer and uint32 segment lengths,
avoiding Parquet's 2GB column-chunk limit (int32 page-size field).
The FFM MemorySegment API maps files of arbitrary size, unlike the
legacy FileChannel.map() which caps each mapping at 2GB.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>1 parent 46817aa commit a380a41
2 files changed
Lines changed: 20 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
21 | 32 | | |
22 | 33 | | |
23 | 34 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
123 | 123 | | |
124 | 124 | | |
125 | 125 | | |
126 | | - | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
0 commit comments