Commit fa53ce3
fix(writer): reject NUL bytes in field names
A NUL inside a column name aborts the reference toolchain: the
Arrow FFI schema export hits a panic-cannot-unwind in arrow-rs
(ffi_stream::get_schema) and SIGABRTs the whole process (measured
against vortex-jni 0.75.0). Our pure-Java path handles NUL names
fine, so without the guard we emit files the canonical reader dies
on. Everything else is opaque UTF-8 and round-trips intact both
directions — "", whitespace-only, "$$$$$", newlines, emoji — all
measured and recorded in docs/compatibility.md.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>1 parent d3b5b25 commit fa53ce3
3 files changed
Lines changed: 28 additions & 0 deletions
File tree
- docs
- writer/src
- main/java/io/github/dfa1/vortex/writer
- test/java/io/github/dfa1/vortex/writer
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| 39 | + | |
39 | 40 | | |
40 | 41 | | |
41 | 42 | | |
| |||
Lines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
143 | 150 | | |
144 | 151 | | |
145 | 152 | | |
| |||
Lines changed: 20 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
97 | 97 | | |
98 | 98 | | |
99 | 99 | | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
100 | 120 | | |
101 | 121 | | |
102 | 122 | | |
| |||
0 commit comments