Commit da76f5b
authored
fix(spark): reject MapType instead of emitting a childless Arrow List (#8811)
`SparkToArrowSchema` mapped `MapType` to a childless `ArrowType.List`,
which is an invalid Arrow list (a List must have exactly one child).
Drop the branch so `MapType` falls through to the existing fail-fast
`UnsupportedOperationException`, and add a test.
Signed-off-by: jackylee <qcsd2011@gmail.com>1 parent 60c1227 commit da76f5b
2 files changed
Lines changed: 10 additions & 4 deletions
File tree
- java/vortex-spark/src
- main/java/dev/vortex/spark/write
- test/java/dev/vortex/spark/write
Lines changed: 0 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
27 | 26 | | |
28 | 27 | | |
29 | 28 | | |
| |||
125 | 124 | | |
126 | 125 | | |
127 | 126 | | |
128 | | - | |
129 | | - | |
130 | | - | |
131 | 127 | | |
132 | 128 | | |
133 | 129 | | |
| |||
Lines changed: 10 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
173 | 173 | | |
174 | 174 | | |
175 | 175 | | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
176 | 186 | | |
0 commit comments