Commit 0480e82
committed
fix: pass return type for MapSort serde
The MapSort serde for Spark 4.0 called scalarFunctionExprToProto without a
return type. The Rust planner then looked up "map_sort" in the session
UDF registry to infer the type, but map_sort is only handled via the
create_comet_physical_fun match dispatch, not registered as a UDF, causing
"There is no UDF named 'map_sort' in the registry" at execution time
(e.g., group-by on a map column in CollationSuite).
Pass ms.dataType explicitly via scalarFunctionExprToProtoWithReturnType,
matching the pattern used by ceil, floor, and other scalar functions.1 parent f99ba23 commit 0480e82
2 files changed
Lines changed: 19 additions & 2 deletions
File tree
- spark/src
- main/spark-4.0/org/apache/comet/shims
- test/scala/org/apache/comet
Lines changed: 6 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
| 33 | + | |
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
| |||
130 | 130 | | |
131 | 131 | | |
132 | 132 | | |
133 | | - | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
134 | 138 | | |
135 | 139 | | |
136 | 140 | | |
| |||
Lines changed: 13 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
30 | 31 | | |
31 | 32 | | |
32 | 33 | | |
| |||
221 | 222 | | |
222 | 223 | | |
223 | 224 | | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
224 | 237 | | |
225 | 238 | | |
226 | 239 | | |
| |||
0 commit comments