Skip to content

Commit 10da742

Browse files
committed
update docs
1 parent d967143 commit 10da742

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

docs/source/user-guide/latest/jvm_udf_dispatch.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,7 @@ Comet can route Spark `ScalaUDF` expressions through a JVM-side kernel that proc
3333
- Scalar input and output types: `Boolean`, `Byte`, `Short`, `Int`, `Long`, `Float`, `Double`, `Decimal`, `String`, `Binary`, `Date`, `Timestamp`, `TimestampNTZ`.
3434
- Complex input and output types with arbitrary nesting: `ArrayType`, `StructType`, `MapType`.
3535
- Composition with other Catalyst expressions inside the user function's argument tree (e.g. `myUdf(upper(s))` binds the whole tree and compiles into one kernel).
36+
- Higher-order functions (`transform`, `filter`, `exists`, `aggregate`, `zip_with`, `map_filter`, `map_zip_with`, etc.) inside the argument tree. Each HOF runs as a single per-row interpreted-eval call site spliced into the kernel; surrounding non-HOF expressions stay codegen.
3637

3738
## Not supported
3839

@@ -41,6 +42,7 @@ Comet can route Spark `ScalaUDF` expressions through a JVM-side kernel that proc
4142
- Python `@udf` and Pandas `@pandas_udf`.
4243
- Hive `GenericUDF` and `SimpleUDF`.
4344
- `CalendarIntervalType` arguments and return types.
45+
- Trees whose total nested-field count (output plus all `BoundReference` inputs) exceeds `spark.sql.codegen.maxFields` (default 100). The dispatcher refuses these at plan time and the operator falls back to Spark.
4446

4547
## Behavior
4648

0 commit comments

Comments
 (0)