spark.sql.optimizer.constantFolding.enabled seems not to be a valid spark configuration.
|
"spark.sql.optimizer.constantFolding.enabled" -> "false") ++ extraCometConfigs |
Does this mean it should be configured as: spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding?
spark.sql.optimizer.constantFolding.enabledseems not to be a valid spark configuration.datafusion-comet/spark/src/test/scala/org/apache/spark/sql/benchmark/CometBenchmarkBase.scala
Line 127 in 95be2c3
Does this mean it should be configured as:
spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding?