Skip to content

Commit 2d2c99f

Browse files
schenksjclaude
andcommitted
feat: enable decimals in CometFuzzDeltaSuite
Removes the DecimalType exclusion from the fuzz schema generator. Unlike Iceberg (which excludes decimals due to iceberg-rust FIXED_LEN_BYTE_ARRAY page-index limitations), Comet's Delta path handles decimals correctly through the standard ParquetSource reader. All 7 fuzz tests pass with decimals included (decimal(10,2) and decimal(36,18) columns in the randomized schema). Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 688b633 commit 2d2c99f

1 file changed

Lines changed: 1 addition & 5 deletions

File tree

spark/src/test/scala/org/apache/comet/CometFuzzDeltaBase.scala

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -78,11 +78,7 @@ class CometFuzzDeltaBase extends CometTestBase with AdaptiveSparkPlanHelper {
7878
SchemaGenOptions(
7979
generateArray = true,
8080
generateStruct = true,
81-
primitiveTypes = SchemaGenOptions.defaultPrimitiveTypes.filterNot {
82-
// Match Iceberg fuzz: exclude DecimalType to avoid known Comet shuffle
83-
// hash-function edge cases with high-precision decimals.
84-
_.isInstanceOf[DecimalType]
85-
}))
81+
primitiveTypes = SchemaGenOptions.defaultPrimitiveTypes))
8682

8783
val options =
8884
DataGenOptions(

0 commit comments

Comments
 (0)