Skip to content

Commit d03d99a

Browse files
committed
chore: remove dead native_iceberg_compat JVM Parquet reader chain
Now that native_iceberg_compat is gone, the JVM-mediated V1 Parquet read path (CometScanExec → CometScanWrapper → CometParquetFileFormat → NativeBatchReader / column-level Native APIs) is unreachable. Iceberg also no longer integrates against Comet's @IcebergApi surface. - CometExecRule: V1 CometScanExec fallback now reverts to wrapped FileSourceScanExec (Spark) instead of CometScanWrapper. - CometScanExec: keep as planning intermediate, throw on doExecute/doExecuteColumnar/executeCollect/inputRDDs. - Drop file-format swap to CometParquetFileFormat in both CometScanExec.apply and CometNativeScanExec.apply. - Delete CometParquetFileFormat and the JVM Parquet reader chain (NativeBatchReader, NativeColumnReader, ColumnReader, RowGroupReader, FileReader, plus all supporting page/index/options/utility classes). - Delete IcebergCometNativeBatchReader and CometLazyVector. - Trim Native.java to the Arrow-native scan APIs. - Delete IcebergApi annotation, CometSchemaImporter, AbstractCometSchemaImporter; strip @IcebergApi from CometVector. - Delete now-orphaned tests (TestFileReader, TestUtils, TestCometInputFile); drop closeColumnReader NPE assertion in CometNativeSuite.
1 parent 235b928 commit d03d99a

39 files changed

Lines changed: 42 additions & 8482 deletions

spark/src/main/java/org/apache/arrow/c/AbstractCometSchemaImporter.java

Lines changed: 0 additions & 76 deletions
This file was deleted.

spark/src/main/java/org/apache/comet/CometSchemaImporter.java

Lines changed: 0 additions & 32 deletions
This file was deleted.

spark/src/main/java/org/apache/comet/IcebergApi.java

Lines changed: 0 additions & 44 deletions
This file was deleted.

spark/src/main/java/org/apache/comet/parquet/AbstractColumnReader.java

Lines changed: 0 additions & 138 deletions
This file was deleted.

0 commit comments

Comments
 (0)