Commit d03d99a
committed
chore: remove dead native_iceberg_compat JVM Parquet reader chain
Now that native_iceberg_compat is gone, the JVM-mediated V1 Parquet read
path (CometScanExec → CometScanWrapper → CometParquetFileFormat →
NativeBatchReader / column-level Native APIs) is unreachable. Iceberg
also no longer integrates against Comet's @IcebergApi surface.
- CometExecRule: V1 CometScanExec fallback now reverts to wrapped
FileSourceScanExec (Spark) instead of CometScanWrapper.
- CometScanExec: keep as planning intermediate, throw on
doExecute/doExecuteColumnar/executeCollect/inputRDDs.
- Drop file-format swap to CometParquetFileFormat in both
CometScanExec.apply and CometNativeScanExec.apply.
- Delete CometParquetFileFormat and the JVM Parquet reader chain
(NativeBatchReader, NativeColumnReader, ColumnReader, RowGroupReader,
FileReader, plus all supporting page/index/options/utility classes).
- Delete IcebergCometNativeBatchReader and CometLazyVector.
- Trim Native.java to the Arrow-native scan APIs.
- Delete IcebergApi annotation, CometSchemaImporter,
AbstractCometSchemaImporter; strip @IcebergApi from CometVector.
- Delete now-orphaned tests (TestFileReader, TestUtils,
TestCometInputFile); drop closeColumnReader NPE assertion in
CometNativeSuite.1 parent 235b928 commit d03d99a
39 files changed
Lines changed: 42 additions & 8482 deletions
File tree
- spark/src
- main
- java/org/apache
- arrow/c
- comet
- parquet
- vector
- scala/org/apache
- comet
- parquet
- rules
- spark/sql/comet
- test
- java/org/apache/comet/parquet
- scala/org/apache/comet
Lines changed: 0 additions & 76 deletions
This file was deleted.
Lines changed: 0 additions & 32 deletions
This file was deleted.
This file was deleted.
Lines changed: 0 additions & 138 deletions
This file was deleted.
0 commit comments