Skip to content

Commit 0cc8fbe

Browse files
committed
format
1 parent 6463273 commit 0cc8fbe

1 file changed

Lines changed: 1 addition & 2 deletions

File tree

docs/source/contributor-guide/parquet_scans.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -41,8 +41,7 @@ implementation:
4141
- Improves performance
4242

4343
> **Note on mutable buffers:** Both `native_comet` and `native_iceberg_compat` use reusable mutable buffers
44-
> when transferring data from JVM to native code via Arrow FFI. The `native_iceberg_compat` implementation uses DataFusion's native Parquet reader for data columns, bypassing Comet's mutable buffer infrastructure entirely. However, partition columns still use `ConstantColumnReader`, which relies on Comet's mutable buffers that are reused across batches. This means native operators that
45-
> buffer data (such as `SortExec` or `ShuffleWriterExec`) must perform deep copies to avoid data corruption.
44+
> when transferring data from JVM to native code via Arrow FFI. The `native_iceberg_compat` implementation uses DataFusion's native Parquet reader for data columns, bypassing Comet's mutable buffer infrastructure entirely. However, partition columns still use `ConstantColumnReader`, which relies on Comet's mutable buffers that are reused across batches. This means native operators that buffer data (such as `SortExec` or `ShuffleWriterExec`) must perform deep copies to avoid data corruption.
4645
> See the [FFI documentation](ffi.md) for details on the `arrow_ffi_safe` flag and ownership semantics.
4746
4847
The `native_datafusion` and `native_iceberg_compat` scans share the following limitations:

0 commit comments

Comments
 (0)