Skip to content

Commit a8ce2c7

Browse files
committed
feat(io): add streaming FileIO support
Introduce InputFile/OutputFile stream APIs and Arrow IO adapters so bundled Avro/Parquet readers and writers can work with generic FileIO implementations.
1 parent 0db527a commit a8ce2c7

41 files changed

Lines changed: 1689 additions & 312 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

src/iceberg/CMakeLists.txt

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,7 @@ set(ICEBERG_SOURCES
3636
expression/rewrite_not.cc
3737
expression/strict_metrics_evaluator.cc
3838
expression/term.cc
39+
file_io.cc
3940
file_io_registry.cc
4041
file_reader.cc
4142
file_writer.cc
@@ -217,9 +218,9 @@ add_subdirectory(util)
217218

218219
if(ICEBERG_BUILD_BUNDLE)
219220
set(ICEBERG_BUNDLE_SOURCES
220-
arrow/arrow_fs_file_io.cc
221+
arrow/arrow_io.cc
221222
arrow/s3/arrow_s3_file_io.cc
222-
arrow/file_io_register.cc
223+
arrow/arrow_io_register.cc
223224
arrow/metadata_column_util.cc
224225
avro/avro_data_util.cc
225226
avro/avro_direct_decoder.cc

src/iceberg/arrow/arrow_fs_file_io.cc

Lines changed: 0 additions & 108 deletions
This file was deleted.

0 commit comments

Comments
 (0)