Skip to content

fix(orc): avoid removed Arrow bitmap append API#423

Merged
lszskye merged 5 commits into
alibaba:mainfrom
wgtmac:codex/fix-orc-arrow-bitmap-api
Jul 15, 2026
Merged

fix(orc): avoid removed Arrow bitmap append API#423
lszskye merged 5 commits into
alibaba:mainfrom
wgtmac:codex/fix-orc-arrow-bitmap-api

Conversation

@wgtmac

@wgtmac wgtmac commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

Purpose

Linked issue: N/A

Arrow removed ArrayBuilder::AppendToBitmap in newer releases. Replace the ORC adapter's calls with the equivalent Reserve + UnsafeAppendToBitmap sequence, which is available in the repository's pinned Arrow 17.0.0 and newer Arrow versions.

API and Format

No public API, storage format, or protocol changes.

Documentation

No new feature; no documentation update required.

Generative AI tooling

Generated-by: OpenAI Codex

Copilot AI review requested due to automatic review settings July 15, 2026 05:25

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the ORC-to-Arrow adapter implementation to remain compatible with newer Apache Arrow releases by removing usage of the deprecated/removed arrow::ArrayBuilder::AppendToBitmap API and replacing it with the supported Reserve + UnsafeAppendToBitmap sequence.

Changes:

  • Replaced arrow::ArrayBuilder::AppendToBitmap(valid_bytes, length) with Reserve(length) + UnsafeAppendToBitmap(valid_bytes, length) in multiple unpooled builder implementations.
  • Kept the existing “no nulls” fast-path behavior (IncreaseLength) unchanged.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread src/paimon/format/orc/orc_adapter.cpp
Comment thread src/paimon/format/orc/orc_adapter.cpp
Comment thread src/paimon/format/orc/orc_adapter.cpp
@wgtmac
wgtmac force-pushed the codex/fix-orc-arrow-bitmap-api branch from 39d5dd5 to e3c38e4 Compare July 15, 2026 05:52
Comment thread src/paimon/format/orc/orc_adapter.cpp Outdated

@lszskye lszskye left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@lszskye
lszskye merged commit 1623029 into alibaba:main Jul 15, 2026
9 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants