Skip to content

Add unknown datatype support#2410

Closed
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:add-unknown-datatype
Closed

Add unknown datatype support#2410
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:add-unknown-datatype

Conversation

@manuzhang

Copy link
Copy Markdown
Member

Add PrimitiveType::Unknown with JSON, Arrow, and Avro null mappings. Validate unknown fields as optional with null defaults and reject unsupported catalog conversions.

Which issue does this PR close?

  • Closes #.

What changes are included in this PR?

Are these changes tested?

@manuzhang manuzhang closed this May 6, 2026
@manuzhang manuzhang reopened this May 6, 2026
@manuzhang manuzhang marked this pull request as draft May 6, 2026 16:19
@manuzhang manuzhang force-pushed the add-unknown-datatype branch 3 times, most recently from d91ef33 to 013362e Compare May 7, 2026 15:12
Add Iceberg unknown type parsing and conversions across schema, Arrow, Avro, HMS, and Glue paths.

Reject non-null defaults for unknown fields and make set predicate formatting deterministic for stable tests.

Co-authored-by: Codex <codex@openai.com>
@manuzhang manuzhang force-pushed the add-unknown-datatype branch from 013362e to 043dbd5 Compare May 7, 2026 15:28
@manuzhang manuzhang marked this pull request as ready for review May 7, 2026 16:14
@manuzhang

Copy link
Copy Markdown
Member Author

This PR should rebase on #2417

@manuzhang manuzhang marked this pull request as draft May 9, 2026 02:53
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.

@github-actions github-actions Bot added the stale label Jun 9, 2026
@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

@github-actions github-actions Bot closed this Jun 16, 2026
@TwinklerG

Copy link
Copy Markdown
Contributor

What is the currrent status of this PR? Is it still going on?

@manuzhang

Copy link
Copy Markdown
Member Author

@TwinklerG A new PR has been opened at #2773

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants