Snowflake iceberg tables adapter#30
Closed
osipovartem wants to merge 1 commit into
Closed
Conversation
Remove invalidate_cache Init Read tables from config Read tables from config Fix avro Add lambda configuration and more logging/tracing (#23) sessions: JWT (#19) * jwt token sessions * Requested changes * clippy * fmt * clippy Remove iceberg call from create table statement (#21) * Remove iceberg call from create table * Remove invalidate_cache Snowdlake table wrapper snowflake rest retries support (#24) * replace oneshot by JoinHandle * switch to different execution model with results waiting until task joined * fix abort * simplify executor interface Register tables from config (#22) * Remove iceberg call from create table * Remove invalidate_cache * Init * Read tables from config * Read tables from config * Fix avro
osipovartem
force-pushed
the
aosipov/iceberg_snowflake
branch
from
0e97e57 to
a689eea
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Added TableProvider adapter that rewrites column names to match Snowflake's case-insensitive semantics.
Snowflake stores schemas in uppercase, while queries are typically written in lowercase. DataFusion treats identifiers as case-sensitive, which causes mismatches between the logical projection expressions (lowercase) and the physical input schema (uppercase). This adapter: