Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion CHANGES.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,7 @@

## I/Os

* Upgraded Iceberg dependency to 1.11.0 (Java) ([#38925](https://github.com/apache/beam/issues/38925)).
Comment thread
peterphitran marked this conversation as resolved.
* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
* Add ArrowFlight IO (Java) ([#20116](https://github.com/apache/beam/issues/20116)).

Expand All @@ -82,7 +83,7 @@
* (Python) Typehints of dataclass fields are honored during type inferences. To restore the behavior of fallback-to-any,
use pipeline option `--exclude_infer_dataclass_field_type` ([#38797](https://github.com/apache/beam/issues/38797)).
However fixing forward is recommended.
* (Java) IcebergIO now requires Java 17 at runtime. This raises the floor in preparation for the Iceberg 1.11.0 upgrade ([#38925](https://github.com/apache/beam/issues/38925)).
* (Java) IcebergIO and projects that use it must now be built with Java 17 or later as a result of Iceberg 1.11.0 upgrade ([#38925](https://github.com/apache/beam/issues/38925)).

## Deprecations

Expand Down
6 changes: 5 additions & 1 deletion sdks/java/io/iceberg/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ def hadoopVersions = [

hadoopVersions.each {kv -> configurations.create("hadoopVersion$kv.key")}

def iceberg_version = "1.10.0"
def iceberg_version = "1.11.0"
def parquet_version = "1.16.0"
def orc_version = "1.9.6"
def hive_version = "3.1.3"
Expand Down Expand Up @@ -118,6 +118,10 @@ dependencies {
configurations.all {
// iceberg-core needs avro:1.12.0
resolutionStrategy.force 'org.apache.avro:avro:1.12.0'
// Iceberg 1.11.0 pulls parquet 1.17.1 transitively; hold at 1.16.0 to keep
// this PR zero-behavior-change. Bump parquet_version in a separate PR.
resolutionStrategy.force 'org.apache.parquet:parquet-avro:1.16.0'
resolutionStrategy.force 'org.apache.parquet:parquet-hadoop:1.16.0'
// TODO(https://github.com/apache/beam/issues/38515):
// Remove below pins when parquet-hadoop upgrades to hadoop-common:3.4.2
resolutionStrategy.force 'org.apache.hadoop:hadoop-common:3.3.6'
Expand Down
Loading