Skip to content

Commit 46a2ac4

Browse files
authored
fix: Use correct Iceberg and Kafka libs in Spark (#446)
1 parent 9de95ee commit 46a2ac4

3 files changed

Lines changed: 4 additions & 4 deletions

File tree

demos/data-lakehouse-iceberg-trino-spark/create-spark-ingestion-job.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -151,8 +151,8 @@ data:
151151
mainApplicationFile: local:///stackable/spark/jobs/spark-ingest-into-lakehouse.py
152152
deps:
153153
packages:
154-
- org.apache.iceberg:iceberg-spark-runtime-4.0_2.13:1.11.0
155-
- org.apache.spark:spark-sql-kafka-0-10_2.13:4.0.1
154+
- org.apache.iceberg:iceberg-spark-runtime-4.1_2.13:1.11.0
155+
- org.apache.spark:spark-sql-kafka-0-10_2.13:4.1.2
156156
s3connection:
157157
reference: minio
158158
sparkConf:

demos/end-to-end-security/create-spark-report.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ data:
6464
mainApplicationFile: local:///stackable/spark/jobs/spark-report.py
6565
deps:
6666
packages:
67-
- org.apache.iceberg:iceberg-spark-runtime-4.0_2.13:1.11.0
67+
- org.apache.iceberg:iceberg-spark-runtime-4.1_2.13:1.11.0
6868
sparkConf:
6969
spark.driver.extraClassPath: /stackable/config/hdfs
7070
spark.executor.extraClassPath: /stackable/config/hdfs

demos/spark-k8s-anomaly-detection-taxi-data/create-spark-anomaly-detection-job.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ data:
5757
mainApplicationFile: local:///spark-scripts/spark-ad.py
5858
deps:
5959
packages:
60-
- org.apache.iceberg:iceberg-spark-runtime-4.0_2.13:1.11.0
60+
- org.apache.iceberg:iceberg-spark-runtime-4.1_2.13:1.11.0
6161
requirements:
6262
- scikit-learn==1.4.0
6363
s3connection:

0 commit comments

Comments
 (0)