Skip to content

chore: Updating spark-k8s dependency to hadoop 3.4.3 - #1533

Merged
Maleware merged 9 commits into
mainfrom
chore/spark-update-hadoop-version
Jun 16, 2026
Merged

chore: Updating spark-k8s dependency to hadoop 3.4.3#1533
Maleware merged 9 commits into
mainfrom
chore/spark-update-hadoop-version

Conversation

@Maleware

@Maleware Maleware commented Jun 15, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Description

Updates spark dependency hadoop to 3.4.3. For this we need to add https://repo1.maven.org/maven2/software/amazon/s3/analyticsaccelerator/analyticsaccelerator-s3 to hadoop as well.

=== NAME  kuttl
    harness.go:403: run tests finished
    harness.go:510: cleaning up
    harness.go:567: removing temp folder: ""
--- PASS: kuttl (529.35s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/delta-lake_openshift-false_spark-delta-lake-4.1.1 (529.33s)
PASS

@Maleware
Maleware marked this pull request as ready for review June 15, 2026 16:23
@Maleware Maleware self-assigned this Jun 15, 2026
@Maleware Maleware moved this to Development: Waiting for Review in Stackable Engineering Jun 15, 2026
@Maleware

Maleware commented Jun 15, 2026

Copy link
Copy Markdown
Member Author

Nexus: https://repo.stackable.tech/#browse/browse:packages:aws%2Fanalyticsaccelerator-s3-1.3.1.jar

razvan
razvan previously approved these changes Jun 16, 2026
View reviewed changes

@razvan razvan left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@sbernauer
sbernauer self-requested a review June 16, 2026 07:59
sbernauer
sbernauer reviewed Jun 16, 2026
View reviewed changes
Comment thread hadoop/hadoop/boil-config.toml Outdated
Comment thread hadoop/hadoop/boil-config.toml Outdated
Comment thread spark-k8s/boil-config.toml
@sbernauer sbernauer moved this from Development: Waiting for Review to Development: In Review in Stackable Engineering Jun 16, 2026
@Maleware @sbernauer
apply review formatting
593a134 
Co-authored-by: Sebastian Bernauer <sebastian.bernauer@stackable.tech>
@Maleware
Maleware requested a review from sbernauer June 16, 2026 09:16
@Maleware
Maleware enabled auto-merge June 16, 2026 09:44
sbernauer
sbernauer approved these changes Jun 16, 2026
View reviewed changes

@sbernauer sbernauer left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot!

@Maleware
Maleware added this pull request to the merge queue Jun 16, 2026
@sbernauer sbernauer moved this from Development: In Review to Development: Done in Stackable Engineering Jun 16, 2026
Merged via the queue into main with commit 5751a31 Jun 16, 2026
3 checks passed
@Maleware
Maleware deleted the chore/spark-update-hadoop-version branch June 16, 2026 10:50
@lfrancke lfrancke moved this from Development: Done to Done in Stackable Engineering Jun 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sbernauer sbernauer sbernauer approved these changes
@razvan razvan razvan left review comments

Assignees

@Maleware Maleware

Labels

None yet

Projects

Stackable Engineering
Status: Done

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@Maleware @razvan @sbernauer @lfrancke