fix: minor release fixes#19
Open
shubham19may wants to merge 25 commits into
Open
Conversation
…nto feat/fusion-releaser
…into feat/fusion-releaser
* feat: adding interval for major in fusion * feat: adding debug development mode for amoro * chore: formatting * fix: terminal queries * fix: compaction throwing parquet error * chore: updating header * chore: remove 17 check as well as remove extra conf path * chore: adding plugin folder dir * chore: removing unnecessary makefile things * fix: spotless issues and upgrading parquet as we moved to 17
…er related issues
* fix: added fix for parquet decoding error * fix: uppgraded iceberg version
- fix: prevent script injection in CI workflows by using env: blocks
instead of ${{ }} interpolation in run: steps for user-controlled
inputs (PR title, branch names, inputs.tag, base_ref)
- fix: upgrade Derby from 10.14.2.0 to 10.16.1.1 for Java 17 compat
(10.14.x uses SecurityManager which throws on Java 17)
- fix: add --add-opens JVM flags to maven-surefire-plugin for Java 17
(Spark/Hadoop/Iceberg access internal JDK APIs, needs strong
encapsulation overrides)
- fix: annotate and correct non-existent iceberg-spark-3.3/1.7.2 artifact
in dep file (Iceberg dropped Spark 3.3 support in 1.7.0)
- fix: correct SPARK_OPTIMIZER_JOB_PATH in build.sh to include
spark version and scala binary version suffix in artifact name
- fix: replace log4j-slf4j-impl with log4j-slf4j2-impl across pom files
(SLF4J 2.x uses ServiceLoader, not StaticLoggerBinder from 1.x)
- fix: upgrade google-java-format from 1.7 to 1.22.0 (1.7 cannot
parse Java 17 syntax features like text blocks and records)
- fix: wait for kind-setup container completion before exporting
kubeconfig in start-fusion-docker Makefile target; remove stale
fusion-spark-cluster delete call
- fix: remove Flink build function and references from build.sh
(Flink optimizer already removed from assembly; Spark 3.5 only)
- fix: upgrade all GitHub Actions to current major versions
(actions/checkout@v4, setup-java@v4, docker/*@V3, build-push@v6)
- fix: cache kind binary in named volume and add SHA256 checksum
verification to prevent re-downloading on each compose up
Made-with: Cursor
Hardcoded SHA256 is fragile — it may be wrong and needs manual update every time KIND_VERSION changes. Fetch the .sha256sum file from the same URL as the binary so it is always correct and self-maintaining. Made-with: Cursor
hash-data
reviewed
Mar 22, 2026
|
|
||
| FLINK_MAJOR_VERSION=${FLINK_VERSION%.*} | ||
| SPARK_MAJOR_VERSION=${SPARK_VERSION%.*} | ||
| SPARK_OPTIMIZER_JOB_PATH=amoro-optimizer/amoro-optimizer-spark/target/amoro-optimizer-spark-${SPARK_MAJOR_VERSION}_${SCALA_BINARY_VERSION}-${AMORO_VERSION}-jar-with-dependencies.jar |
Collaborator
There was a problem hiding this comment.
we can remove about scala as spark optimizer not use scala, so would be better to not include in jar name
Collaborator
There was a problem hiding this comment.
Also, build.sh is not being used by docker build currently it is for localy building docker image
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
AI fixes for releaser minor things