Skip to content

Commit 3444e97

Browse files
committed
[SPARK-57859] Exclude com.esotericsoftware dependency
### What changes were proposed in this pull request? This PR excludes the transitive `com.esotericsoftware` dependency from the shaded operator jar. ### Why are the changes needed? `com.esotericsoftware:kryo-shaded` is pulled in via `spark-core` (directly and through `com.twitter:chill`) as a serializer. The operator only builds driver/submission specs and never runs it, like the other already-excluded runtime codecs and serializers (`org.lz4`, `org.xerial.snappy`, `com.github.luben`, `org.roaringbitmap`, `com.ning`). ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 4.8 Closes #731 from dongjoon-hyun/SPARK-57859. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent d2118d6 commit 3444e97

2 files changed

Lines changed: 2 additions & 0 deletions

File tree

spark-operator/build.gradle

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,7 @@ dependencies {
3939
implementation(libs.metrics.core)
4040
implementation(libs.metrics.jvm)
4141
compileOnly(libs.spark.core) {
42+
exclude group: "com.esotericsoftware"
4243
exclude group: "com.github.luben"
4344
exclude group: "com.ibm.icu"
4445
exclude group: "com.ning"

spark-submission-worker/build.gradle

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ dependencies {
2525
implementation(libs.slf4j.api)
2626

2727
implementation(libs.spark.kubernetes) {
28+
exclude group: "com.esotericsoftware"
2829
exclude group: "com.github.luben"
2930
exclude group: "com.ibm.icu"
3031
exclude group: "com.ning"

0 commit comments

Comments
 (0)