Skip to content

Commit d2118d6

Browse files
committed
[SPARK-57857] Exclude com.ning dependency
### What changes were proposed in this pull request? This PR excludes the transitive `com.ning:compress-lzf` dependency from the shaded operator jar. ### Why are the changes needed? `compress-lzf` is pulled in via `spark-core` as a shuffle/broadcast compression codec. The operator only builds driver/submission specs and never runs it, like the other already-excluded runtime codecs (`org.lz4`, `org.xerial.snappy`, `com.github.luben`, `org.roaringbitmap`). ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 4.8 Closes #730 from dongjoon-hyun/SPARK-57857. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent 7515921 commit d2118d6

2 files changed

Lines changed: 2 additions & 0 deletions

File tree

spark-operator/build.gradle

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ dependencies {
4141
compileOnly(libs.spark.core) {
4242
exclude group: "com.github.luben"
4343
exclude group: "com.ibm.icu"
44+
exclude group: "com.ning"
4445
exclude group: "commons-codec"
4546
exclude group: "commons-collections", module: "commons-collections"
4647
exclude group: "net.razorvine"

spark-submission-worker/build.gradle

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,7 @@ dependencies {
2727
implementation(libs.spark.kubernetes) {
2828
exclude group: "com.github.luben"
2929
exclude group: "com.ibm.icu"
30+
exclude group: "com.ning"
3031
exclude group: "commons-codec"
3132
exclude group: "commons-collections", module: "commons-collections"
3233
exclude group: "io.fabric8"

0 commit comments

Comments
 (0)