Skip to content

Commit 891f3eb

Browse files
committed
[SPARK-57799] Exclude net.razorvine dependency
### What changes were proposed in this pull request? This PR excludes the `net.razorvine` dependency (transitively pulled in by Spark) from `spark-submission-worker` (`spark-kubernetes`) and `spark-operator` (`spark-core`). ### Why are the changes needed? `net.razorvine:pickle` is a PySpark serialization library that the operator never uses. Excluding it removes an unnecessary dependency from the runtime classpath and shaded jar. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 4.8 This patch had conflicts when merged, resolved by Committer: Dongjoon Hyun <dongjoon@apache.org> Closes #725 from dongjoon-hyun/SPARK-57799. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent aa702a7 commit 891f3eb

2 files changed

Lines changed: 2 additions & 0 deletions

File tree

spark-operator/build.gradle

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,7 @@ dependencies {
4343
exclude group: "com.ibm.icu"
4444
exclude group: "commons-codec"
4545
exclude group: "commons-collections", module: "commons-collections"
46+
exclude group: "net.razorvine"
4647
exclude group: "org.apache.commons", module: "commons-compress"
4748
exclude group: "org.apache.logging.log4j"
4849
exclude group: "org.checkerframework"

spark-submission-worker/build.gradle

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,7 @@ dependencies {
3131
exclude group: "commons-collections", module: "commons-collections"
3232
exclude group: "io.fabric8"
3333
exclude group: "net.sf.py4j"
34+
exclude group: "net.razorvine"
3435
exclude group: "org.apache.avro"
3536
exclude group: "org.apache.commons", module: "commons-compress"
3637
exclude group: "org.apache.logging.log4j"

0 commit comments

Comments
 (0)