Commit 891f3eb
committed
[SPARK-57799] Exclude
### What changes were proposed in this pull request?
This PR excludes the `net.razorvine` dependency (transitively pulled in by Spark) from `spark-submission-worker` (`spark-kubernetes`) and `spark-operator` (`spark-core`).
### Why are the changes needed?
`net.razorvine:pickle` is a PySpark serialization library that the operator never uses. Excluding it removes an unnecessary dependency from the runtime classpath and shaded jar.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 4.8
This patch had conflicts when merged, resolved by
Committer: Dongjoon Hyun <dongjoon@apache.org>
Closes #725 from dongjoon-hyun/SPARK-57799.
Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>net.razorvine dependency1 parent aa702a7 commit 891f3eb
2 files changed
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
| 46 | + | |
46 | 47 | | |
47 | 48 | | |
48 | 49 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
| 34 | + | |
34 | 35 | | |
35 | 36 | | |
36 | 37 | | |
| |||
0 commit comments