Skip to content

Spark-2.0 Kernel startup is failing due to "data/libs/streaming-twitter-assembly-1.6.jar" has jopt-simple version 3.2 #4

Description

@mahadev-khapali

Spark-2.0 Kernel startup is failing with below error when user has pushed library "streaming-twitter-assembly-1.6.jar" to his "data/libs" directory.

"data/libs/streaming-twitter-assembly-1.6.jar" has jopt-simple version 3.2 which not compatible with "toree" with spark02.0, can you please update your "streaming-twitter-assembly-1.6.jar" with "jopt-simple-4.6.jar" or above level version.

TMP=/gpfs/fs01/user/sc01-4b6feb1d1106ba-5fc93277e5ba/kgateway/tmp
USER=sc01-4b6feb1d1106ba-5fc93277e5ba
Starting Spark Kernel with SPARK_HOME=/usr/local/src/spark20master/spark
Exception in thread "main" java.lang.NoSuchMethodError: joptsimple/OptionParser.allowsUnrecognizedOptions()V
at org.apache.toree.boot.CommandLineOptions.(CommandLineOptions.scala:31)
at org.apache.toree.Main$.delayedEndpoint$org$apache$toree$Main$1(Main.scala:25)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions