Skip to content

Failed running python -m spylon_kernel install #64

@yunjiangster

Description

@yunjiangster

I got the following error message

Traceback (most recent call last):
  File "/Users/username/miniconda3/lib/python3.9/runpy.py", line 188, in _run_module_as_main
    mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
  File "/Users/username/miniconda3/lib/python3.9/runpy.py", line 147, in _get_module_details
    return _get_module_details(pkg_main_name, error)
  File "/Users/username/miniconda3/lib/python3.9/runpy.py", line 111, in _get_module_details
    __import__(pkg_name)
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon_kernel/__init__.py", line 3, in <module>
    from .scala_kernel import SpylonKernel
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon_kernel/scala_kernel.py", line 5, in <module>
    from .init_spark_magic import InitSparkMagic
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon_kernel/init_spark_magic.py", line 3, in <module>
    import spylon.spark
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon/spark/__init__.py", line 27, in <module>
    from .launcher import SparkConfiguration, with_spark_context, with_sql_context
  File "/Users/username/miniconda3/lib/python3.9/site-packages/spylon/spark/launcher.py", line 51, in <module>
    import pyspark
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/__init__.py", line 46, in <module>
    from pyspark.context import SparkContext
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/context.py", line 31, in <module>
    from pyspark import accumulators
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/accumulators.py", line 97, in <module>
    from pyspark.cloudpickle import CloudPickler
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/cloudpickle.py", line 146, in <module>
    _cell_set_template_code = _make_cell_set_template_code()
  File "/Users/username/miniconda3/lib/python3.9/site-packages/pyspark/cloudpickle.py", line 127, in _make_cell_set_template_code
    return types.CodeType(
TypeError: an integer is required (got type bytes)

environment:
MacOS Monterey, apple M1 pro

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions