Skip to content

Commit 522f9bf

Browse files
authored
Remove PySpark from install_requires dependency (#24)
This pull request fixes #13 by removing install-time dependency on PySpark. If PyDeequ package is installed on a Apache Spark compatible cluster, there's 100% confidence that PySpark module path is already there. Just Deequ JAR has to be installed directly from Maven Central - https://search.maven.org/artifact/com.amazon.deequ/deequ
1 parent 1689156 commit 522f9bf

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

setup.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,9 +22,9 @@ def setup_package():
2222
"Programming Language :: Python :: 3",
2323
"License :: OSI Approved :: Apache Software License"
2424
],
25-
install_requires=['pyspark==2.4.7', 'pandas'],
25+
install_requires=['pandas'],
2626
setup_requires=['pyspark==2.4.7', 'pytest-runner', 'pandas'],
27-
tests_require=['pyspark==2.4.7','pytest', 'pandas']
27+
tests_require=['pyspark==2.4.7', 'pytest', 'pandas']
2828

2929
)
3030

0 commit comments

Comments
 (0)