Skip to content

Commit 71b1384

Browse files
committed
docs: remove dead link
1 parent ad50f36 commit 71b1384

1 file changed

Lines changed: 1 addition & 2 deletions

File tree

docs/modules/demos/pages/jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data.adoc

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,6 @@
33
:scikit-lib: https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.IsolationForest.html
44
:k8s-cpu: https://kubernetes.io/docs/tasks/debug/debug-cluster/resource-metrics-pipeline/#cpu
55
:spark-pkg: https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html
6-
:forest-article: https://towardsdatascience.com/isolation-forest-and-spark-b88ade6c63ff
76
:pyspark: https://spark.apache.org/docs/latest/api/python/getting_started/index.html
87
:forest-algo: https://cs.nju.edu.cn/zhouzh/zhouzh.files/publication/icdm08b.pdf
98
:nyc-taxi: https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page
@@ -133,7 +132,7 @@ In practice, clients of Spark Connect do not need a full-blown Spark installatio
133132
== Model details
134133

135134
The job uses an implementation of the Isolation Forest {forest-algo}[algorithm] provided by the scikit-learn {scikit-lib}[library]:
136-
the model is trained and then invoked by a user-defined function (see {forest-article}[this article] for how to call the sklearn library with a pyspark UDF), all of which is run using the Spark Connect executors.
135+
the model is trained and then invoked by a user-defined function running on the Spark Connect executors.
137136
This type of model attempts to isolate each data point by continually partitioning the data.
138137
Data closely packed together will require more partitions to separate data points.
139138
In contrast, any outliers will require less: the number of partitions needed for a particular data point is thus inversely proportional to the anomaly "score".

0 commit comments

Comments
 (0)