@@ -8,7 +8,7 @@ sidebar_label: Overview
88
99### LightGBM
1010
11- [ LightGBM] ( https://github.com/Microsoft /LightGBM ) is an open-source,
11+ [ LightGBM] ( https://github.com/lightgbm-org /LightGBM ) is an open-source,
1212distributed, high-performance gradient boosting (GBDT, GBRT, GBM, or
1313MART) framework. This framework specializes in creating high-quality and
1414GPU enabled decision tree algorithms for ranking, classification, and
@@ -22,11 +22,11 @@ many other machine learning tasks. LightGBM is part of Microsoft's
2222 workloads.
2323- ** Performance** : LightGBM on Spark is 10-30% faster than SparkML on
2424 the Higgs dataset, and achieves a 15% increase in AUC. [ Parallel
25- experiments] ( https://github.com/Microsoft /LightGBM/blob/master/docs/Experiments.rst#parallel-experiment )
25+ experiments] ( https://github.com/lightgbm-org /LightGBM/blob/master/docs/Experiments.rst#parallel-experiment )
2626 have verified that LightGBM can achieve a linear speed-up by using
2727 multiple machines for training in specific settings.
2828- ** Functionality** : LightGBM offers a wide array of [ tunable
29- parameters] ( https://github.com/Microsoft /LightGBM/blob/master/docs/Parameters.rst ) ,
29+ parameters] ( https://github.com/lightgbm-org /LightGBM/blob/master/docs/Parameters.rst ) ,
3030 that one can use to customize their decision tree system. LightGBM on
3131 Spark also supports new types of problems such as quantile regression.
3232- ** Cross platform** LightGBM on Spark is available on Spark, PySpark, and SparklyR
@@ -107,10 +107,10 @@ both places, *passThroughArgs* takes precedence.
107107LightGBM on Spark uses the Simple Wrapper and Interface Generator (SWIG)
108108to add Java support for LightGBM. These Java Binding use the Java Native
109109Interface call into the [ distributed C++
110- API] ( https://github.com/Microsoft /LightGBM/blob/master/include/LightGBM/c_api.h ) .
110+ API] ( https://github.com/lightgbm-org /LightGBM/blob/master/include/LightGBM/c_api.h ) .
111111
112112We initialize LightGBM by calling
113- [ ` LGBM_NetworkInit ` ] ( https://github.com/Microsoft /LightGBM/blob/master/include/LightGBM/c_api.h )
113+ [ ` LGBM_NetworkInit ` ] ( https://github.com/lightgbm-org /LightGBM/blob/master/include/LightGBM/c_api.h )
114114with the Spark executors within a MapPartitions call. We then pass each
115115workers partitions into LightGBM to create the in-memory distributed
116116dataset for LightGBM. We can then train LightGBM to produce a model
@@ -201,7 +201,7 @@ For streaming mode, only one Dataset is created per partition, so *useSingleData
201201### Data Sampling
202202
203203In order for LightGBM algorithm to work, it must first create a set of bin boundaries for optimization. It does this calculation by
204- first sampling the data before any training or inferencing starts. ([ LightGBM docs] ( https://github.com/Microsoft /LightGBM ) ). The number of
204+ first sampling the data before any training or inferencing starts. ([ LightGBM docs] ( https://github.com/lightgbm-org /LightGBM ) ). The number of
205205samples to use is set using * binSampleCount* , which must be a minimal percent of the data or LightGBM rejects it.
206206
207207For * bulk* mode, this sampling is automatically done over the entire data, and each executor uses its own partitions to calculate samples for only
0 commit comments