Skip to content

Commit ec9f010

Browse files
fix: typo (-> Voting) (#199)
1 parent 70c0169 commit ec9f010

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

โ€Žanswers/2-machine-learning.mdโ€Ž

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -779,7 +779,7 @@ XGBoost์˜ ์žฅ์ ์€ ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค.
779779

780780
**์•™์ƒ๋ธ”(Ensemble)** ์€ ์—ฌ๋Ÿฌ๊ฐœ์˜ ๋ชจ๋ธ์„ ์กฐํ•ฉํ•ด์„œ ๊ทธ ๊ฒฐ๊ณผ๋ฅผ ๋ฝ‘์•„ ๋‚ด๋Š” ๋ฐฉ๋ฒ•์ด๋‹ค. "์ •ํ™•๋„๊ฐ€ ๋†’์€ ๊ฐ•ํ•œ ๋ชจ๋ธ์„ ํ•˜๋‚˜ ์‚ฌ์šฉํ•˜๋Š” ๊ฒƒ๋ณด๋‹ค, ์ •ํ™•๋„๊ฐ€ ๋‚ฎ์€ ์•ฝํ•œ ๋ชจ๋ธ์„ ์—ฌ๋Ÿฌ๊ฐœ ์กฐํ•ฉ ํ•˜๋Š” ๋ฐฉ์‹์˜ ์ •ํ™•๋„๊ฐ€ ๋†’๋‹ค"๋Š” ๊ฐœ๋…์—์„œ ๋น„๋กฏํ•œ ๋ฐฉ๋ฒ•์ด๋‹ค. `Bagging`, `Boosting`, `Stacking` ๋“ฑ์˜ ๋ฐฉ๋ฒ•์ด ์žˆ๋‹ค.
781781

782-
**๋ฐฐ๊น…(Bagging, Bootstrap Aggregation)** ์ด๋ž€ ์ƒ˜ํ”Œ์„ ์—ฌ๋Ÿฌ๋ฒˆ ๋ฝ‘์•„(Bootstrap = ๋ณต์› ๋žœ๋ค ์ƒ˜ํ”Œ๋ง) ๊ฐ ๋ชจ๋ธ์„ ํ•™์Šต์‹œ์ผœ ๊ฒฐ๊ณผ๋ฌผ์„ ์ง‘๊ณ„(Aggregation)ํ•˜๋Š” ๋ฐฉ๋ฒ•์ด๋‹ค. ์นดํ…Œ๊ณ ๋ฆฌ ๋ฐ์ดํ„ฐ๋Š” ํˆฌํ‘œ ๋ฐฉ์‹(Votinig)์œผ๋กœ ๊ฒฐ๊ณผ๋ฅผ ์ง‘๊ณ„ํ•˜๋ฉฐ, ์—ฐ์†ํ˜• ๋ฐ์ดํ„ฐ๋Š” ํ‰๊ท ์œผ๋กœ ์ง‘๊ณ„ํ•œ๋‹ค. Bagging์„ ์‚ฌ์šฉํ•œ ๋Œ€ํ‘œ์ ์ธ ๊ธฐ๋ฒ•์—๋Š” `Random Forest` ๋ฐฉ๋ฒ•์ด ์žˆ๋‹ค. ํ•™์Šต ๋ฐ์ดํ„ฐ๊ฐ€ ์ถฉ๋ถ„ํ•˜์ง€ ์•Š๋”๋ผ๋„ ์ถฉ๋ถ„ํ•œ ํ•™์Šตํšจ๊ณผ๋ฅผ ์ฃผ์–ด ๋†’์€ bias์˜ underfitting ๋ฌธ์ œ๋‚˜, ๋†’์€ variance๋กœ ์ธํ•œ overfitting ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๋Š”๋ฐ ๋„์›€์„ ์ค€๋‹ค.
782+
**๋ฐฐ๊น…(Bagging, Bootstrap Aggregation)** ์ด๋ž€ ์ƒ˜ํ”Œ์„ ์—ฌ๋Ÿฌ๋ฒˆ ๋ฝ‘์•„(Bootstrap = ๋ณต์› ๋žœ๋ค ์ƒ˜ํ”Œ๋ง) ๊ฐ ๋ชจ๋ธ์„ ํ•™์Šต์‹œ์ผœ ๊ฒฐ๊ณผ๋ฌผ์„ ์ง‘๊ณ„(Aggregation)ํ•˜๋Š” ๋ฐฉ๋ฒ•์ด๋‹ค. ์นดํ…Œ๊ณ ๋ฆฌ ๋ฐ์ดํ„ฐ๋Š” ํˆฌํ‘œ ๋ฐฉ์‹(Voting)์œผ๋กœ ๊ฒฐ๊ณผ๋ฅผ ์ง‘๊ณ„ํ•˜๋ฉฐ, ์—ฐ์†ํ˜• ๋ฐ์ดํ„ฐ๋Š” ํ‰๊ท ์œผ๋กœ ์ง‘๊ณ„ํ•œ๋‹ค. Bagging์„ ์‚ฌ์šฉํ•œ ๋Œ€ํ‘œ์ ์ธ ๊ธฐ๋ฒ•์—๋Š” `Random Forest` ๋ฐฉ๋ฒ•์ด ์žˆ๋‹ค. ํ•™์Šต ๋ฐ์ดํ„ฐ๊ฐ€ ์ถฉ๋ถ„ํ•˜์ง€ ์•Š๋”๋ผ๋„ ์ถฉ๋ถ„ํ•œ ํ•™์Šตํšจ๊ณผ๋ฅผ ์ฃผ์–ด ๋†’์€ bias์˜ underfitting ๋ฌธ์ œ๋‚˜, ๋†’์€ variance๋กœ ์ธํ•œ overfitting ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๋Š”๋ฐ ๋„์›€์„ ์ค€๋‹ค.
783783

784784
**๋ถ€์ŠคํŒ…(Boosting)** ์ด๋ž€ ์ด์ „ ๋ชจ๋ธ์˜ ์˜ค๋‹ต์— ๊ฐ€์ค‘์น˜๋ฅผ ๋†’๊ฒŒ ๋ถ€์—ฌํ•˜์—ฌ ๋‹ค์Œ ๋ชจ๋ธ์„ ํ•™์Šตํ•˜๋Š” ๋ฐฉ๋ฒ•์ด๋‹ค. ์˜ค๋‹ต์„ ์ •๋‹ต์œผ๋กœ ๋งž์ถ”๊ธฐ ์œ„ํ•ด ์˜ค๋‹ต์— ๋” ์ง‘์ค‘ํ•˜์—ฌ ํ•™์Šต์‹œํ‚ค๊ธฐ ๋–„๋ฌธ์— ์ผ๋ฐ˜์ ์œผ๋กœ ๋ฐฐ๊น…์— ๋น„ํ•ด ์ •ํ™•๋„๊ฐ€ ๋†’๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ํ‹€๋ ธ๋˜ ๋ถ€๋ถ„์— ๋Œ€ํ•ด ๋ฐ˜๋ณต์ ์œผ๋กœ ํ•™์Šตํ•˜๋ฏ€๋กœ ์˜ค๋ฒ„ํ”ผํŒ…์˜ ๋ฌธ์ œ๊ฐ€ ์žˆ์œผ๋ฉฐ, outlier์— ์ทจ์•ฝํ•˜๊ณ , ์†๋„๊ฐ€ ๋А๋ฆฌ๋‹ค๋Š” ๋‹จ์ ๋„ ๊ฐ€์ง€๊ณ  ์žˆ๋‹ค. `GBM(Gradient Boosting)` ๋ฐฉ๋ฒ•์ด ๋Œ€ํ‘œ์ ์ด๊ณ , `XGBoost, AdaBoost, GradientBoost` ๋“ฑ์˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ์กด์žฌํ•œ๋‹ค.
785785

0 commit comments

Comments
ย (0)