/level2_dkt-recsys-10

level2_dkt-recsys-10 created by GitHub Classroom

Primary LanguageJupyter Notebook

image

level2_dkt-recsys-10

๐Ÿ’ก Deep Knowledge Tracing

๐Ÿ† ๋Œ€ํšŒ ๊ฐœ์š”

์ดˆ๋“ฑํ•™๊ต, ์ค‘ํ•™๊ต, ๊ณ ๋“ฑํ•™๊ต, ๋Œ€ํ•™๊ต์™€ ๊ฐ™์€ ๊ต์œก๊ธฐ๊ด€์—์„œ ์šฐ๋ฆฌ๋Š” ์‹œํ—˜์„ ๋Š˜ ๋ด์™”์Šต๋‹ˆ๋‹ค. ์‹œํ—˜ ์„ฑ์ ์ด ๋†’์€ ๊ณผ๋ชฉ์€ ์šฐ๋ฆฌ๊ฐ€ ์ž˜ ์•„๋Š” ๊ฒƒ์„ ๋‚˜ํƒ€๋‚ด๊ณ  ์‹œํ—˜ ์„ฑ์ ์ด ๋‚ฎ์€ ๊ณผ๋ชฉ์€ ๋ฐ˜๋Œ€๋กœ ๊ณต๋ถ€๊ฐ€ ๋”์šฑ ํ•„์š”ํ•จ์„ ๋‚˜ํƒ€๋ƒ…๋‹ˆ๋‹ค. ์‹œํ—˜์€ ์šฐ๋ฆฌ๊ฐ€ ์–ผ๋งˆ๋งŒํผ ์•„๋Š”์ง€ ํ‰๊ฐ€ํ•˜๋Š” ํ•œ ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค.

ํ•˜์ง€๋งŒ ์‹œํ—˜์—๋Š” ํ•œ๊ณ„๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๊ฐ€ ์ˆ˜ํ•™ ์‹œํ—˜์—์„œ ์ ์ˆ˜๋ฅผ 80์  ๋ฐ›์•˜๋‹ค๋ฉด ์šฐ๋ฆฌ๋Š” 80์ ์„ ๋ฐ›์€ ํ•™์ƒ์ผ ๋ฟ์ž…๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๊ฐ€ ๋ˆ์„ ๋“ค์—ฌ ๊ณผ์™ธ๋ฅผ ๋ฐ›์ง€ ์•Š๋Š” ์ด์ƒ ์šฐ๋ฆฌ๋Š” ์šฐ๋ฆฌ ๊ฐœ๊ฐœ์ธ์— ๋งž์ถคํ™”๋œ ํ”ผ๋“œ๋ฐฑ์„ ๋ฐ›๊ธฐ๊ฐ€ ์–ด๋ ต๊ณ  ๋”ฐ๋ผ์„œ ๋ฌด์—‡์„ ํ•ด์•ผ ์„ฑ์ ์„ ์˜ฌ๋ฆด ์ˆ˜ ์žˆ์„์ง€ ํŒ๋‹จํ•˜๊ธฐ ์–ด๋ ต์Šต๋‹ˆ๋‹ค. ์ด๋Ÿด ๋•Œ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒƒ์ด DKT์ž…๋‹ˆ๋‹ค!

DKT๋Š” Deep Knowledge Tracing์˜ ์•ฝ์ž๋กœ ์šฐ๋ฆฌ์˜ "์ง€์‹ ์ƒํƒœ"๋ฅผ ์ถ”์ ํ•˜๋Š” ๋”ฅ๋Ÿฌ๋‹ ๋ฐฉ๋ฒ•๋ก ์ž…๋‹ˆ๋‹ค.

๐Ÿฆ† ๋ชจ๋ธ

1. Transformer Based

  • LSTM
  • LSTM Attention
  • BERT
  • Saint+

2. Boosting Based

  • LGBM: Light Gradient Boosting Machine
  • CatBoost
  • XGBoost

3. Rule Based

  • KT by problem Class

4. Graph Based

  • Light GCN

๐Ÿ“‚ ๋””๋ ‰ํ† ๋ฆฌ ๊ตฌ์กฐ

ํ”„๋กœ์ ํŠธ๊ตฌ์กฐ ํŽผ์น˜๊ธฐ
  ...

ํŒ€์›

image image image image image
๊น€๋™ํ˜„ ๋ฐฑํ˜„์ฃผ ์žฅํ˜•๊ทœ ์ฑ„๋ฏผ์ง€ ํ™ฉ์„ ์šฐ
๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ
CatBoost, LGBM
XGBoost ์‹คํ—˜
UltraGCN ์‹œ๋„
๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ
XGB๋ชจ๋ธ ์‹คํ—˜
๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ
Catboost, XGBoost
hydra, rule base
๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ
Saint+, LGBM
LSTM ๋ชจ๋ธ ์„ค๊ณ„ ๋ฐ ์‹คํ—˜
๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ
LightGCN ๋ชจ๋ธ
ํŠœ๋‹ ๋ฐ ์ฝ”๋“œ ๊ตฌํ˜„

- Public Score

image

- Private Score

image