/easy-lm-trainer

πŸ€— μ΅œμ†Œν•œμ˜ μ„ΈνŒ…μœΌλ‘œ LM을 ν•™μŠ΅ν•˜κΈ° μœ„ν•œ μƒ˜ν”Œμ½”λ“œ

Primary LanguagePython

Easy LM Trainer

Huggingface Transformersλ₯Ό μ‚¬μš©ν•΄ LM을 ν•™μŠ΅ν•  λ•Œ, λ‹¨μˆœ LM(CLM) ν•™μŠ΅ μž‘μ—…μ„ 보닀 μ‰½κ²Œ μ‹œμž‘ν•˜κΈ° μœ„ν•œ Boilerplate ν”„λ‘œμ νŠΈ.

ν™˜κ²½

  • CPython 3.10+
  • PyTorchλŠ” CUDA ν™˜κ²½μ— 맞게 μ„€μΉ˜ν•˜κΈ° (1.12.1 이상)
pip install -r requirements.txt