- λ³Έ APIλ μν°λ ν리μ¨λ³΄λ© μ½μ€μ κΈ°μ κ³Όμ 3λ² μνμ μν΄ μ μλμμ΅λλ€.
- model : KoELECTRAμ€ koelectra-base-v3-discriminator(pre-trained model)μ fine-tuningν λͺ¨λΈμ λλ€.
- fine-tuningμλ KLUE-STS μ train dataλ₯Ό μ¬μ©νμμ΅λλ€.
- πfine-tuning ννΈμ λν μ€λͺ μ fine-tuning.ipynbμ λ Έμ νμ΄μ§λ₯Ό μ°Έκ³ ν΄μ£ΌμΈμ!
March 23, 2022
- initial commit
$ pip install -r requirements.txt
$ python main.py
μ€ν ν, http://127.0.0.1:5000/ (νΉμ localhost)λ‘ μ μ
λ°μ€μμ λ¬Έμ₯ λκ°λ₯Ό μ
λ ₯νκ³ submit ν΄μ€λλ€.
βββ images
βββ running_model
β βββ best_model
β β βββ config.json
β β βββ pytorch_model.bin
β βββ data_preprocessing.py
β βββ models.py
βββ templates
β βββ index.html
β βββ result.html
βββ fine-tuning.ipynb
βββ main.py
βββ README.md
βββ requirements.txt
- running_model : fine-tuningλ best_modelκ³Ό modelμ μ€ννλλ° νμν λͺ¨λμ ν¬ν¨ν©λλ€.
- models.py : modelν¨μλ‘ λͺ¨λΈμ μ€ννμ¬ λκ°μ λ¬Έμ₯μ λν΄ μ μ¬λλ₯Ό ꡬν©λλ€.
- data_preprocessing.py : λ°μ λκ°μ λ¬Έμ₯μ λν΄ μ μ²λ¦¬λ₯Ό μ§ννλ λͺ¨λμ λλ€.
- fine-tuning.ipynb : KoELECTRA λͺ¨λΈμ λΆλ¬μ fine-tuning νλ κ³Όμ μ λ΄μ νμΌμ λλ€.
Flask==2.0.3
huggingface-hub==0.4.0
tokenizers==0.11.6
torch==1.11.0
transformers==4.17.0
Score (at KLUE sts dev set)
- Pearson's r (0~5 continuous similarity): 0.933
- F1 Score(for binary classification): 0.867
λ₯μ μ± | μμ¬μ± | μ₯μ§ν¬ |
λͺ¨λΈ μ‘°μ¬ λ° λ°μ΄ν° μ μ²λ¦¬ | λͺ¨λΈ μ‘°μ¬ λ° κ΅¬ν, fine-tuning | λͺ¨λΈ μ‘°μ¬ λ° κ΅¬ν, rest api ꡬν |