JetRunner/BERT-of-Theseus
⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
PythonApache-2.0
Issues
- 2
CoLA reproducibility
#15 opened by mcps5601 - 0
- 0
- 1
fine-tune a predecessor model
#14 opened by mcps5601 - 4
- 1
how to draw the cover picture?
#11 opened by MrRace - 1
Which version of transformers is this repo using?
#12 opened by failable - 5
- 2
Comparison against six layer BERT
#10 opened by david-macleod - 1
The performance of DistilBERT
#8 opened by forjiuzhou - 2
- 2
- 3
- 5
[Answered] MRPC Reproducibility
#1 opened by YaNjIeE - 2