/nlp-model-compression

Primary LanguagePython

NLP Compression

Experiments for language model compression

Features

  • Quantization
  • Movement pruning for RoBERTa (source code from huggingface)
  • LayerDrop

Results

Pretrained phoBERT on NER task: Google drive

Pretrained phoBERT on POS task: Google drive

Report: Google drive PDF