nlpie-research/Compact-Biomedical-Transformers

This repository contains the code used for distillation and fine-tuning of compact biomedical transformers that have been introduced in the paper "On The Effectiveness of Compact Biomedical Transformers"

PythonMIT