TensorFlow Lite Transformers w/ Android demos
Convert Transformers models imported from the 🤗 Transformers library and use them on Android. You can also check out our swift-coreml-transformers repo if you're looking for Transformers on iOS.
Question Answering with DistilBERT
Demo of the DistilBERT model (97% of BERT’s performance on GLUE) fine-tuned for Question answering on the SQuAD dataset. It provides 48 passages from the dataset for users to choose from.
Text Generation with GPT-2/DistilGPT2
On-device text generation using GPT-2 or DistilGPT2 (same distillation process than DistilBERT, 2x faster and 33% smaller than GPT-2)
Models generation
Example scripts used to convert the models are available in the models_generation directory.
Please note that they require the nightly version of TensorFlow and might thus be unstable.