KubraYilmaz1/nlp-models-examples

Examples of inference and fine-tuning T5, GPT-2 and ruGPT-3 models

T5 Model Examples

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
by Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu.

Model

Text classification

SQuAD

Text summarization

Text translation

Text classification fine-tuning

Results:

GPT-2 Model Examples

Text generation in English

Model

Text generation in Russian

Model

Telegram chatbot example