/bert-as-a-gpt

This project is aimed to make MLM generate texts like gpt in an unsupervized, consistent way. It's used in https://github.com/nightingu/damebot to generate formatted memes, because MLM is better at fill in blanks in an appropriate context, while GPT only support left context.

Primary LanguagePython

Watchers