BERT is designed to help computers understand the meaning of ambiguous language in text by using surrounding text to establish context. The BERT framework was pre-trained using text from Wikipedia and can be fine-tuned with question and answer datasets.
Ref: https://www.techtarget.com/searchenterpriseai/definition/BERT-language-model
Here in this repo, I have explained how to classify email based on BERT model.