This repository is made by me as a part of my internship at University of Maryland, Baltimore under the guidance of Professor Manas Gaur.
The contents include theoretical ablations of relevant topics such as:
- Transformers
- GLUE Benchmark
- Natural Language Understanding Tasks:
- Sentence Similarity
- Textual Entailment
- Sentiment Analysis
- Work:
- Developed a new method to find similarity of words, and comparison with word2vec, PCA, t-SNE and a newly proposed novel method.
- Supported in Development of a new transformer architecture as well as in comparison tasks against baseline transformers such as BERT, ELECTRA, roBERTa, XLNet etc