/SD-Transformer

This repository is made by me as a part of my internship at University of Maryland, Baltimore under the guidance of Professor Manas Gaur.

Primary LanguagePython

Sufficiently Descriptive Transformers

This repository is made by me as a part of my internship at University of Maryland, Baltimore under the guidance of Professor Manas Gaur.

The contents include theoretical ablations of relevant topics such as:

  • Transformers
  • GLUE Benchmark
  • Natural Language Understanding Tasks:
    • Sentence Similarity
    • Textual Entailment
    • Sentiment Analysis
  • Work:
    • Developed a new method to find similarity of words, and comparison with word2vec, PCA, t-SNE and a newly proposed novel method.
    • Supported in Development of a new transformer architecture as well as in comparison tasks against baseline transformers such as BERT, ELECTRA, roBERTa, XLNet etc