/nlpower

Tutorial materials for SOTA NLP

Primary LanguageJupyter Notebook

nlpower

Tutorial materials for SOTA NLP (+ friends like Stable Diffusion!)

This repository comprises material to introduce a user to SOTA NLP techniques as of 2023/02. It includes:

A. High level intro to NLP:

  • Introducing the idea of embeddings for unstructured data like text, images, videos
  • Brief history of LLMs
  • Transformer models like BERT and the Attention neural network layer
  • Transfer Learning

B. Generative AI GPT/ChatGPT demo

C. Generative AI Stable Diffusion demo

D. Discussion on biases in LLMs and mitigation strategies

E. Resource list of foundational papers, bias mitigation resources, and helpful tutorials