inzy/Everything-is-about-LLM

A curated lists of blogs, papers, github repositories and colab notebooks covering everything about LLM from fine tuning to production.

Everything-is-about-LLM

A curated lists of blogs, papers, github repositories and colab notebooks covering everything about LLM from fine tuning to production.

Top authors

• Eugene Yan
• Lilian Weng
• Sayak Paul's Roadmap
• Harsh Singhal's Ideas based on LLM
• Sebastian Raschka

Understanding Transformers

• Blogs
  • Visual Transformer
  • Generative AI exists because of the transformer - Easy Scrollable Guide
• Youtube
  • Serrano Academy - Large Language Models

Fine Tuning

• Libraries
  • HuggingFace
  • Replicate
• Papers
  • QLora
• Blogs
  • Fine Tuning Embeddings for RAG based custom dataset
  • Fine tuning a T5 transformers for any summarization task
  • Fine tuning LLMs using PEFT Techniques
  • Fine tuning LLama-2 by AnyScale
• Youtube
• RAG Implementation of medical Chatbot using Mitral 7B

LLMs

• FinGPTPaper

Embeddings

• Use Cases
  • Spam Classification using Embeddings
• Blogs
  • Embeddings: What are they?

Quantization

• Blogs
  • Huggingface's intro to quantization

Cost

• LLM cost estimation from fine tuning to inference

Production

• Blogs
  • How ByteDance Scales Offline Inference with multi-modal LLMs to 200 TB Data
  • Building a RAG based production application - Anyscale

LLM Tools

• Nemo GuardRails

  • The missing manual

• LitGPT - Official starter kit for the NeurIPS 2023 LLM Efficiency Challenge

• Steaming LLM

Optimization

• Optimization LLMs from a dataset perspective

Evaluation of LLM

• Evaluating LLMs is a minefield - Princeton University

• Compiled Resources for LLM Evaluation

• Tools

  • Ragas
  • Giskard

Hosting

• Blogs
  • Hosting a LLama Model on Colab

Tokenizers

• Youtube
  • What makes LLM tokenizers different from each other?

Prompt Engineering

• Try Prompt Hacking to know the passcode

Agents

• Survey on Rise and Potential of LLM based Agents
• Surver on LLM based AutoAgents

Tutorials

• Youtube
  • Neural Hacks with Vasanth

Multimodal LLMs

• Papers
  • Multimodal Foundation Models
• Blogs
  • Introduction to MultiModal LLM - Comet

Notebooks

• Graph RAG using Llama-index
• OpenAI Cookbook blog github