Marvinmw/LLM-FineTuning-Large-Language-Models

LLM (Large Language Model) FineTuning

Multiple LLM (Large Language Models) FineTuning Projects

For almost all of these I have detailed video in my YouTube Channel

Find me here..

• 🐦 TWITTER: https://twitter.com/rohanpaul_ai
• 🟠 YouTube: https://www.youtube.com/@RohanPaul-AI/featured
• 👨🏻‍💼 LINKEDIN: https://www.linkedin.com/in/rohan-paul-b27285129/
• ​👨‍🔧​ KAGGLE: https://www.kaggle.com/paulrohan2020
• 👨‍💻 GITHUB: https://github.com/rohan-paul
• 🤖 Substack : https://rohanpaul.substack.com/
• 🧑‍🦰 FACEBOOK: https://www.facebook.com/rohanpaulai
• 📸 INSTAGRAM: https://www.instagram.com/rohan_paul_2020/

---

• CodeLLaMA-34B - Conversational Agent | Large Language Models

• Inference Yarn-Llama-2-13b-128k with KV Cache to answer quiz on very long textbook

• Mistral 7B FineTuning with_PEFT and QLORA

• Falcon finetuning on openassistant-guanaco

• Fine Tuning Phi 1_5 with PEFT and QLoRA

• Finetune codellama-34B with QLoRA

• Fine-tune opt-6.7b with QLoRA while keeping some of the Model layers at full-precision of float32

---

Other Language Models (Which are technically NOT LLM )

• DeBERTa Fine Tuning for Amazon Review Dataset Pytorch

• FineTuning BERT for Multi-Class Classification on custom Dataset

• Document STRIDE when Tokenizing with HuggingFace Transformer for NLP Projects

• Fine-tuning of a PreTrained Transformer model - what really happens to the weights (parameters)

• Cerebras-GPT New Large Language Model Open Sourced with Apache 2.0 License

• Roberta-Large Named Entity Recognizition on Kaggle NLP Competition with PyTorch

• Longformer end to end with Kaggle NLP competition

• Zero Shot Multilingual Sentiment Classification with PyTorch Lightning

• Fine Tuning Transformer (BERT) for Customer Review Prediction | NLP | HuggingFace

• Understanding BERT Embeddings and Tokenization | NLP | HuggingFace

• Topic Modeling with BERTopic | arxiv-abstract dataset

• Latent Dirichlet Allocation (LDA) for Topic Modeling

• Adding a custom task-specific Layer to a HuggingFace Pretrained Model

• Fine Tuning DistilBERT for Multiclass Text Classification

• Fine Tuning BERT for Named Entity Recognition (NER)

• Text Summarization by Fine Tuning Transformer Model | NLP

• Text Summarization with Transformer - BART + T5 + Pegasus

• Debarta-v3-large model fine tuning for Kaggle Competition Feedback-Prize | NLP

• Topic Modeling with BERT and Automatic Cluster Labeling

• Decoding strategies while generating text with GPT-2

• Fake News Classification with LSTM and Tensorflow

• FinBERT Sentiment Analysis for very Long Text (more than 512 Tokens) | PART 2

• FinBERT Sentiment Analysis for very Long Text Corpus (more than 512 Tokens) | PART-1

• Cosine Similarity between sentences with Transformers HuggingFace

• Zero Shot Learning - Cross Lingual Named Entity Recognition with XLM-Roberta

• BERT from Hugging Face - Few Baseline Application | NLP

• Transformer Encoder with Scaled Dot Product from Scratch

• Fuzzy String Matching in Natural Language Processing | NLP

• Understanding Word Vectors usage with Spacy Word and Sentence Similarity

• Named Entity Recognition NER using spaCy - Extracting Subject Verb Action

• Fine-Tuning-DistilBert - Hugging Face Transformer for Poem Sentiment Prediction | NLP

• Fine Tuning BERT-Based-Uncased Hugging Face Model on Kaggle Hate Speech Dataset

• Text Analytics of Tweet Emotion - EDA with Plotly

• Sentiment analysis using TextBlob and Vader