Jajabenit250/llm-twin-course

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

LLM Twin Course: Building Your Production-Ready AI Replica

An End-to-End Framework for Production-Ready LLM & RAG Systems by Building Your LLM Twin

From data gathering to productionizing LLMs using LLMOps good practices.

by Paul Iusztin, Alexandru Vesa and Alexandru Razvant

Why is this course different?

By finishing the "LLM Twin: Building Your Production-Ready AI Replica" free course, you will learn how to design, train, and deploy a production-ready LLM twin of yourself powered by LLMs, vector DBs, and LLMOps good practices.

Why should you care? 🫵

→ No more isolated scripts or Notebooks! Learn production ML by building and deploying an end-to-end production-grade LLM system.

What will you learn to build by the end of this course?

You will learn how to architect and build a real-world LLM system from start to finish - from data collection to deployment.

You will also learn to leverage MLOps best practices, such as experiment trackers, model registries, prompt monitoring, and versioning.

The end goal? Build and deploy your own LLM twin.

What is an LLM Twin? It is an AI character that learns to write like somebody by incorporating its style and personality into an LLM.

The architecture of the LLM twin is split into 4 Python microservices:

The data collection pipeline

• Crawl your digital data from various social media platforms.
• Clean, normalize and load the data to a Mongo NoSQL DB through a series of ETL pipelines.
• Send database changes to a RabbitMQ queue using the CDC pattern.
• ☁️ Deployed on AWS.

The feature pipeline

• Consume messages from a queue through a Bytewax streaming pipeline.
• Every message will be cleaned, chunked, embedded (using Superlinked, and loaded into a Qdrant vector DB in real-time.
• ☁️ Deployed on AWS.

The training pipeline

• Create a custom dataset based on your digital data.
• Fine-tune an LLM using QLoRA.
• Use Comet ML's experiment tracker to monitor the experiments.
• Evaluate and save the best model to Comet's model registry.
• ☁️ Deployed on Qwak.

The inference pipeline

• Load and quantize the fine-tuned LLM from Comet's model registry.
• Deploy it as a REST API.
• Enhance the prompts using RAG.
• Generate content using your LLM twin.
• Monitor the LLM using Comet's prompt monitoring dashboard.
• ☁️ Deployed on Qwak.

Along the 4 microservices, you will learn to integrate 3 serverless tools:

• Comet ML as your ML Platform;
• Qdrant as your vector DB;
• Qwak as your ML infrastructure;

Who is this for?

Audience: MLE, DE, DS, or SWE who want to learn to engineer production-ready LLM systems using LLMOps good principles.

Level: intermediate

Prerequisites: basic knowledge of Python, ML, and the cloud

How will you learn?

The course contains 11 hands-on written lessons and the open-source code you can access on GitHub.

You can read everything and try out the code at your own pace. 

Costs?

The articles and code are completely free. They will always remain free.

If you plan to run the code while reading it, you have to know that we use several cloud tools that might generate additional costs.

Pay as you go

• AWS offers accessible plans to new joiners.
  • For a new first-time account, you could get up to 300$ in free credits which are valid for 6 months. For more, consult the AWS Offerings page.
• Qwak has a QPU based pricing plan. Here's what you need to know:
  • A QPU stands for Qwak Processing Unit, and is the equivalent of 4vCPU-16GB.
  • Qwak offers up to 100QPU/month for free for up to one year after registration.
  • After that, a policy of 1.2$/QPU is applied as a pay-as-you-go tactic.
  • To find more about Qwak pricing, consult Qwak Pricing Page
  • To find more about Qwak Compute Instances, consult Qwak Instances Page

Freemium (Free-of-Charge)

• Qdrant
• Comet ML

Lessons

Important

To understand the entire code step-by-step, check out our articles ↓

The course is split into 11 lessons. Every Medium article will be its own lesson.

System Design

1. An End-to-End Framework for Production-Ready LLM Systems by Building Your LLM Twin

Data Engineering: Gather & store the data for your LLM twin

2. The Importance of Data Pipelines in the Era of Generative AI
3. Change Data Capture: Enabling Event-Driven Architectures

Feature Pipeline: prepare data for LLM fine-tuning & RAG

4. SOTA Python Streaming Pipelines for Fine-tuning LLMs and RAG — in Real-Time!
5. The 4 Advanced RAG Algorithms You Must Know to Implement

Training Pipeline: fine-tune your LLM twin

6. The Role of Feature Stores in Fine-Tuning LLMs: From raw data to instruction dataset
7. How to fine-tune LLMs on custom datasets at Scale using Qwak and CometML
8. Best Practices when evaluating fine-tuned LLMs

Inference Pipeline: serve your LLM twin

9. Architect scalable and cost-effective LLM & RAG inference pipelines
10. How to evaluate your RAG using RAGAs Framework

Grand Finale

11. The LLM-Twin Free Course on Production-Ready RAG applications
12. Ending Notes (TBD)

Meet your teachers!

The course is created under the Decoding ML umbrella by:

	Paul Iusztin Senior ML & MLOps Engineer
	Alexandru Vesa Senior AI Engineer
	Răzvanț Alexandru Senior ML Engineer

License

This course is an open-source project released under the MIT license. Thus, as long you distribute our LICENSE and acknowledge our work, you can safely clone or fork this project and use it as a source of inspiration for whatever you want (e.g., university projects, college degree projects, personal projects, etc.).

🏆 Contribution

A big "Thank you 🙏" to all our contributors! This course is possible only because of their efforts.