/llama2_oreilly_live_training

Repository for the oreilly live training course: "Getting Started with Llama2"

Primary LanguageJupyter Notebook

OReilly Live-Training: "Getting Started with Llama3"

Repository for the oreilly live training course: "Getting Started with Llama3": https://learning.oreilly.com/live-events/getting-started-with-llama-2/0636920098588/

Setup

Conda

  • Install anaconda
  • This repo was tested on a Mac with python=3.10.
  • Create an environment: conda create -n oreilly-llama3 python=3.10
  • Activate your environment with: conda activate oreilly-llama3
  • Install requirements with: pip install -r requirements/requirements.txt
  • Setup your openai API key

Pip

  1. Create a Virtual Environment: Navigate to your project directory. Make sure you hvae python3.10 installed! If using Python 3's built-in venv:

    python -m venv oreilly-llama3

    If you're using virtualenv:

    virtualenv oreilly-llama3
  2. Activate the Virtual Environment:

    • On Windows:
      .\oreilly-llama3\Scripts\activate
    • On macOS and Linux:
      source oreilly-llama3/bin/activate
  3. Install Dependencies from requirements.txt:

    pip install python-dotenv
    pip install -r requirements/requirements.txt
  4. Setup your openai API key

Remember to deactivate the virtual environment once you're done by simply typing:

deactivate

Setup your .env file

  • Change the .env.example file to .env and add your OpenAI API key.

To use this Environment with Jupyter Notebooks:

  • pip install jupyter
  • python3 -m ipykernel install --user --name=oreilly-llama3

Notebooks

Here are the notebooks available in the notebooks/ folder:

Notebooks

Here are the notebooks available in the notebooks/ folder:

  1. Llama 3 Quick Start

    Open In Colab

  2. Llama 3 Vector Similarity Search

    Open In Colab

  3. Llama 3 Chat PDF Intro

    Open In Colab

  4. PrivateGPT with Llama 3 Quick Setup

    Open In Colab

  5. Tool Calling Ollama

    Open In Colab

  6. Llama 3 Groq Function Calling

    Open In Colab

  7. Llama 3.1 LlamaCPP Tool Calling

    Open In Colab

  8. Llama 3.1 Tool Calling

    Open In Colab

  9. Tool Calling Agent

    Open In Colab

  10. Llama 3.1 Structured Outputs

    Open In Colab

  11. Llama 3 Agentic RAG

    Open In Colab

  12. Fine Tuning Llama 3: What You Need to Know

    Open In Colab

  13. Fine Tuning Walkthrough Hugging Face

    Open In Colab

  14. Quantization Precision Format Code Explanation

    Open In Colab

  15. GUI for Llama 3 Options

    Open In Colab