/Llama-2-cpp-example

An example to run Llama 2 cpp python in Colab environment.

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

Llama-2-cpp-example

An example to run Llama 2 cpp python in Colab environment.

Link:

Part 1: How to use llama 2 Colab Link: Link

Part 2: How to let llama 2 Model as a Fastapi Service Colab Link: Link

Part 3: How to let mistral 7b Model as a Fastapi Service Colab Link: Link

Course:

  • Demo 1 - GGUF example code: Colab Link: Link

  • Demo 2 - Embedding Vector and RAG: Colab Link: Link

  • Demo 3 - Let mistral 7b Model as a Fastapi Service Colab Link: Link