An example to run Llama 2 cpp python in Colab environment.
Part 1: How to use llama 2 Colab Link: Link
Part 2: How to let llama 2 Model as a Fastapi Service Colab Link: Link
Part 3: How to let mistral 7b Model as a Fastapi Service Colab Link: Link