/codellama-chatbot

A local LLM chatbot using Code Llama

Primary LanguagePythonMIT LicenseMIT

codellama-chatbot

A local LLM chatbot using CodeLlama-7b-Instruct-hf

Screenshot

Dependencies

  • torch
  • transformers
  • bitsandbytes
  • accelerate
  • streamlit

Running the chatbot

streamlit run app.py