d-t-n/llama2-chatbot-deep-learning

Deep Learning expert chatbot built using Llama2, langchain and chainlit.

PythonMIT

Llama2 Chatbot Deep Learning

Deep Learning expert chatbot built using Llama2, langchain and chainlit and Deep Learning books.

Data

Dive Into Deep Learning: https://d2l.ai/d2l-en.pdf
Deep Learning: http://imlab.postech.ac.kr/dkim/class/csed514_2019s/DeepLearningBook.pdf

System Requirements

Python 3.9 + requirements.txt

Installation

Fork this repository and create a codespace in GitHub or clone it locally.
Use your HuggingfaceHub API key (from this URL) in the .env file
```
HUGGINGFACEHUB_API_TOKEN=your_huggingface_api_token
```

Create a virtualenv and activate it

conda create -n llama2chainlit python=3.9

conda activate llama2chainlit

Run the following command in the terminal to install necessary python packages:
```
pip install -r requirements.txt
```
Run the following command in your terminal to create the embeddings and store it locally:
```
python ingest.py
```
Run the following command in your terminal to run the app UI (to choose ip and port use --host IP and --port XXXX):
```
chainlit run main.py -w --host 127.0.0.1 --port 9001
```