/Chat-with-Audio-using-LangChain.

Chat with Audio data using LangChain Framework.

Primary LanguageJupyter Notebook

Chat-with-Audio-using-LangChain.

Chat with Audio data using LangChain Framework.

System Setup:

Step 1. Create a virtual environment

conda create -p myenv python=3.9 -y

step 2. Activate the environment:

conda activate myenv/

step 3. Install all the requirements:

pip install -r requirements.txt

step 4. start writing the code, with standard file name as main.py

Flow

image

High Level Architecture

image

Steps:

  1. Upload the Audio File
  2. Generate the text from the Audio
  3. Store the text into another variable
  4. Split content into Chunk
  5. Do Embeddings of the data Download embeddings from the OpenAI)
  6. Store Data into Vector Store (eg: FAISS)
  7. User can pass a Prompt
  8. Based on User query, Similarity search will apply
  9. Get the Output.

Input

image

Output

image