/Semantic-Search-OpenAI-Chromadb

Semantic Search using OpenAI API and Chromadb

Primary LanguageJupyter NotebookMIT LicenseMIT

Semantic Search using OpenAI API & Chromadb

Implementation of Semantic Searching using OpenAI API embedding and ChromaDB as a vector database

Set-up

Python Dependencies

All the dependencies are in the pyproject.toml file. Just install poetry and run $ poetry install

OpenAI API

  1. Go to the https://platform.openai.com/docs/ and on the menu select API Keys

API Key

  1. Click on Create a new secret key and Create secret key

Create secret key popup

  1. Save the secret key in a file called .env:
API_KEY=YOUR_KEY_HERE

Running

  1. Activate the environment shell: $ poetry shell
  2. Run a jupyter session: $ jupyter-notebook
  3. Open the jupyter notebook notebooks/Semantic-Searching.ipynb (there is the result inside the jupyter notebook)

Dataset

Kowsari, Kamran; Brown, Donald; Heidarysafa, Mojtaba ; Jafari Meimandi, Kiana ; Gerber, Matthew; Barnes, Laura (2018), “Web of Science Dataset”, Mendeley Data, V6, doi: 10.17632/9rw3vkcfy4.6