/openllmmodels

research about using open models vs openai

Primary LanguageJupyter Notebook

openllmmodels

research about using open models vs openai

Rag Sample

  1. create venv python 3.11.8 / Use ragsample/requirements.txt

  2. Start qdrant in local Use qdrant_start.sh Test http://localhost:6333/dashboard

  3. create ragsample/data folder and move Databricks-Big-Book-Of-GenAI-FINAL.pdf file

  4. ingest data using python ragsample/ingesdata.py check collection creation in qdrant

  5. test inference