/talk-haystack_demo_meetup

Primary LanguageJupyter NotebookMIT LicenseMIT

Haystack Meetup Demo

Haystack demonstration used for discussions during a DataScience Meetup: Meetup: Building LLM applications - inovex GmbH.

It showcases:

  • Index & Query Pipelines
  • Crawling website content
  • LLM integration & multi-turn conversations

Additionaly it contains a CustomPreprocessor which handles crawled websites.

Setup

Virtual Env & Dependencies

Install the dependencies inside requirements.txt. Execute the first cell in main.py to automatically install jupyter-notebook into the same environment.

Elasticsearch Documentstore

An Elasticsearch Documentstore is required to run the haystack demo. Deployment via docker is the easiest way.

docker run --name es01 --net elastic -p 9200:9200 -it -m 1GB docker.elastic.co/elasticsearch/elasticsearch:8.11.2

LLM API

LLM API credentials are required, to run later stages of the notebook. An .env file provides a credentials template. (We used gpt3.5 from azure. If you plan to use another model read the haystack-docs, since the initialization format changes.)