/finding-bigfoot-with-semantic-search

Code from my livestream where I—much to the surprise of all—search for Bigfoot using semantic search.

Primary LanguageJavaScript

Finding Bigfoot with JavaScript + Vector Search

This is the repository for a live stream where I using LangChain.js, Redis Vector Search, and assorted models to find Bigfoot using semantic search.

The stream is available at: https://www.youtube.com/watch?v=R1IXYnoSd5U

Getting it Running

This is a work in progress so nothing solid here yet. However, the model file is too big to store in GitHub—even if you use Git LFS. So, you'll need to download it yourself at:

https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF/blob/main/mistral-7b-instruct-v0.2.Q4_K_M.gguf

More to come on how to get it running once I get it running myself!

If you are using an Intel-based Mac, you might need to change how Metal is installed. Details are here but the magic command is:

npx --no node-llama-cpp download --no-metal