How to connect with the knowledge base

Question

How to connect with the knowledge base

anan1213095357 opened this issue 9 months ago · 4 comments

Answer 1 · 2024-06-06T08:29:27.000Z

Maybe you should try LangChain or Semantic Kernel, or learn how Retrieval Augmented Generation (RAG) works and implement the search yourself using OllamaApiClient.GenerateEmbeddings and some vector database.

Answer 2 · 2024-06-07T05:32:04.000Z

Maybe you should try LangChain or Semantic Kernel, or learn how Retrieval Augmented Generation (RAG) works and implement the search yourself using OllamaApiClient.GenerateEmbeddings and some vector database.

I understand that retrieval vectors can be saved, but how can the vectors obtained through GenerateEmbedding be output as text?

Answer 3 · 2024-06-07T09:36:52.000Z

I understand that retrieval vectors can be saved, but how can the vectors obtained through GenerateEmbedding be output as text?

It doesn't seem to work like that way, the vectors resulting from Embedding are only used to compare similarity distances. You may need to make the association between the vectors and the original text yourself. Vector databases can usually have text or id attached to them.
https://platform.openai.com/docs/tutorials/web-qa-embeddings

Answer 4 · 2024-06-11T08:36:09.000Z

This is not in the context of the Ollama API alone, so it's out of range of this project. @mili-tan is right, you should use langchain or semantic kernel for this.
There are tons of articles out there, I think this one is a good one to start:

https://www.kaggle.com/code/deeepsig/rag-using-langchain-chromadb-ollama-and-gemma-7b/notebook