(Maybe?) Add a semantic cache

Closed this issue 2 months ago · 0 comments

creatorrr commented 2 months ago

use https://huggingface.co/nvidia/dragon-multiturn-context-encoder for semantic cache embeddings