databricks/lilac

Nomic Embed Prefixes

drikster80 opened this issue · 0 comments

I was working separately on a patch for nomic-embed-text and noticed the model card says it "Requires Pre-fixes" https://huggingface.co/nomic-ai/nomic-embed-text-v1.5.

Didn't see this specifically implemented in the Nomic PR. Is this a blocker or will it affect performance of Nomic?

It looks like the Cohere implementation has a similar requirement, but it would be implemented on Cohere's API side.

I can do some testing and look at an implementation of the prefix if it's a concern, but won't be able to get to it until next week sometime.