mayooear/notion-chat-langchain

Pinecone upsert raw error

xingfanxia opened this issue · 7 comments

Hi, I'm getting an error with ingestion. And it's not clear what the issue is...

creating vector store...
error PineconeClient: Error calling upsert: PineconeClient: Error calling upsertRaw: ResponseError: Response returned an error code  
/Users/xingfanxia/projects/notion-chat-langchain/scripts/ingest-data.ts:38
    throw new Error('Failed to ingest your data');
          ^


Error: Failed to ingest your data
    at run (/Users/xingfanxia/projects/notion-chat-langchain/scripts/ingest-data.ts:38:11)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at <anonymous> (/Users/xingfanxia/projects/notion-chat-langchain/scripts/ingest-data.ts:43:3)

Node.js v18.15.0

Is there any specific requirement for the index? This is my index
Monosnap Pinecone Console 2023-03-21 02-16-53

The langchain api is poorly written, there's no other error details except for this message...

I tried out this one https://github.com/hwchase17/notion-qa. It does ingest ok, but the faiss index is not as good tho

It does not support other language other than English as well

seems to be related to this issue..pinecone-io/pinecone-ts-client#16

It's a problem with outdated dependency which doesn't throw proper error when the docs length is too long/too big

What did you need to update?