mckaywrigley/chatbot-ui

API Folder Misused

Closed this issue · 0 comments

The retrievals processing is in the API folder. This is a MAJOR issue becuase when deployed, to something like vercel, when the embeddings prcedure has begun, its essentially making concurrent API requests in major volumes to the API folder and thus, causes "too many request" errors when deployed (I imagine when deployed to most or many servers).

Id liek to request the entire embedding procedure be moved to the server, not serverless. It doesnt make sense why it would be put there in the first place. Thanks