Modify embedding scripts to do batch writes
Closed this issue · 1 comments
emrgnt-cmplxty commented
Writing to the Chroma db in single instances appears quite slow. We need to do further testing to confirm, but in general it is good practice to write to dbs in batches. We should extend run_doc_embedding and run_code_embedding to default to this behavior.
emrgnt-cmplxty commented
Done in recent pr.