emrgnt-cmplxty/automata

Modify embedding scripts to do batch writes

Closed this issue · 1 comments

Writing to the Chroma db in single instances appears quite slow. We need to do further testing to confirm, but in general it is good practice to write to dbs in batches. We should extend run_doc_embedding and run_code_embedding to default to this behavior.

Done in recent pr.