typesense/firestore-typesense-search

Firestore Backfill Not Working

Closed this issue · 4 comments

Description

Firestore Extension installed, but backfill is not getting triggered.

Steps to reproduce

image
image

Expected Behavior

Backfill to trigger and documents to be updated to my notes collection on Typesense

Actual Behavior

image

Metadata

**Typesense Version2.7:

OS:

Could you try deleting the trigger key completely from the document and create it again?

It should still log that missing key error when you delete the key, but when you add it back again, you should now see a 2nd log message stating the backfill is starting and either a success or error messages.

Thanks Jason. I did this and backfill started, but ended in a crash because of memory. I'm uploading 35 thousand records only.

Screenshot 2024-09-12 080535

For large datasets, you would have to run the backfill using an admin script from your local computer.

We still need to look into batching during backfill as part of #70 to make a cloud function run a large backfill.

I see. Thank you. Can you point me to some documentation about this?