sebdah opened this issue 12 years ago · 0 comments
It would be nice if scrapy-mongodb supported data buffering to ease the load on the MongoDB cluster if needed. It would then send every n docs to MongoDB in a batch.
scrapy-mongodb