GP89/FileQueue

A thread-safe queue which queues items on disk, with an optional in memory buffer. Can put and get any pickle-able object into a buffer of a specified size (optional), any overflow will get put to a gzip file to keep excessive amounts of queued items out of memory

Python