rumpelstiltzkin/ndjson_processor

High Speed multiprocessing ndjson processor

High speed ndjson processor

This is an example of a Python script that reads chunks of data from sys.stdin efficiently and sends them to multiprocessor worker threads for processing.