danthegoodman1/icedb

Concurrent log file download

Closed this issue · 1 comments

90+% of the download time is waiting for time to first byte (avg 86ms in region on AWS). If we do batches of these and buffer in memory it should be far faster to parse the log

duplicate of #74