bruth/stream-split

split(1) but streams each chunk to the provided command.

Stream Split

split but streams each chunk to the provided command.

stream-split -lines 500 data.txt -- wc -l

This will split up data.txt into 500 line chunks and execute wc -l for each chunk.