The idzip file format allows seeking in gzip files.
Features:
- efficient seeking in the compressed data
- no 4GB limit
- compatible with gzip
Provided interface:
idzip,gunzip,zcatcommand line utilities- Python function
idzip.open(filename)for transparent reading
Gzip allows to store extra fields in the gzip header. Idzip stores offsets for the efficient seeking there.
The file format was designed by Rik Faith for dictzip. Idzip just uses multiple gzip members to have no file size limit.
Idzip means Improved Dictzip.