thammegowda/mtdata

Reading from tarfiles without extracting them is slow

thammegowda opened this issue · 0 comments

Tar files are decompressed three times for each access

  • get names for glob matching
  • get source
  • get target

unlike zip, (compressed) tarfiles aren't suitable for random access