Improve unzip performance
cmdcolin opened this issue · 3 comments
cmdcolin commented
- use inflateRaw instead of inflate...skip crc32 checks which are computationally expensive
- use Uint8Array instead of Buffer or otherwise make the unzip more memory efficient somehow? it is basically doing "Major GC" the entire time, see screenshot. see igvutils unbgzip(MIT licensed) https://github.com/igvteam/igv-utils/blob/master/src/bgzf.js#L30
cmdcolin commented
note that the unzip performance causes our jb2profiling test on high coverage short reads to timeout
cmdcolin commented
(orange blocks are major gc)