Very slow snapshots compression and decompression
dincho opened this issue · 1 comments
dincho commented
Try to tune CPU threads as it seems it runs on single core by default.
Also check compression level and even different algorithm.
Checksum check is also ridiculously slow, consider removing the step.
dincho commented
Did some testing:
- CPU threads has no effect on the machines we run
- default compression level (3) works fine - about 10mins for 42G (27G compressed). Level 6 didn't make it for 30mins and has been interrupted
- compression level 1 doesn't worth it as it's almost the same time 9min50s and compressed size 32G
- --long option just slows down the compression a bit (13mins) without significant size benefits
Checksum has been removed from the playbooks in #629