SCons/scons

Add support for much faster hash algorithms (e.g. `xxHash`)

Closed this issue · 0 comments

Currently, SCons only supports hash algorithms which are provided by the hashlib, but those are rather slow (in the ballpark of 1-2 GB/s).

There are much faster alternatives available, e.g. xxHash which runs at the speed of RAM (an order of magnitude faster than MD5, up to ~30 times, according to xxHash developers). xxHash is readily available as a C and Python3 library via Debian repositories, so e.g. Ubuntu/Debian users can install it with ease. The hash is not cryptographic, but it's acceptable according to the comments I found in SCons code.