protocol/beyond-bitswap

The testbed can't generate random files over 100MB

Closed this issue · 1 comments

For the option to use random files in the testbed, the local machine chokes when trying to generate files over 100MB. This issue may extrapolate to cloud environments because in the current implementation a single seed generates the full file. We should devise a way in which all seeds collaborate on generating non overlapping pieces of the file so that the single seed doesn't choke.

Randomly generating files is computationally expensive, and it is not possible inside experiments where there is a hardware limitation. A workaround to this is proposed in 5402f3f. Random files should be prepared and generated beforehand for the experiment using testbed/scripts/random-file.sh.