marithetland/susCovONT

Faster file transfer?

inful opened this issue · 1 comments

inful commented

This might be worth a try: https://arjon.es/2017/which-is-the-best-tool-for-copying-a-large-directory-tree-locally/

Going the rsync route should also remove the need for doing md5sum checks.

We did use rsync initially but it took much longer than just the simple cp + check md5sums afterwards. Will look at rsync + parallel though to see if that speeds up the process, thanks for the suggestion @inful.