dvyukov/go-fuzz

Put examples in another repo

anacrolix opened this issue · 7 comments

The go-fuzz repository is abnormally large, and takes some time to fetch on poor connections. Perhaps you could move the non-essential assets to another repository?

Maybe the corpus should be removed, but I think the code in the examples are quite usefull.

Removing them from the repo will only shrink the download size if we rewrote history.

True, but I think it will be worth it. Currently the full repo is about 300 MB on disk for me which seems rather big. Remove the examples and the complete git history it's only 1.2 MB.

Indeed. It looks like the majority of on-disk space is taken up because the corpus files are small, but still take up an entire disk block.

<dgryski@kaepora[go-fuzz] \ʕ◔ϖ◔ʔ/ > du -sh .
749M    .
<dgryski@kaepora[go-fuzz] \ʕ◔ϖ◔ʔ/ > git rm -q -r examples
<dgryski@kaepora[go-fuzz] \ʕ◔ϖ◔ʔ/ > git commit -q -m "examples: delete"
<dgryski@kaepora[go-fuzz] \ʕ◔ϖ◔ʔ/ > du -sh .
31M .


sparseness more apparent this way

gopath/src/github.com/dvyukov/go-fuzz$ gdu --apparent-size -sh .
73M .
gopath/src/github.com/dvyukov/go-fuzz$ gdu -sh .
287M    .

But it was originally the transfer size I am concerned with, which is in the order of 22-24MB. https://api.github.com/repos/dvyukov/go-fuzz

Will be obsoleted by #154

@dvyukov This is done too.