berzerk0/Probable-Wordlists

1.1 repo size

lnlyssg opened this issue · 5 comments

Following the comments about the reduced repo size I just tried to clone it but it still appears to be absolutely massive:

Cloning into 'Probable-Wordlists'...
remote: Counting objects: 1649, done.
remote: Compressing objects: 100% (7/7), done.
receiving objects:  31% (522/1649), 1.83 GiB | 6.67 MiB/s

I am assuming this is because the old versions of the files are still in the commit history, could they be removed using BFG?

That tool looks great - I'll do it promptly

You know, I think I found which files were causing the size difference.

image

They got to go! Going to run BFG. Thanks, @jaytay79.

Current Zip Size: 54MB
Current Clone Size: 118 MB

Progress for sure, but I'm still trying to purge the clones of unwanted history.
It may be that I can't push ALL the files away in the clones - so far I have encountered an error similar what is described in this StackOverflow post - where some answers may be found.

I'm continuing to chase the files down and have been directed to this set of instructions where they describe my error may come from pull refs.

In the past, there has only ever been one pull request from an outside source, and I've only ever created one branch to work on, which I ended up deleting.

TL;DR - It's smaller now, but cloning is still 118 MB, less than half of which aren't hidden files.
Since the repo is mostly links, you can get by with the 54 MB zip download for now
The situation is not WHOLLY intolerable at this size, but I am continuing to try and shrink it

Will run this again after torrents uploaded (within 5 days)

Pre Torrent upload:

Zip - 5.6 MB
Clone - 74.7MB

Will run a BFG again after torrents go up