Github Downloader
Find and download files using wildcards from multiple Github repositories
Requirements
pip install PyGithub
Usage
git_downloader.py [-h] [-r REPO_FILE] [-w WILDCARD] [-o OUTPUT_DIR]
[-t TIMEOUT] [-v]
Github file downloader
optional arguments:
-h, --help show this help message and exit
-u USERNAME, --username USERNAME
Username used to authenticate with github for
increased rate limit
-p PASSWORD, --password PASSWORD
Password or token used to authenticate with github
-r REPO_FILE, --repo_file REPO_FILE
Path for the input file which contains a url of a
Github repository for each separate line
-l LAST_REPO, --last_repo LAST_REPO
When not using a repo_file, this will be used as
starting position for github repo crawl
-w WILDCARD, --wildcard WILDCARD
Unix shell-style wildcard to match files to download
(for example: *.txt)
-o OUTPUT_DIR, --output_dir OUTPUT_DIR
Directory to store all downloaded files
-y YARA_META, --yara-meta YARA_META
Yara meta rule filename to create
-t TIMEOUT, --timeout TIMEOUT
Socket timeout (seconds)
-v, --verbose increase output verbosity
Example
python git_downloader.py -r repos.txt -w *.txt -o /directory/for/downloaded/files
Keep in mind you need to change "repos.txt" to add the repos you want to download from, by adding a Github repository link in each line.
Use to download YARA signatures
This tool can be used to easily download all the YARA signatures in Github. The example "repos.txt" contains many links to Github repos with YARA signatures, so the only thing left to do is to run the tool with this command:
python git_downloader.py -r repos.txt -w *.yar* -o /directory/for/downloaded/files