Indexes open directories listings in 80+ supported formats, including FTP, Google Drive.
Written in C# with .NET Core, which means it is cross platform!
Downloading is not (yet) implemented, but is already possible when you use the resulting file into another tool (for most of the formats).
Downloading with aria2c:
aria2c -i theurlsfile.txt
Downloading with wget:
wget -i theurlsfile.txt
If you have improvements, supply me with a pull request! If you have a format not yet supported, please let me know.
Please install the newest preview of .NET Core 3.0.
https://dotnet.microsoft.com/download/dotnet-core/3.0
Command line parameters:
Short | Long | Description |
---|---|---|
-u |
--url |
Url to scan |
-t |
--threads |
Number of threads |
-q |
--quit |
Do not wait after scanning |
-j |
--json |
Save JSON file |
-f |
--no-urls |
Do not save URLs file |
-r |
--no-reddit |
Do not show Reddit stats markdown |
-l |
--upload-urls |
Uploads urls file |
-e |
--exact-file-sizes |
Exact file sizes (WARNING: Uses HEAD requests which takes more time and is heavier for server) |
-s |
--speed-test |
Does a speed test after indexing |
Example:
OpenDirectoryIndexer.exe --url "https://myopendirectory.com"
If you want to learn more or contribute, see the following paragraphs!
- Install Visual Studio: https://visualstudio.microsoft.com/vs/community/ a. With workload: ".NET Core cross-platform development" b. With individual components: Code tools > Git for Windows and Code tools > GitHub extension for Visual Studio
- Be sure to install Git: https://git-scm.com/downloads
- Clone the repository by clicking "Clone or download" and click "Open in Visual Studio"
- Download Visual Studio Code: https://code.visualstudio.com/download
- Be sure to install Git: https://git-scm.com/downloads
- Clone the repository: https://code.visualstudio.com/docs/editor/versioncontrol#_cloning-a-repository
- More help: https://docs.microsoft.com/en-us/dotnet/core/tutorials/with-visual-studio-code
- Install the newest preview of .NET Core 3.0.
git clone https://github.com/KoalaBear84/OpenDirectoryDownloader
cd OpenDirectoryDownloader/OpenDirectoryDownloader
dotnet build .
cd bin/Debug/netcoreapp3.0
./OpenDirectoryDownloader --url "https://myopendirectory.com"
Then, if you need to package it into a binary, you can use warp-packer
For Google Drive scanning you need to get a Google Drive API credentials file, it's free!
- Go to https://console.cloud.google.com/projectcreate
- Fill in Project Name
- Change Project ID (optional)
- Wait a couple of seconds until the project is created and open it
- Click "Go to APIs overview" in the APIs panel
- Click "ENABLE APIS AND SERVICES"
- Enter "Drive", select "Google Drive API"
- Click "ENABLE"
- Click "CREATE CREDENTIALS" in the tooltip
- First box pick "Google Drive API"
- Second box pick "Other UI (e.g. Windows, CLI tool)"
- Select "Application data"
- Click "What credentials do I need?"
- Enter a "Service account name" (for example "serviceaccount")
- JSON option is good
- Click "Continue"
- A dialog pops up, choose "CREATE WITHOUT A ROLE"
- The needed Json file is downloaded
- Rename this file to "OpenDirectoryDownloader.GoogleDrive.json" and place it in the OpenDirectoryDownloader.Google project, or place it in the same directory as the executable