/dotup_scraper

A simple script to scrape URLs from dotup.org

Primary LanguagePython

About

A simple script to scrape urls from dotup.org or light.dotup.org. Deprecated by dotup-scrapy.

Usage

python dotup.py

will output a list of URLs to the current working directory.

python dotup.py light

will do the same for light.dotup.org URLs.

Settings

Specify the oldest file in the format of { Number ID }.{ extension }. The scraper will continue to fetch URLs until it reaches that file.