/PHP-WebCrawler

PHP based web crawler. Reads RSS feeds and fetches related images

Primary LanguagePHP

###PHP-WebCrawler

Objective

  • PHP web crawler/scraper
  • Reads RSS feeds from most sources
  • Fetch article related image thumb

Requires

  • PHP 5.3+
  • cURL
  • MySQL 5.5+ (tested)

TO-DO:

  • Switch to PDO
  • Standard retrieval class
  • Run-type configuration
    • Production
    • Development