/Spider

Basic web spider

Primary LanguagePHP

#Spider

##Description Spiders a website and optionally logs information about it.

This is a simple, yet flexible web spider for indexing a website.

##Requires

  • PHP 5
  • CURL