There are many kinds of spiderman. But this spiderman will help you scrap the web.
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.
What things you need to install the software and how to install them
PHP v5.3 or above
A step by step series that tell you how to get a development env running :
git clone [this repo]
Set env variable and do migration please:
php migration.php
And run the spiderman from runner:
php runner.php
Actually, you could edit the runner.php or any file as you want. I'm not providing any formal ways to do it.
Please read CONTRIBUTING.md which is none. Sorry for that. Big thanks to every open source project that i used. Spiderman is nothing without them. Please also check their repos !
- (only) me - Muhamad Hilmy Haidar
This project is licensed under the MIT License. Because it is automatically choosen as common permissive license.