/spider

A node js web crawler, which generates metadata/tags for a search string by crawling its google search results.

Primary LanguageJavaScript

spider

Crawls the web, generates tags.

Demo

Try out the demo here

Requirements

  • node js and npm

Usage

  1. Clone the repo git clone https://github.com/itsfadnis/spider.git

  2. Move to the spider directory cd spider

  3. Install dependencies npm install

  4. Start the server npm start

  5. Start crawling by visiting: http://localhost:8080