Branch | Status |
---|---|
master |
|
develop |
A crawling and indexing library to build crawlers and indexers with.
Install the module with: npm install crawler-indexer
var Crawler = require('crawler-indexer').Crawler;
var Indexer = require('crawler-indexer').Indexer;
var indexer = Indexer.create(options, overrides);
indexer.start();
var crawler = Crawler.create(options, overrides);
crawler.start();
(Coming soon)
(Coming soon)
In lieu of a formal styleguide, take care to maintain the existing coding style. Add unit tests for any new or changed functionality. Lint and test your code using Grunt.
(Nothing yet)
Copyright (c) 2014 Niels Henrik Hagen. Licensed under the MIT license.