/metacrawler

A lightweight crawling framework (Python).

Primary LanguagePythonMIT LicenseMIT

MetaCrawler

A lightweight Python crawling framework.

Build Status Coverage Status PyPI Documentation Status

Installation

pip install metacrawler

Quick start

metacrawler startproject example
cd example
python run.py
cat output.json

Also see example.

Documentation

Read the Docs

Tests

Run tox or python tests.py.

Changelog

See releases

License

See LICENSE