yongsun-yoon/webshooter

WebShooter

Introduction

Web Crawling Framework

Installation

pip install git+https://github.com/respect5716/webshooter.git

Tutorial

• static crawling

Dockefile

docker build -t webshooter:latest .
docker run -it --name webshooter -v $PWD:/app -p 8080:8080 webshooter:latest bash

Test

python -m pytest tests