Pinned Repositories
awesome-crawler
A collection of awesome web crawler,spider in different languages
awesome-python-cn
Python资源大全中文版，包括：Web框架、网络爬虫、模板引擎、数据库、数据可视化、图片处理等，由伯乐在线持续更新。
awesome-scrapy
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
files
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
logparser
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
notes
Keep on reading
scrapyd
[PR #326] Native support for basic auth :lock: `pip install -U git+https://github.com/scrapy/scrapyd.git`, then add `username = yourusername` and `password = yourpassword` in the scrapyd.conf file. DOCS :point_right:
scrapyd-cluster-on-heroku
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:
scrapyd-cluster-on-heroku-scrapyd-app
How to set up Scrapyd cluster on Heroku
scrapydweb
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
my8100's Repositories
my8100/scrapydweb
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
my8100/files
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
my8100/scrapyd-cluster-on-heroku
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:
my8100/logparser
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
my8100/scrapyd
[PR #326] Native support for basic auth :lock: `pip install -U git+https://github.com/scrapy/scrapyd.git`, then add `username = yourusername` and `password = yourpassword` in the scrapyd.conf file. DOCS :point_right:
my8100/scrapyd-cluster-on-heroku-scrapyd-app
How to set up Scrapyd cluster on Heroku
my8100/awesome-scrapy
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
my8100/awesome-python-cn
Python资源大全中文版，包括：Web框架、网络爬虫、模板引擎、数据库、数据可视化、图片处理等，由伯乐在线持续更新。
my8100/notes
Keep on reading
my8100/awesome-crawler
A collection of awesome web crawler,spider in different languages
my8100/awesome-web-scraping
List of libraries, tools and APIs for web scraping and data processing.
my8100/Python-Algorithms
All Algorithms implemented in Python
my8100/awesome-flask
A curated list of awesome Flask resources and plugins
my8100/awesome-python
A curated list of awesome Python frameworks, libraries, software and resources
my8100/awesome-python-applications
💿 Free software that works great, and also happens to be open-source Python.
my8100/public-test
public-test
my8100/scrapy-redis
Redis-based components for Scrapy.
my8100/scrapyd-CircleCI
my8100/scrapyd-cluster-on-heroku-scrapydweb-app-git
How to set up Scrapyd cluster on Heroku
my8100/queuelib
Collection of persistent (disk-based) queues
my8100/scrapyd-cluster-on-heroku-scrapyd-app-basic-auth
scrapyd-cluster-on-heroku-scrapyd-app-basic-auth
my8100/scrapyd-cluster-on-heroku-scrapyd-app-git
How to set up Scrapyd cluster on Heroku
my8100/scrapyd-cluster-on-heroku-scrapydweb-app
How to set up Scrapyd cluster on Heroku
my8100/temp
temp