scrapy-extension

There are 8 repositories under scrapy-extension topic.

sangaline/scrapy-wayback-machine
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
Language:Python108 6 428
shengchenyang/AyugeSpiderTools
使 scrapy 开发不用在意 item，pipeline，middleware 等通用场景下模块的编写，解放开发者的双手。
Language:Python64 3 1211
croqaz/awesome-scrapy
🕶 Awesome list of Scrapy tools and libraries
53 2 06
DotNetAge/scrapy_plus
scrapy 常用爬网必备工具包
Language:Python24 1 09
stummjr/scrapy-fieldstats
A Scrapy extension to log items coverage when the spider shuts down
Language:Python17 5 114
rudeigerc/scrapy-slackbot
A Scrapy extension for sending notification to Slack channels
Language:Python9 3 03
sp1thas/scrapy-folder-tree
A scrapy pipeline which stores files using folder trees.
Language:Python8 3 32
crawlaio/scrapy-spiderstats-extension
将 Spider Stats 存储到 MongoDB 的扩展，可以用于爬虫监控和统计
Language:Python2 1 00