istresearch/scrapy-cluster
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
PythonMIT
Stargazers
- 1mentatHalf Moon Bay, CA
- aburan28San Francisco Bay Area
- aeneaswiener
- andrewtchin
- bengolopera software
- colt-evil
- curtiszimmermanPlanet Earth
- cyberplantRoji.NET
- ddorian
- eventuallyc0nsistentNew York, NYC
- fjavieralbaMadrid, Spain
- fjordanUnited States
- gdelfresno
- gleehokie
- guoqiyiChina
- HagerHuChina
- jackjmShanghai
- jasonrhaasAustin, TX
- JoshOYShanghai, China
- juanriaza@idealista
- kaisatec
- mgalushka@facebook
- Mj258蒙达娜农业科技有限公司
- muminoffElectronic Arts
- nimblemachineNimbleMachine
- parker20121Northern Virginia
- pgeraghty
- Roconda@datastreamsio
- ryanbaxendale@CenturionInfoSec
- septs@NiceLabs
- sgtzSydney
- sibiryakovFrontera core developer at @scrapinghub
- timClicks@rust-in-action
- undernewmanagement
- veverkap@github
- vshlapakovLocalistico