distributed-spider

There are 2 repositories under distributed-spider topic.

  • Insutanto/scrapy-distributed

    A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

    Language:Python6061311

  • Programming-With-Love/Elise

    :hand: A simple, extensible, and support for a distributed crawler framework.一个简单的，高度可扩展的，并且支持分布式的爬虫框架

    Language:Java39679