ScrapyRedisProject Scrapy Distributed Project next step 1.optimization seed url [optimization seed url][https://blog.csdn.net/Bone_ACE/article/details/53306629] 2.Prepare the integrated bloom filter ScrapyRedisBloomFilter 3.Automated deployment