Salt Crawler is a distributed web crawler based on the Salt remote execution framework. It is currently only for demonstration purposes, but it is likely to expand to a more powerful web crawling engine.
Salt Crawler is a distributed web crawler based on the Salt remote execution framework. It is currently only for demonstration purposes, but it is likely to expand to a more powerful web crawling engine.