Swarm

Swarm is high-perfomance library for web crawling.

Depends on libcurl, uriparser, libxml2.

libcurl built with --enable-ares is highly needed for better perfomance. libcurl must be built with SSL support for accessing https sites.

More information is available at Reverbrain

TheVoid

TheVoid is asynchronious event-driven C++ library for building high-perfomance web applications.

Depends on boost::asio and swarm.

More information is available at Reverbrain