This is a project to design and implement a scalable web crawler with search capabilities.
This is in research phase: The useful information and links can be found here
make
: tested with GNU Make version 3.81
docker
: tested with Docker version 20.10.6, build 370c28
git
: tested with version 2.24.3