Basic multi-threaded web crawler made using Python that can be used for mapping small sites Credits : thenewboston