/Crawler_Search_Engine

A Web Crawler works as a website links search engine

Primary LanguagePythonMIT LicenseMIT

Crawler_Search_Engine

A Web Crawler works as a lite search engine

Info

A Web Crawler with Task Queue based on Python

Setup

  1. Open main.py file
  2. Input the website you want to crawl
  3. Name the project (the folder name you hold the result)
  4. Run python main.py to start crawling
  5. Open the Project Folder to see the result

Sample

Take my Personal Homepage as an example Project: Musketeer Website: www.musketeer-liu.info