/sample-crawler

Sample Crawler created using Python

Primary LanguagePython

Sample Web Crawler

A sample web crawler that can crawl a web page and download selected images from the page.

Development

Install pip modules if requires

pip install bs4
pip install selenium
pip install tqdm

then,

python3 crawl.py

to run the application.

You requires the chrome driver as well. Download the compatible version for chrome installed in you OS from here - https://chromedriver.chromium.org/downloads