/ItsyBitsySpyder

Basic Web Scraper

Primary LanguagePython

Itsy Bitsy Spyder

	 _____ _            ______ _ _             _____                 _           
	|_   _| |           | ___ (_) |           /  ___|               | |          
	  | | | |_ ___ _   _| |_/ /_| |_ ___ _   _\ `--. _ __  _   _  __| | ___ _ __ 
	  | | | __/ __| | | | ___ \ | __/ __| | | |`--. \ '_ \| | | |/ _` |/ _ \ '__|
	 _| |_| |_\__ \ |_| | |_/ / | |_\__ \ |_| /\__/ / |_) | |_| | (_| |  __/ |   
	 \___/ \__|___/\__, \____/|_|\__|___/\__, \____/| .__/ \__, |\__,_|\___|_|   
			__/ |                 __/ |     | |     __/ |                
		       |___/                 |___/      |_|    |___/             
									  @Cont3nted :D  

A Basic Python Program using python scrapy library to scrap websites.

I have included my notes in notes.md on what I have learn throughout making this.

Prerequisite


Python

Scrapy version 2.0.0

git clone https://github.com/cont3nted/ItsyBitsySpyder.git

pip install Scrapy

How to use it


After cloning and pip installing the scrapy library,

just run main.py and key in the URL you want to scrap

and the extracted data will be put into the extracted_data folder.