/Scrapping_web

Demo App for scrapping content from a real state portal

Primary LanguagePython

Scraper

Scraping web

Installation

git clone https://github.com/saketbairoliya2/Scraper.git
cd Scraper
pip install -r requirements.txt

Usage

python shopping.py <key>
python shopping.py <key> <page number>

Problem

Implement a robust text scraper that will connect to a page on www.shopping.com, and return a result for a given keyword. Two queries can be performed using this program. The first query is getting the total number of results for a given keyword. The second query is to find all results for a given keywords on a specified page. Handle all the exceptions gracefully any feel free to use your favorite library.

Following are the URLs

`http://www.shopping.com/products?KW=<keword>`
`http://www.shopping.com/products~PG-<number>?KW=<keyword>"`

Queries:

Query 1: (requires a single argument)
`your_program <keyword>`

Query 2: (requires two arguments)
`your_program <keyword> <page number>`