The following python code is capable of scraping dynamic web site. For this project I have used Amazon.com and Naukri.com
The automated web scraper can be used for any data analysis project
- BeautifulSoup
- Selenium
- Webdrivers
Using Beautyfulsoup, selenium and web drivers we can extract
- Price
- Rating
- Review count
- URL of product searched
- Image link
The result is saved in an excel file. Which can be used for further analysis
Built a python web scraper to extract data from Naukri job site and save the output as a csv
We have a csv file 'link_by_areas.csv’ as an input containing following information:
- Type of job
- Job posting page
I have scrapped data and saved into an output file. Following information is scraped and saved in the output file:
- Job_Title: Job title posted on the website
- Experience: Experience needed
- Company: Company which posted the job
- Scraping_date : Which date did I scraped the data
- Salary: Salary mentioned in the posting (Not disclosed when not mentioned)
- Location: Location for the Job
- Tag mentioned: Associated words with the job
- Posting date: Date of job posting