Simple script to scrape Google using requests
and bs4
.
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
Python3+
https://www.python.org/downloads/
# clone repo
git pull https://github.com/getlinksc/scrape_google.git
# install requirements
pip install -r requirements.txt
# modify query in search.py and run script
python search.py
- Python3 - Python is a programming language that lets you work quickly and integrate systems more effectively.
- Pip - The Python Package Installer
- Requests - HTTP for Humans
- Beautiful Soup - a Python library for pulling data out of HTML and XML files
- Google Search API - an API for scraping Google search results
- Link.sc - Initial work - Link.sc