thiggimajig/scraper_search_database

Scraper goes to a website then Loops through all pages and all results on each page collecting ID. That ID goes into a url manipulator script to get the primary document url for each of those cases. Then it loops through all of those primary documents and scrapes the stake holder names and prints to a csv. Then the google search script takes those names and conducts a google search with each name and a certain keyword. The top 10 search results are printed to a new CSV. I'd like to get this data all into a sql database or manipulate with pandas.

Python