aetzion1/scraper_tutor

Repository to facilitate lessons on python and web scraping (for education purposes only)

README

SCRAPER TUTOR

• Database notes: This app does not use or create a database. It is for educaitonal purposes. Running the existing final python file will create an eggs.csv

Dependencies

• Python version: 3
• Tools Required:
  • requests
  • bs4 (BeautifulSoup)
  • csv

How to run the practice file:

• To run the file, type the following into your temrinal: '$ python 3 <file_name>'
• Try to work through the file provided and make changes. Play arund with it!
• Find a web page that you would like to try to scrape (be sure to review the robots.txt file for that page)
• Copy this tool and work to scrape your example site. The code will likely need to be adjusted. Jump into the Developer tools to View the Source code / inspect elements to understand what might need to be changed!

NOTE: Please review the robots.txt page for all sites used for this educational practice tool!