Title | Author | Date |
---|---|---|
Automating Data Download with Python |
John Fay |
Fall 2020 |
These are some notebooks demonstrating various ways to download data using Python packages. These examples are intended to be run using an ArcGIS Desktop install of Python.
- A refresher on ways to import local data files using native file objects,
csv
,numpy
, andpandas
- Accessing web-hosted csv and txt files directly using
pandas
- Fetching files on a web server with
urllib
- Fetching files on an ftp server with
ftplib
- Grabbing HTML tables with
pandas
- Scraping data with
requests
andbs4
- Using specialized Python packages for data download
Census
- First, it will reveal some actual strategies for automating data download for your course projects or for other tasks.
- Second, it introduces concepts relating to "web-GIS" and "cloud computing" that we will follow up in subsequent lectures...