This site is a community, crowdsourced collection of code, tools, datasets, and other resources related to SafeGraph Data and the SafeGraph Community. Thousands of organizations work with SafeGraph Data, and are contributing to COVID-19 data science research through the SafeGraph Community. We are leveraging the [awesome-list] approach to organize and share the rapidly growing set of contributions from this community.
Please add to the list 👍 📈 :
Do you have a software tool, research project, use case, code snippet, or data product related to or using SafeGraph data, that you'd like to recommend or share? Please add it to the list using either:
- a pull request with your items added to the list. This is so easy, you can just edit the file directly in your browser and then click the "commit" button. or
- an new issue that includes details of what to add (link, description) and we will add it.
Don't see a category that matches your needs--make a new one!
You can find out more about awesome-lists HERE
If you would like to know about different methods in which to add to the awesome-list, please checkout this step-by-step guide
SafeGraph is a geospatial data company. "Unlock innovation with the most accurate Points-of-Interest (POI) data, business listings, & store visitor insights data for commercial places in the U.S." Here is a full list of SafeGraph data sets which you can search in the SafeGraph Data Bar (use coupon AwesomeDataScience for $100 free data).
A list of code snippets, scripts, notebooks, and workflows for reproducing awesome data science with SafeGraph data
- safegraph_py -- a Python library designed to make your experiece with SafeGraph data as easy as possible. From Ryan Fox Squire (SafeGraph), Jack Lindsay and community members. Please contribute!
- SafeGraph Core Places Starter Notebook -- CoLab from Ryan Fox Squire (SafeGraph) -- Brand new to SafeGraph Places data? This will help you get oriented.
- Simple Outlier Filtering -- CoLab Notebook from Ryan Fox Squire (SafeGraph) -- Python Google CoLab Notebook showing simple IQR*k based outlier filtering
- Connecting Safegraph_place_id to Census Block Groups (CBGs) -- CoLab notebook by Ryan Fox Squire
- Quickly visualize SafeGraph data on a map with python -- CoLab Notebook from Ryan Fox Squire
- Convert SafeGraph geometry CSV files to ESRI Shapefile (.shp) format -- CoLab notebook from Eugene Chong (SafeGraph)
- Download from Wasabi with Boto3 from Thomas Roderick
- Python Library for wrangling Open Census Data for Demographic Analysis from Ryan Fox Squire (SafeGraph)
- Calculate area / square footage from SafeGraph Geometry polygon_wkt using geopandas from Ryan Fox Squire (SafeGraph)
- Matching CBGs to ZCTAS (Zip code tabulation areas) using geopandas for Covid-19 research from Chris Graziul (University of Chicago)
- Unfolded SQL-Query Helper for directly querying Unfolded in Python from Brian Blakely (Bowling Green State University)
- CBG to zip code/ZCTA merge - A notebook showing how to make a master dataset that includes a cross reference for nearly all CBG to ZCTA to Zip code conversion
- Automated Download and Filtering, Prep for Normalization (Monthly Patterns) - A notebook to easily filter monthly patterns to your desired POIs, and prepare data for use with SafeGraph's normalization best practices, allowing you to start analyzing more quickly from Ryan Kruse
- Aggregate social distancing metrics visits from origin CBG to destination CBG at the county level by Ruowei Yang
- Demo for getting started with SafeGraph Open Census Data Google CoLab Notebook from Ryan Fox Squire (SafeGraph)
- Demo for getting started with Monthly Patterns Data in Jupyter Notebook with SQLite from Ryan Kruse
- Demo for getting started with Social Distancing Data in Jupyter Notebook with SQLite from Ryan Kruse
- Merging patterns with core_places from Jack Lindsay - a short notebook displaying how you can merge the weekly patterns to the core places data
- Visualizing Catchment Analysis with SafeGraph Patterns from Ryan Kruse
- Identifying CBGs with Anomalously High Number of Devices Residing from Matthew Davidowicz.
- Databricks Python Notebook: Simple Demo of Analyzing Starbuck's visitors from SafeGraph Patterns from Ryan Fox Squire (SafeGraph)
- Demo for using PPP loan data and Core SafeGraph data from Jack Lindsay - a CoLab notebook showing how the SafeGraph core places data can be used as a master list of certain NAICS codes.
- The SafeGraphR github repo -- Package for reading and analyzing SafeGraph foot traffic data
- The Stanford Future Bay Initiative: Covid-19 Rapid Response Projects -- a collection of R functions and documentation for processing, normalizing, and analyzing SafeGraph foot-traffic data
- A Demonstration of how to do population weighting and Hierarchical Bayes shrinkage with SafeGraph social distancing data.
- For SafeGraph social distancing metrics, map census tracts to zip codes.
- Spatial crosswalks. Includes CBGs to ZCTAs, census tracts to zip codes, and zip codes to ZCTAs.
- Sample Raster Codes; getting raster statistics at census tract or county level.
- Sync SafeGraph data to a local directory using the
aws.s3package.
- SafeGraph Snowflake demo, a sequence of SQL queries demonstrating a comparison of SafeGraph Patterns data for two Starbucks locations, from Jeff Ho (SafeGraph)
- Awesome examples of SafeGraph data analysis with spreadsheets
- Awesome examples of SafeGraph data analysis with STATA
- Simple Methods for Normalizing SafeGraph Patterns Data Over Time from Eugene Chong (SafeGraph)
- Advanced Methods for Correlating SafeGraph Patterns With Other Datasets Across Time from Ryan Fox Squire (SafeGraph)
- Macro and Micro approaches to estimating true counts from SafeGraph data from Derek Ouyang (Stanford Future Bay Initiative)
- Memo and Spreadsheet Example for Simple Example of "Micro" CBG-based Normalization to estimate "True Visits" by day -- from Ryan Fox Squire (SafeGraph)
- Details on The Covid19 Commerce Patterns Dashboard from SafeGraph from Ryan Fox Squire (SafeGraph)
- Data Analysis Methodology for the SafeGraph Stay-At-Home Index from Ryan Fox Squire (SafeGraph)
- SafeGraph's Shelter-in-place index Appendix: Bayesian Hierarchical Models and Empirical Bayes from Ryan Fox Squire (SafeGraph)
- Measuring and Correcting Sampling Bias in Safegraph Patterns for More Accurate Demographic Analysis from Ryan Fox Squire (SafeGraph)
- Analyze Demographic Profiles of Retail Visitors From SafeGraph Patterns Data from Ryan Fox Squire (SafeGraph)
- Calculate Statistics and Confidence Intervals from SafeGraph Patterns from Ryan Fox Squire (SafeGraph)
- SafeGraph's Visit Attribution Whitepaper -- How does SafeGraph combine GPS data and point-of-interest polygon data to measure visits.
- Covid-19 Case Count Forecasting using SafeGraph data from UT Austin 8 A weekly fatality counts prediction model from Kostas Pelechrinis
- Analyzing Top Brands in SafeGraph Neighborhood Patterns Data -- A NLP approach to SafeGraph Top Brand analysis.
- SafeGraph Data Publications -- Full list of all publications using SafeGraph data. If you see something is missing, please let SafeGraph know by emailing datastories AT safegraph DOT com
- The SafeGraph Covid-19 Re-opening Dashboard -- built with plot.ly and Dash
- SafeGraph Weekly Patterns Disaster Response Map from Esri -- built with Arcgis Online
- Social Distancing Compliance Dashboard for City of San Jose from Stanford Future Bayusing R Shiny
- Covid-19 Cases and Point-of-interest Visit correlation dashboard from Stanford Future Bay using R Shiny
- UT Austin Covid-19 Forecasting using SafeGraph data
- SafeGraph Places Comparison Dashboard -- A dashboard that allows you to compare two different (sets of) POIs in terms of where they get their visitors from, and what the characteristics of those places are. Currently uses Harris County (Houston) example data but could easily be redone with a different area. Code in the GitHub Repo.
- Tableau Dashboard. This is an interactive comparison of movement between counties by day using Tableau as the visualization tool.
- ODT Flow Explorer. This is an interactive spatial web portal that allows you to query, aggregate, visualize, and download daily origin-destination (OD) flows derived from SafeGraph data and Twitter data at various geographic scales (from local to global).
- SafeGraph Free Point-of-interest Matching Tool
- How to Join X with Y a collection of free resources/tools for joining different geospatial areas together (e.g., County <> Zip Code)
- SafeGraph USA census block group lookup and visualization -- want to quickly see the shape of a CBG on a map?
- Movable-type Geohashes page
- arthur-e polygon WKT visualization
- Google CoLab -- FREE cloud-hosted python notebooks
- Esri
- CARTO
- Databricks
- Snowflake
- Tableau
- Tableau Dashboard. This is an interactive comparison of movement between counties by day using Tableau as the visualization tool.
- PowerBI
- SafeGraph Docs page
- SafeGraph data science resources page - Lots of notebooks and demos using SafeGraph data produced by SafeGraph
- SafeGraph FAQ
- SafeGraph Places Manual
- SafeGraph Monthly Release Notes
- Our community is where users of SafeGraph data come to get technical support, discover the latest news and trends in the geospatial industry, and colloborate with others on innovative projects. Over 9k leading researchers and industry professionals are part of this vibrant community and get access to exclusive events and seminars. SafeGraph is also committing to provide data free of charge to all individuals in the academic industry.
- Sign-up to join the SafeGraph Community
- SafeGraph SafeGraph Community Quick Start Guide
- Data SafeGraph Community FAQ