agrc/porter

Remove EMS Facilities from SGID

Closed this issue ยท 40 comments

Summary

As near as I can tell, based on the blog post "Utah SGID Layer Updates" dated 2013-06-05, the EMS Facilities layer was supposed to be removed in favor of a new Emergency Medical Services layer. However, despite a corresponding "Removal" entry in the data stewardship log, they both appear to have continued in the SGID and have both made it into AGOL.

Our hub/open data site includes both, and the current data page points to the older one.

I propose completely expunging the older layer and using the website update process to update the data page.

Brownout: 21 June 2024
Removal: 8 July 2024

Migration Guide

Repoint data to the Emergency Medical Services Layer.

This dataset has been replaced by Emergency Medical Services which is named health.emergency_medical_services in the Open SGID and utah-emergency-medical-services in ArcGIS Online Hub (Open Data) .

Action items

  1. Assign a person who should complete the task by replacing name with their github @name.
  2. Check [x] the box when the task is completed and add the date of completion.
  3. Strike out all items that do not apply.

Soft Delete

The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.

Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:

  • Append "(Mature Support)" to the end of the item title in the SGID.META.AGOLItems table (@jacobdadams, completed: 2024/06/21)
  • Remove all tags other than "Deprecated" in the SDE metadata (@jacobdadams, completed: 2024/06/21)
  • Add note to SDE description noting when layer will be deleted and any replacement layer (@jacobdadams, completed: 2024/06/21)
  • Update the SGID Index row as deprecated by pasting the related Porter issue URL in the Deprecated field (@jacobdadams, completed: 2024/06/21)
  • Change Authoritative field to d in SGID.META.AGOLItems to automatically set the Deprecated AGOL flag. Allow the d to persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@jacobdadams, completed: 2024/06/21)
    • After at least one successful run of Auditor:
      • Remove the row from the SGID.META.AGOLItems table. This will trigger the removal of this item in Open SGID (@jacobdadams, completed: 2024/06/25)
      • Unshare the item from its SGID group, which will remove it from Open Data (@jacobdadams, completed: 2024/00/00)
  • Check if this layer in the base maps. If so, work with Zach to develop a path forward before you proceed with a Hard Delete (@jacobdadams, completed: 2024/06/25).

Hard Delete

Hard deletes are final. It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.

  • Manually remove data from the Internal SGID (@jacobdadams, completed: 2024/07/08)
  • Remove ArcGIS Online item: (@jacobdadams, completed: 2024/07/08)
    • Manually delete the AGOL item
      - [ ] Remove Farm from AGOL connection (name, completed: 2024/00/00)
  • Update relevant gis.utah.gov data pages (@jacobdadams, completed: 2024/07/08)
  • Add this porter url to the Deprecated field of the Stewardship record (@jacobdadams, completed: 2024/06/21)
  • Update SGID.META.AGOLItems table (@jacobdadams, completed: 2024/07/08)
    - cut and paste row to AGOLItems_shelved table if shelving (see below)
    - set the AGOL_ITEM_ID field to hosted by <agency> for Farm from AGOL
    - set the AGOL_ITEM_ID field to exclude from AGOL to not publish to ArcGIS Online
  • Delete the entry from the table
    - [ ] Delete Google Drive data (name, completed: 2024/00/00)
  • Remove row from SGID.META.ChangeDetection (@stdavis, completed: 2024/07/08)
    • I couldn't find the "sgid.health.emsfacilities" table name in this table
  • Remove data from forklift hashing and receiving (@stdavis, completed: 2024/07/08)
  • Remove row from data/hashed/changedetection.gdb/TableHashes (@stdavis, completed: 2024/07/08)

๐Ÿค– Automation validation

  1. Assign yourself or someone to check the item by replacing name with their github @name.
  2. Check [x] the box and add the date of verification 2020/01/01 when the task is verified.
  3. Strike out all items that do not apply.

Are there service dependencies

  • Are clients querying this data with the WebAPI?
  • Notify Don Jackson (don.jackson1 at motorolasolutions.com) if the data is in the Next-Generation 911 Motorola Aware Map? (@gregbunce on 2024/03/11)
  • Does any other application depend on this data?

Notification

Group Task Assignments

  1. Check [x] the box when you have assigned all the tasks relevant to your group.

When does the brown out date start and when should the final deletion date be?

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
@gregbunce has completed 1 out of 2 tasks โ›”
@rkelson has completed 0 out of 1 tasks โ›”

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
@rkelson has completed 0 out of 1 tasks โ›”

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
@rkelson has completed 0 out of 1 tasks โ›”

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
@rkelson has completed 0 out of 1 tasks โ›”

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- deprecation issue link โ›”

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
@rkelson has completed 0 out of 1 tasks โ›”

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
@rkelson has completed 0 out of 1 tasks โ›”

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 0 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 8 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table โ›”
open sgid โ›”
open data โ›”
arcgis online โ›”
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 10 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table ๐Ÿ‘
stewardship
- porter issue link ๐Ÿ‘

conductor results for tasks - 297

check status
@jacobdadams has completed 10 out of 15 tasks โ›”
@stdavis has completed 0 out of 3 tasks โ›”
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid โ›”
meta table ๐Ÿ‘
stewardship
- porter issue link ๐Ÿ‘

Ok, the layer has been deleted from Internal and AGOL. There was no gis.utah.gov content for it. If I've done everything right, it should soon be completely gone from everything (except a backup zip in google drive).

conductor results for tasks - 297

check status
jacobdadams has completed 15 out of 15 tasks ๐Ÿ‘
stdavis has completed 3 out of 3 tasks ๐Ÿ‘
@steveoh has completed 2 out of 4 tasks โ›”
gregbunce has completed 2 out of 2 tasks ๐Ÿ‘
rkelson has completed 1 out of 1 tasks ๐Ÿ‘

conductor results for HEALTH.EMSFacilities

check status
internal sgid ๐Ÿ‘
meta table ๐Ÿ‘
stewardship
- porter issue link ๐Ÿ‘

This looks ready to be closed ๐Ÿ