Remove HEALTH.HealthCareFacilities from SGID
ZachBeck opened this issue · 40 comments
ZachBeck commented
Summary
- Internal Dataset Name: SGID.HEALTH.HealthCareFacilities
- External Dataset Name: opensgid.health.health_care_facilities
- ArcGIS Online Url: https://utah.maps.arcgis.com/home/item.html?id=f5e5d7c717c946fe9cd6f2c8d0bf8d86
HEALTH.HealthCareFacilities hasn't been updated in years. To facilitate the update process the current HealthCareFacilities needs to be deprecated and replaced by a dataset with the same name and new schema that is the same as the source data from the Dept of Health.
Migration Guide
AGOL data will be deprecated and shelved to make way for the new health care facilities
This dataset will be replaced by HEALTH.HealthCareFacilities which is named health.health_care_facilities in the Open SGID.
The replaced data is still accessible via our shelved policy in AGOL (a link to the shelved item).
Action items
- Assign a person who should complete the task by replacing
namewith their github@name. - Check [x] the box when the task is completed and add the date of completion.
Strikeout all items that do not apply.
Soft Delete
The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.
Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:
- Append "(Mature Support)" to the end of the item title in the
SGID.META.AGOLItemstable (@ZachBeck , completed:2024/07/08) - Remove all tags other than "Deprecated" in the SDE metadata (@ZachBeck , completed:
2024/07/08) - Add note to SDE description noting when layer will be deleted and any replacement layer (@ZachBeck, completed:
2024/07/08) - Update the SGID Index row as deprecated by pasting the related Porter issue URL in the Deprecated field (@ZachBeck, completed:
2024/07/08) - Change
Authoritativefield todinSGID.META.AGOLItemsto automatically set theDeprecatedAGOL flag. Allow thedto persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@ZachBeck , completed:2024/07/08)- After at least one successful run of Auditor:
- Remove the row from the
SGID.META.AGOLItemstable. This will trigger the removal of this item in Open SGID (@ZachBeck, completed:2024/07/15) - Unshare the item from its SGID group, which will remove it from Open Data (@jacobdadams, completed:
2023/00/00)
- Remove the row from the
- After at least one successful run of Auditor:
Hard Delete
Target Date: 2024/07/23
Hard deletes are final. It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.
- Manually remove data from the Internal SGID (@ZachBeck , completed:
2024/07/23)- Deprecated database layers should be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > internal_db_sgid_layers (@ZachBeck , completed:
2024/07/22).
- Deprecated database layers should be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > internal_db_sgid_layers (@ZachBeck , completed:
- Remove ArcGIS Online item: (@jacobdadams , completed:
2023/00/00)- Manually delete the AGOL item
- -OR-
- Unshare by changing the
AGOL_ITEM_IDfield inSGID.META.AGOLItemsto something other than an Item ID and manaually changing the sharing settings (remove the item from all SGID groups, remove Public sharing), - -OR-
- Shelve the data by copying the row from
SGID.META.AGOLItemsto theAGOLItems_shelvedtable in AGOL and changing theAGOL_ITEM_IDfield inSGID.META.AGOLItemstoshelvedor some other note.
- Deprecated AGOL items can be backed up on Google Drive > AGRC Projects > SGID > deprecated layers >agol_sgid_layers.
[ ] Remove Farm from AGOL connection (name, completed:2023/00/00)- Update relevant gis.utah.gov data pages (@ZachBeck, completed:
2023/07/23)
- [ ] Add this porter url to theDeprecatedfield of the Stewardship record (name, completed:2023/00/00) - Update
SGID.META.AGOLItemstable (@ZachBeck, completed:2024/07/15)- cut and paste row to
AGOLItems_shelvedtable if shelving (see below) - set the
AGOL_ITEM_IDfield tohosted by <agency>for Farm from AGOL - set the
AGOL_ITEM_IDfield toexclude from AGOLto not publish to ArcGIS Online
- cut and paste row to
- Delete Google Drive data (@ZachBeck , completed:
2024/07/23) - Remove row from
SGID.META.ChangeDetection(@stdavis , completed:2023/07/29) - Remove data from forklift hashing and receiving (@stdavis, completed:
2023/07/29) - Remove row from
data/hashed/changedetection.gdb/TableHashes(@stdavis, completed:2023/07/29)
Shelve/Static
Choose one based on situation.
- [ ] Upload to UtahAGRC/AGRC_Shelved folder in AGOL (New shelved item not already in AGOL) (name , completed: 2023/00/00)
- Move existing AGOL item to
AGRC_ShelvedAGOL folder (shelving an item already in AGOL) (@ZachBeck, completed:2024/07/23)
- [ ] Upload to appropriateUtahAGRC/{SGID Category}folder in AGOL (forstaticdatasets) (name, completed:2023/00/00)
Add record to table.
- Add record to
AGOLItems_shelvedtable in ArcGIS Online withshelvedorstaticin theCATEGORYfield (@ZachBeck, completed:2023/07/23)
🤖 Automation validation
- Assign yourself or someone to check the item by replacing
namewith their github@name. - Check [x] the box and add the date of verification
2020/01/01when the task is verified. Strikeout all items that do not apply.
- Remove data from Open SGID (@steveoh on
2024/08/07) - sgid-index (@steveoh on
2024/08/07) - Auditor sets appropriate
shelved/static/Deprecatedinformation (@jacobdadams on2024/07/09)
Are there service dependencies
- Are clients querying this data with the WebAPI?
- Notify Don Jackson (at motorolasolutions.com) if the data is in the Next-Generation 911 Motorola Aware Map? (@gregbunce on
2023/00/00) - Does any other application depend on this data?
Notification
- Twitter (@steveoh)
Group Task Assignments
- Check [x] the box when you have assigned all the tasks relevant to your group.
- Data Team (@gregbunce)
- Dev Team (@steveoh)
- Cadastre Team (@rkelson)
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @eneemann has completed 0 out of 1 tasks | ⛔ |
| @gregbunce has completed 0 out of 1 tasks | ⛔ |
| @rkelson has completed 0 out of 1 tasks | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @eneemann has completed 0 out of 1 tasks | ⛔ |
| @gregbunce has completed 0 out of 1 tasks | ⛔ |
| @rkelson has completed 0 out of 1 tasks | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @eneemann has completed 0 out of 1 tasks | ⛔ |
| @gregbunce has completed 0 out of 1 tasks | ⛔ |
| @rkelson has completed 0 out of 1 tasks | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @eneemann has completed 0 out of 1 tasks | ⛔ |
| @gregbunce has completed 0 out of 1 tasks | ⛔ |
| @rkelson has completed 0 out of 1 tasks | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @eneemann has completed 0 out of 1 tasks | ⛔ |
| @gregbunce has completed 0 out of 1 tasks | ⛔ |
| @rkelson has completed 0 out of 1 tasks | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 0 out of 2 tasks | ⛔ |
| @rkelson has completed 0 out of 1 tasks | ⛔ |
steveoh commented
adding blocked since work hasn't started
ZachBeck commented
Waiting on updated facilities from Health.
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | ⛔ |
| open sgid | ⛔ |
| open data | ⛔ |
| arcgis online | ⛔ |
| stewardship | |
| - porter issue link | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | ⛔ |
| open sgid | ⛔ |
| open data | ⛔ |
| arcgis online | ⛔ |
| stewardship | |
| - porter issue link | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | ⛔ |
| open sgid | ⛔ |
| open data | ⛔ |
| arcgis online | ⛔ |
| stewardship | |
| - porter issue link | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
brigsz commented
Do folks think this will need a new retention schedule as it moves to "Shelved"? it seems like it will, as it is different from non shelved.
steveoh commented
In my opinion it probably doesn't need to be shelved. It lived in the SGID for longer than 6 months and archives should have a copy so I believe we are covered there. The schedule it is on says archives will retain it in perpetuity, which I would suggest maybe a shorter lifespan since it doesn't appear to have historical relevance.
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | ⛔ |
| open sgid | ⛔ |
| open data | ⛔ |
| arcgis online | ⛔ |
| stewardship | |
| - porter issue link | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 0 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | ⛔ |
| open sgid | 👍 |
| open data | ⛔ |
| arcgis online | ⛔ |
| stewardship | |
| - porter issue link | ⛔ |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 3 out of 11 tasks | ⛔ |
| @jacobdadams has completed 0 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 4 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | ⛔ |
| open sgid | ⛔ |
| open data | ⛔ |
| arcgis online | ⛔ |
| stewardship | |
| - porter issue link | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 6 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | ⛔ |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |
jacobdadams commented
Sorry to reopen the conversation. We're shelving this layer, but I'm wondering if we shouldn't just do a hard delete it and keep a copy in our google drive. It seems as though it's been completely superseded by the new layer and there's not any reason to keep the historic data around (ie, is anyone going to want to compare this with the new one to track changes over time?).
steveoh commented
I agree. When Matt and I were looking at the shelved category items, it appeared that there are many more shelved items than seemed to have historical relevance. Maybe I need a refresher on when items should be shelved or we need to take a closer look at the process to understand what's being added there.
jacobdadams commented
From our policy:
Over time, we will remove datasets from the Open SGID that are no longer current but continue to have historical value (e.g., Census/ACS data or previous tax district boundaries). Their associated ArcGIS Online items will be tagged as shelved and placed in the public UGRC Shelf ArcGIS Online group for future reference. Shelved datasets are not included in the SGID on ArcGIS site.
steveoh commented
Tracking in agrc/planning-queue#452
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 11 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 4 tasks | ⛔ |
| @stdavis has completed 0 out of 3 tasks | ⛔ |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | 👍 |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 11 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 4 tasks | ⛔ |
| stdavis has completed 3 out of 3 tasks | 👍 |
| @steveoh has completed 0 out of 3 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | 👍 |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 11 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 3 tasks | ⛔ |
| stdavis has completed 3 out of 3 tasks | 👍 |
| @steveoh has completed 3 out of 4 tasks | ⛔ |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | 👍 |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 11 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 3 tasks | ⛔ |
| stdavis has completed 3 out of 3 tasks | 👍 |
| steveoh has completed 4 out of 4 tasks | 👍 |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | 👍 |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| @ZachBeck has completed 11 out of 13 tasks | ⛔ |
| @jacobdadams has completed 1 out of 3 tasks | ⛔ |
| stdavis has completed 3 out of 3 tasks | 👍 |
| steveoh has completed 4 out of 4 tasks | 👍 |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | 👍 |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |
agrc-conductor commented
conductor results for tasks - 256
| check | status |
|---|---|
| ZachBeck has completed 13 out of 13 tasks | 👍 |
| @jacobdadams has completed 1 out of 3 tasks | ⛔ |
| stdavis has completed 3 out of 3 tasks | 👍 |
| steveoh has completed 4 out of 4 tasks | 👍 |
| @gregbunce has completed 1 out of 2 tasks | ⛔ |
| rkelson has completed 1 out of 1 tasks | 👍 |
agrc-conductor commented
conductor results for HEALTH.HealthCareFacilities
| check | status |
|---|---|
| internal sgid | 👍 |
| meta table | 👍 |
| stewardship | |
| - porter issue link | 👍 |