Urban heating Discovery/houston-* intermittent failures
Closed this issue · 3 comments
What
Maps in urban heating discovery are intermittently failing to load, see note:
#299 (comment)
Notes
- The dev-stac-api and staging-stac-api versions of the land cover collection refer to different assets, the dev assets are newer
AC
- All maps in urban heating discovery load data
@anayeaye I'm not seeing any issues loading the Houston urban heat rasters in the discovery page: https://www.earthdata.nasa.gov/dashboard/environmental-justice/discoveries/urban-heating
It also looks like the collections in dev and staging are in sync. What were some of the errors you saw previously?
@smohiudd @slesaad The behavior I have seen is that sometimes one or more of the land cover comparison maps in the urban heating discovery would fail to load. I did not source the problem but I suspected a time out on an invalid file because it still worked sometimes. I signed in to MCP to get a couple filenames to compare the old (currently ingested to staging) versions of the files to the newer versions. I'm pasting some notes below from a quick comparison.
From what I can see, the assets in the staging Houston land cover collection have all caps filenames and work in the viewer but are not valid. They also do not have embedded colormaps. In the same veda-data-store-staging buckets there are another series of rasters that have lower case filenames, are valid COG, and have embedded colormap info.
Staging 2001 landcover
S3 assets like s3://veda-data-store-staging/houston-landcover/HOUS_DFAL_Z_f_landcover_2001.tif
example staging item record https://staging-stac.delta-backend.com/collections/houston-landcover/items/HOUS_DFAL_Z_f_landcover_2001
This COG is invalid but still works a lot of the time (my guess is the intermittent errors are time outs?)
https://staging-raster.delta-backend.com/cog/validate?strict=false&url=s3%3A%2F%2Fveda-data-store-staging%2Fhouston-landcover%2FHOUS_DFAL_Z_f_landcover_2001.tif
Newer file version for 2001 landcover is valid
S3 asset naming pattern s3://veda-data-store-staging/houston-landcover/landcover_Z_2001_cog.tif
Thanks for pointing out the issue @anayeaye !
I updated the staging catalog with the updated cogs.
I've loaded it in multiple browsers multiple times and they seem to load fine to me.
Hopefully, the intermittent failures don't happen anymore!
Closing this, for now, will reopen if we see failures in the future!