openclimatefix/PVNet

Deal with satellite outages

Closed this issue · 4 comments

dfulu commented

Sometimes, on a fairly regular schedule, the rapid refresh satellite data that we use to run the model in production goes offline. Usually for a 2-day period each month.

This can cause a degradation in model performance like happened on 20th June.
Screenshot 2023-06-21 at 14 32 36

When the rapid refresh is down the 15-minutely data still exists, and PVNet1 used this. See here. We could try a similar solution for PVNet2, maybe in combination with training a model specifically for this circumstance

Thanks @dfulu for putting this here,

note: this happens when switching from the 5 min data, to 15 min data

Could this be solved by,

  • loading 15 mins data, when 5 mins is not avaialble
  • dont fill satellite data with zeros?

Thoughts @dfulu

@dfulu we can probably close this too