NCAS-CMS/canari-data

Need to develop a tape pool strategy.

Opened this issue · 2 comments

We probably want to separate the data on tapes, need to discuss with the CEDA/JASMIN group:

Need at least:

  • dumps and boundary conditions pool
  • high frequency pool
  • monthly data pool
  • RCM data pool

Current estimates of GCM volumes would be

Volume Source
900 TB "normal" atmosphere data
450 TB "normal" ocean and ice data
540 TB compressed atmosphere dumps (monthly)
50 TB ocean and ice dumps (yearly)
30-200 TB 10 TB per regional model for frames
2-2.2 PB All in

So o(1.5PB) of science data, split amongst the high-frequency and monthly pools (details coming).
o(0.7PB) of dumps and boundary conditions (number of regional model frames tbd).

Depends on resolving #13 first!