knowledgesystems/knowledgesystems-k8s-deployment

Mount VEP Cache File w/o Downloading from S3

averyniceday opened this issue · 0 comments

Currently genie genome-nexus downloads the VEP cache from S3. We want to replace this cache with an indexed tabix-converted version which improves VEP performance. Furthermore, because this file takes a while to download, it would be better to figure out a way to have the cache stored on a persistent volume and just have the GN pod mount it on startup (preventing longer startup/restart times)

  • Check/locate which cache version to use
  • Figure out where to store cache (AWS volume)
  • Figure out how to mount through kubernetes config file (instead of curl download)

Consider NFS as a solution .. "timebox" the effort selecting a tool / approach. Not more than 1 day of examination. If at all possible ... avoid an amazon-specific solution. (Follow other kubernetes generic projects)

https://aws.amazon.com/efs/