[discussion] DB data rotation/partitioning
mimir-d opened this issue · 0 comments
Friday Oct 09, 2020 at 09:54 GMT
Originally opened as https://github.com/facebookincubator/contest/issues/149
This is a follow-up task of discussion: https://github.com/facebookincubator/contest/pull/148
(feel free to edit the issue)
Problem
Currently we just have a database where we store the whole history of anything ever happened. So longer we use ConTest, more data is stored and those tables. And the problem is that in long term any migration/backup/whatever of the DB might take too much time. IMO, it makes sense to consider ways to rotate/archive data or partition it.
Action required
So I'm asking to share your thoughts about the problem and possible solutions, including data rotation/archivation and data partitioning. We need to decide what and how we will do about the problem.