NationalSecurityAgency/timely

Metric tablets may not fully age-off

dtspence opened this issue · 0 comments

Tablets may accumulate for metrics that should be aged-off. Accumulo may create split points at certain time boundaries which can lead to orphaned metrics in older tablets. This is caused by the default compaction strategy no longer checking tablets after the split has occurred and the ratio calculation remaining unchanged.

The workaround is to invoke a full or scripted compaction.

Example:

sys.cpu-<-11days> [prev-end]
sys.cpu-<-10days> [end]

Given an age-off of 5 days and an example sys.cpu tablet above; the DefaultCompactionStrategy may have successfully compacted the tablet before the age-off is reached. Once a split has occurred, the data will no longer change and new compactions will not take place to delete data.