42atomys/stud42

fix: meilisearch disk space grow every day

42atomys opened this issue · 1 comments

Describe the bug

Discovered with monitoring : https://discord.com/channels/248936708379246593/1023378285935198208/1051908954583748638

The PVC of meilisearch seams grow up, incrementally and reach the alert point of 75%.

Need to be investivate quick due to the fact of : if we increase the pvc size, we cannot reduce it after.

To Reproduce

REQUIRED AN ADMIN ACCESS

  1. Watch the pvc size on https://dashboards.s42.app/d/lexkUXnVk/panels-library?orgId=1&from=now-30d&to=now&var-pvc=meilisearch-data&var-namespace=production
  2. Watch the file system on kubernetes cluster directly

Expected behavior

The Database size with 26,846 users is ~ 70 Mb, the databse of meilisearch must be close of the data size.

Relevant log output

No response

Version of software

v0.20

Environment

Live (https://s42.app)

Additional context

Screenshot 2022-12-12 at 20 18 44

Screenshot 2022-12-12 at 20 18 19

Code of Conduct

  • I agree to follow this project's Code of Conduct

After investigation on pod directly :

700Mb are used by tasks database. Need to found a solution to auto clean tasks.

Docs found : https://docs.meilisearch.com/reference/api/tasks.html#delete-all-tasks