spacejam/sled

Storage issues when using high count of trees

Opened this issue · 1 comments

Hey there,

I have a need of using really a lot of trees to make difference/versioning of some values.
Unfortunately, looks like this cause lot of storage issues as the database is bloat up to 30 GB..

Also, when doing a loop on all trees from DB to drop them, the database explose in size (30 GB -> 90 GB)

  • expected result: Not have 29 GB of database on disk for ~500 MB of data
  • actual result: 29 GB on disk used
  • sled version: last stable available (0.34.7)
  • rustc version is 1.72.0
  • Operating System: Debian 11 (kernel v5.10.0-25-amd64)

have you tried reducing the segment size in the options ? it could help i think