Bloom filters based on structured metadata search chunks even if key does not exists
Closed this issue · 4 comments
Describe the bug
Based on this even if metadata key is not present chunk is still considered to be used.
Expected behavior
If key nor value exist in metadata chunk should not be considered.
Hi @tiithansen
This is expected behaviour. The reason is that the requested label of the label filter expression could be a regular label as well. We simply don't know it at this point, since the bloom gateway is only dealing with fingerprints (hashed labels of streams).
Yes, ideally we could dismiss all chunks. This is something we have on our radar and want to improve, because it can increase the filter rate by a lot.
Hmm, ok lets say I run query like:
{cluster="prod"} | trace_id="xxxx" then it matches all chunks which have trace_id in it?
By regular label you mean stream filter label?
Thanks, I will give it test.