delta-io/connectors

Power BI - Allow Partition filters to be set via the Power Query UI

gbrueckl opened this issue · 1 comments

Currently, in order to leverage partition pruning, you have to manually specify the filter expression as part of code and there is no UI to make this partition filtering easier for users.
image
This approach is quite powerful as it allows all kinds of filtering but is not really accessible to the unexperienced user which could result in loading the whole delta lake table to the client first and then discarding the non-matching rows again

This shall be improved so UI filters are also passed down to the Delta Lake table and the files are filtered based on the metadata in the delta_log already:
image

This can be accomplished using Table.View and the GetRows parameters

It will probably be a bit complicated to handle all possible selections from the UI but at least basic filters like equals, greater, less, in should be supported

This repo has been deprecated and the code is moved under connectors module in https://github.com/delta-io/delta repository. Please create the issue in repository https://github.com/delta-io/delta. See #556 for details.