delta-io/connectors

Power BI Connector does not work when root path of delta table contained in function parameter

TKlerx opened this issue · 6 comments

Hey there,

when using power query to get the set of files for the delta connector, the following query results in an emtpy table when using the Power BI Delta connector:

let
    Source = AzureStorage.Blobs("some_blob_name"),
    storage = Source{[Name="some_container_name"]}[Data],
    #"Filtered Rows" = Table.SelectRows(storage, each Text.StartsWith([Name], "customers"))
in
    #"Filtered Rows"

This results in the following table:
image

Having the first row there makes the delta connector fail.
Changing the power query to the following (only adding a trailing "/" in the filter string and thus getting rid of the first row) makes the connector work:

let
    Source = AzureStorage.Blobs("some_blob_name"),
    storage = Source{[Name="some_container_name"]}[Data],
    #"Filtered Rows" = Table.SelectRows(storage, each Text.StartsWith([Name], "customers/"))
in
    #"Filtered Rows"

I guess this could/should be handled in the Power BI connector function, if possible.

@gbrueckl - is this something you think you could take on?
also, @TKlerx would you be interested in implementing a fix?

sure, will have a look - should not be hard to fix
you can assign it to me

Awesome. Assigned to you @gbrueckl !

tdas commented

@gbrueckl any update on this?

not 100% sure but I am not able to reproduce the issue with the current/latest version.
It was probably fixed with the code that was released 3 days after this ticket was opened
@TKlerx can you please verify again with the latest code from this repo

Yeah, it is working now without trailing "/"