Ability to exclude columns from replication
nurikk-sa opened this issue · 6 comments
Hello! Thanks for a great software! TF provider is really good addition to airbyte.
I'm looking for a way to exclude column from replication. Currently terraform provider doesn't support field list/exclusion.
Example reason: remove sensitive columns from replica, like emails/passowrds
I plus one this! Thanks for the really nice tool, I was so happy to see specially the Terraform provider and everything else looks amazing, but this little use-case which is missing is actually a huge deal-breaker for our use-case. It would be amazing if we could directly select columns via Terraform, otherwise the manual selection via UI is reset every time you configure the connection and you have to redo the selection for each and every stream (eg. when adding a new stream to the connection). I couldn't find any workarounds for it, there is no way to select them on the source (in my case redshift) and I've even tried creating a view on top of my table to contain only the columns needed but the streams don't include the views in the stream.
That would be excellent!
Having a way to use terraform with airbyte in itself is incredible, but with this functionality it would be amazing.
Anxiously awaiting a response.
Not having column selection here prevents us (and I believe everyone who needs this feature) from using this TF provider for connections. It's still great to have source and destinations defined once and versioned as TF configurations 👍
+1 this feature is really missing :(
It would be great if this feature will be available soon. Terraform is not used to his full potential. Getting streams on a connection is good, but not enough. Airbyte UI can be a source of error if we misclick on the webpage.
+1 We also need this feature. Today we are waiting for it to be available to use airbyte