Support External Catalogs in DBT Adapter
Opened this issue · 3 comments
Feature request
Is your feature request related to a problem? Please describe.
No, but a blocker to use the DBT adapter.
Describe the solution you'd like
The SR DBT Connector supports reading from external tables/catalogs and writing materialized tables into SR internal storage.
We plan to use SR for querying our external Hive tables with disk caching instead of Presto/Athena. We have many processes around using DBT to transform data in Athena. It would be great to be able to replace them with SR instead.
Describe alternatives you've considered
No alternatives at the moment, DBT runs happen in Athena and we read the resulting data in SR.
Ideally nosql systems such as Elastic or Kafka can also be supported and even the ingestion from kafka controlled form DBT
@wangyouzhuo for visibility
I saw that there was a readme section on supporting hive external catalog. Can you try it out?