Add table_type property to create_ctas_table to support iceberg tables
Closed this issue · 2 comments
Is your idea related to a problem? Please describe.
Iceberg has a lot of nice features we'd like to use, and AWS create table as supports it now out of the box. It'd be great if the create_ctas_table allowed us to specify the table type to be either hive or iceberg as per the spec linked before.
Describe the solution you'd like
create_ctas_table has a new kwarg, table_type. It would also change external_location to location based on Hive vs Iceberg table type, in addition to changing partitioned_by to partitioning
Alternatively, the function could be made more general by adding a kwarg additional_table_properties which allows end users to do what they want instead of restricting things to a subset of keywords.
I'd be happy to submit a PR for this if the concept sounds good.
Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.