AbsaOSS/pramen

Use Hive's 'varchar(n)' data type when the maximum length of string fields is known.

Closed this issue · 0 comments

Background

Using varchar(n) when exposing tables via Hive helps importing data to relational databases that do not support varcher without specifying maximum string length.

Feature

A description of the requested feature.

Proposed Solution

Maximum length of fields can be determined by StructType field metadata key 'maxLength'. Cobrix sets this automatically from copybooks. For other data sources this field should be set in order to use this feature.