aws-samples/aws-glue-samples

Issue with direct migration from hive metastore to glue catalog

Opened this issue · 0 comments

While migrating table with OpenCSVSerde from hive metastore to glue catalog it brings extra character on serde properties. Like hive metastore has * however glue catalog will have *.

I think the problem is creted by the below function (hive_metastore_migration.py)

def udf_escape_chars(param_value):
ret_param_value = param_value.replace('\', '\\')
.replace('|', '\|')
.replace('"', '\"')
.replace('{', '\{')
.replace(':', '\:')
.replace('}', '\}')