Issue in handling Date field. Kylo job failed
Opened this issue · 0 comments
Subject of the issue
Dataset with date fields are not managed properly: the related kylo job failed
Steps to reproduce
After the metadata process, submit a dataset with one or more date fields (that you defined properly in the ingestion form)
The kylo feed will start and try to process the dataset.
Expected behaviour
The date field should be handle properly and the job should be completed without errors a
Actual behaviour
The job failed.
Probably the current Hive version we are using doesn't manage properly the data fields.
Stack trace:
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.UnsupportedOperationException: Parquet does not support date. See HIVE-6384
Additional info
https://issues.apache.org/jira/browse/HIVE-6384
In the meantime we should consider to hide the "date" type from the ingestion form @panelladavide @giux78
Please see attached a sample dataset in order to reproduce the issue
sample_esiti_anac_TO.txt