italia/daf-kylo

Issue in handling Date field. Kylo job failed

Opened this issue · 0 comments

Subject of the issue

Dataset with date fields are not managed properly: the related kylo job failed

Steps to reproduce

After the metadata process, submit a dataset with one or more date fields (that you defined properly in the ingestion form)
The kylo feed will start and try to process the dataset.

Expected behaviour

The date field should be handle properly and the job should be completed without errors a

Actual behaviour

The job failed.

Probably the current Hive version we are using doesn't manage properly the data fields.

Stack trace:
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.UnsupportedOperationException: Parquet does not support date. See HIVE-6384

Additional info

https://issues.apache.org/jira/browse/HIVE-6384

In the meantime we should consider to hide the "date" type from the ingestion form @panelladavide @giux78

Please see attached a sample dataset in order to reproduce the issue
sample_esiti_anac_TO.txt