exasol/hadoop-etl-udfs

Cannot compile develop branch with Hive version 1.1.0-cdh5.16.2

nicolamarangoni opened this issue · 3 comments

nicolamarangoni commented

Hello,
trying to compile with the following command
mvn clean -DskipTests package -P cloudera -Dhadoop.version=2.6.0-cdh5.16.2 -Dhive.version=1.1.0-cdh5.16.2
I get the following error:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.2:compile (default-compile) on project hadoop-etl-common: Compilation failure: Compilation failure:
[ERROR] /home/mar0012n/hadoop-etl-udfs/hadoop-etl-common/src/main/java/com/exasol/hadoop/HdfsSerDeImportService.java:[18,42] cannot find symbol
[ERROR]   symbol:   class Date
[ERROR]   location: package org.apache.hadoop.hive.common.type
[ERROR] /home/mar0012n/hadoop-etl-udfs/hadoop-etl-common/src/main/java/com/exasol/hadoop/HdfsSerDeImportService.java:[22,42] cannot find symbol
[ERROR]   symbol:   class Timestamp
[ERROR]   location: package org.apache.hadoop.hive.common.type
[ERROR] /home/mar0012n/hadoop-etl-udfs/hadoop-etl-common/src/main/java/com/exasol/hadoop/HdfsSerDeImportService.java:[336,46] cannot find symbol
[ERROR]   symbol:   method toEpochMilli()
[ERROR]   location: variable hiveDate of type java.util.Date
[ERROR] /home/mar0012n/hadoop-etl-udfs/hadoop-etl-common/src/main/java/com/exasol/hadoop/HdfsSerDeImportService.java:[337,35] cannot find symbol
[ERROR]   symbol:   class Timestamp
[ERROR]   location: class com.exasol.hadoop.HdfsSerDeImportService
[ERROR] /home/mar0012n/hadoop-etl-udfs/hadoop-etl-common/src/main/java/com/exasol/hadoop/HdfsSerDeImportService.java:[338,19] cannot find symbol
[ERROR]   symbol:   class Timestamp
[ERROR]   location: class com.exasol.hadoop.HdfsSerDeImportService
[ERROR] /home/mar0012n/hadoop-etl-udfs/hadoop-etl-common/src/main/java/com/exasol/hadoop/HdfsSerDeImportService.java:[338,46] cannot find symbol
[ERROR]   symbol:   class Timestamp
[ERROR]   location: class com.exasol.hadoop.HdfsSerDeImportService
morazow commented

Hello @nicolamarangoni,

Thanks for the feedback. I am going to look into it. There was issue with Hive date/timestamp types for some versions of Hive.

  • 👍1
morazow commented

Hello @nicolamarangoni,

Thanks for the feedback!

Please use the main branch for building Cloudera 5.16.x artifacts. For now, develop branch is used to track the Hive 3.1.x releases that introduced compatibility issues with date/timestamp types (shown in the errors above).

Additionally, I released new version, in the releases section of the repository you could also find already assembled artifacts, the one you need has cdh5.16.2 suffix on the jar file.

nicolamarangoni commented

Hi @morazow , many thanks for making the jar available! I will test it in the next days!

  • 👍1