tensorflow/ecosystem

Failed to build spark-tensorflow-connector_2.12

Echo9573 opened this issue · 3 comments

Environment


tensorflow: 2.0.0
spark version: 2.4.3-107
maven version: 3.6.3


Description
I have followed the steps to build which is shown in the link .
image
But, I got fail in the test stage when building the jar, which is shown as follows:


T E S T S

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (scalaTest) @ spark-tensorflow-connector_2.12 ---
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-sink-api/1.0-alpha-10/doxia-sink-api-1.0-alpha-10.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-sink-api/1.0-alpha-10/doxia-sink-api-1.0-alpha-10.pom (1.3 kB at 3.1 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia/1.0-alpha-10/doxia-1.0-alpha-10.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia/1.0-alpha-10/doxia-1.0-alpha-10.pom (9.2 kB at 5.1 kB/s)
/bin/sh: 1: java: not found
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:14 h
[INFO] Finished at: 2021-01-06T01:04:30+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (scalaTest) on project spark-tensorflow-connector_2.12: There are test failures -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Hey @Echo9573, I think your error is:

/bin/sh: 1: java: not found

judging by the output. However you can try running Maven with -e and -X to get more info. It seems like either you don't have Java installed or it's not on your PATH.

Hi @dgoldenberg-audiomack, thanks for your remind! I have added the JAVA_HOME to PATH. But, after that, another error appears, as the following shows:

21/01/06 11:52:46 INFO ShutdownHookManager: Shutdown hook called
21/01/06 11:52:46 INFO ShutdownHookManager: Deleting directory /tmp/spark-cc13aa16-ab22-4e48-ac89-8bce42492280
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:07 min
[INFO] Finished at: 2021-01-06T11:52:46+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (scalaTest) on project spark-tensorflow-connector_2.12: There are test failures -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

It says there are test failures. Any more info before or after this snippet? You can add -e and -X switches to your maven command to get more info, too.

Worst comes to worse you could disable tests by adding -DskipTests but I would not recommend it. Tests should pass..