aws-samples/spark-on-aws-lambda

Require a JAVA path update based on the version of the jdk

JohnChe88 opened this issue · 1 comments

Below are the few things that's need to be updated before running the Docker Image in the AWS Setup Lambda.
-> In Docker Files Update JAVA_HOME with the actual version installed on Docker Image.
Eg: Current JAVA_HOME="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.342.b07-1.amzn2.0.1.x86_64/jre"
Acutal version in My Image JAVA_HOME="/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.352.b08-2.amzn2.0.1.x86_64/jre"
-> Update the version in spark-class as well
Eg:current: exec /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.342.b07-1.amzn2.0.1.x86_64/jre/bin/java -cp /var/lang/lib/python3.8/site-packages/pyspark/conf/:/var/lang/lib/python3.8/site-packages/pyspark/jars/* -Xmx1g "$@"
New: exec /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.352.b08-2.amzn2.0.1.x86_64/jre/bin/java -cp /var/lang/lib/python3.8/site-packages/pyspark/conf/:/var/lang/lib/python3.8/site-packages/pyspark/jars/* -Xmx1g "$@"

The Java version fix and update is complete and merged to the Main branch