aws-samples/spark-on-aws-lambda

Error Running Spark with Hudi Error: fork/exec /lambda-entrypoint.sh: exec format error Runtime.InvalidEntrypoint

soumilshah1995 opened this issue · 1 comments

Here are steps I followed

Step 1

sam deploy  \
    --template-file sam-imagebuilder.yaml  \
    --stack-name spark-on-lambda-image-builder \
    --capabilities CAPABILITY_IAM CAPABILITY_NAMED_IAM  \
    --resolve-s3 --parameter-overrides 'ParameterKey=FRAMEWORK,ParameterValue=HUDI'

before pushing image I edited this variables in docker file


ENV INPUT_PATH="s3a://XX/accommodations.csv"
ENV OUTPUT_PATH="s3a://XXX/silver/"
ENV AWS_ACCESS_KEY_ID="XX"
ENV AWS_SECRET_ACCESS_KEY="XXX"
ENV AWS_REGION="us-east-1"
ENV AWS_SESSION_TOKEN=""
ENV CUSTOM_SQL=""

I have created REPO on ECR and then pushed the image on ECR with commands given on readme file

when running lambda function I keep getting error "errorType": "Runtime.InvalidEntrypoint",

Screenshot 2023-11-01 at 8 08 53 PM

Screenshot 2023-11-01 at 8 09 17 PM

Seems like an error due the Lambda entry point in Docker file. Could you please try a local execution https://github.com/aws-samples/spark-on-aws-lambda/wiki/Local-testing?