aws-samples/spark-on-aws-lambda

Issues

• Iceberg error

  #59 opened 2 months ago by reinhardt1kws
  0

• Consistent variable reference across all spark scripts.

  #58 opened 2 months ago by ashishgupta-in
  0

• Hudi Job on Lambda - Directory /var/task/metastore_db cannot be created.

  #54 opened 3 months ago by sha12br
  1

• When using VPC and S3 endpoints in Commercial and Gov cloud

  #56 opened 2 months ago by JohnChe88
  0

• submit jar on lambda failed

  #51 opened 4 months ago by tyyzqmf
  4

• reading csv from s3 throwing this error using (sample-spark-script-csv-to-csv.py) file

  #53 opened 3 months ago by saiteja2420
  0

• Setup for Java env

  #52 opened 4 months ago by rsbCodeZ
  2

• Amazon Linux 2023 version works has dependency issues

  #50 opened 4 months ago by JohnChe88
  1

• Mapping the spark version to the right Iceberg version

  #35 opened 4 months ago by JohnChe88
  0

• Include S3 based Shuffle storage plugin

  #48 opened 5 months ago by gauravtanwar03
  1

• Error Running Spark with Hudi Error: fork/exec /lambda-entrypoint.sh: exec format error Runtime.InvalidEntrypoint

  #45 opened 7 months ago by soumilshah1995
  1

• Task fail without logs

  #39 opened 9 months ago by vinicvaz
  2

• Iceberg Error

  #38 opened a year ago by gowthamprabhus
  1

• Deploy and test Spark on AWS Lambda container on AWS ECS

  #13 opened a year ago by JohnChe88
  3

• java.lang.NoSuchMethodError when executing Iceberg MERGE INTO query in local docker

  #33 opened a year ago by cdelamocepsa
  4

• Spark on AWS Lambda with Glue Catalog Integration

  #30 opened a year ago by guischuwarten
  13

• Integrate Apache Iceberg to spark on AWS Lambda

  #12 opened a year ago by JohnChe88
  1

• Stress the Apache HUDI Branch for the different input file size and identify the threshold

  #6 opened a year ago by JohnChe88
  1

• Add feature to use Apache HUDI for ACID transactions

  #4 opened a year ago by JohnChe88
  1

• Create AWS SAM Cloudformation template to auto deploy the Spark on Lambda

  #8 opened a year ago by JohnChe88
  2

• The AWS Lambda to pick up pyspark script from Amazon S3 location and execute it

  #5 opened a year ago by JohnChe88
  1

• Publish the Docker image on AWS ECR public repository

  #14 opened a year ago by JohnChe88
  1

• Publish SAM Cloud Formation to Application Public repository

  #15 opened a year ago by JohnChe88
  1

• AWS ECS integration

  #16 opened a year ago by JohnChe88
  1

• Pyspark shell is not working inside of the container

  #19 opened a year ago by patrick-muller
  3

• Getting the following error "errorMessage": "An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext",

  #21 opened a year ago by Mridula-Juluri
  3

• Test Near real time streaming from Kinesis using Spark on AWS Lambda

  #22 opened a year ago by JohnChe88
  1

• Integrate Delta Lake to Spark on AWS Lambda

  #7 opened a year ago by JohnChe88
  1

• Spark configuration for local deployment

  #11 opened a year ago by JohnChe88
  1

• Apache HUDI Marker, Glue catalog sync and time line configuration issue

  #10 opened a year ago by JohnChe88
  0

• Require a JAVA path update based on the version of the jdk

  #2 opened a year ago by JohnChe88
  1