SHS Spark History Server is the web UI for completed and running Spark applications.
This chart uses AWS K8s IRSA technology to authenticate against AWS, so a proper ServiceAccount needs to be specified in order to have the right permissions accessing application logs S3 bucket.
To install the chart:
helm install --set app.S3logPath=yourBucketName/eventLogFoloderMinimum required variables are:
| Parameter | Required | Description | Example |
|---|---|---|---|
S3logPath |
yes |
S3 bucket and key used as base directory for Spark Application logs | mybucket/logs |
serviceAccount.name |
yes |
Service account used to run the deployment. Needs to have the appropiate IRSA role associated in order to access S3 | sparkSA |