s3_to_databricks load file example DAG run fails
pankajkoti opened this issue · 1 comments
pankajkoti commented
Previously, it was an intermittent issue. But now it looks like we are seeing this error repeatedly without a single success.
The issue comes on Databricks when it is not able to configure the AWS credentials correctly for accessing S3.
Previously, we tried to create a new Databricks cluster with updating cluster version which ran fine for a while,
but looks like it is not helping us.
pankajkoti commented
closing this. duplicate of #1968