GCS connectors 2.1.8 and 2.2.7 are not allowing user authentication
shnapz opened this issue · 3 comments
Currently both 2.1.X and 2.2.X GCS connectors are not allowing user accounts to access GCS:
Issue with 2.1.X
dependency: "com.google.cloud.bigdataoss:gcs-connector:hadoop3-2.1.8"
when accessing a resource in GCS a browser is opened with:
The version of the app you're using doesn't include the latest security features to keep you protected. ...
Apparently this is due to Google's deprecation of OAuth OOB flow:
Issue with 2.2.X
dependency: "com.google.cloud.bigdataoss:gcs-connector:hadoop3-2.2.7"
As of now branch-2.2.x does not have fs.gs.auth.type and fs.gs.auth.type=USER_CREDENTIALS implemented:
https://github.com/GoogleCloudDataproc/hadoop-connectors/tree/branch-2.2.x
2.2.7 supports only Service Account.
This is a blocker for spotify/gcs-tools functionality, new users are not able to access GCS:
Dependent issue from spotify/gcs-tools repo
Apparently the functionality to authenticate user accounts is being implemented in master branch. Do you have any estimation?
Opened in a new issue in "Partner Issue Tracker":
https://partnerissuetracker.corp.google.com/issues/252999627
User credentials authentication will be supported in the upcoming GCS connector 3.0.0 release in Q1 2023: https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/master/gcs/CONFIGURATION.md#user-credentials