google-research/text-to-text-transfer-transformer

All attempts to get a Google authentication bearer token failed, returning an empty token.

hwyFighting opened this issue · 2 comments

  • Replicate the code training process on DCU and encounter errors:
...

2023-04-11 11:03:35.267744: W tensorflow/core/platform/cloud/google_auth_provider.cc:184] All attempts to get a Google authentication bearer token failed, returning an empty token. Retrieving token from files failed with "NOT_FOUND: Could not locate the credentials file.". Retrieving token from GCE failed with "ABORTED: All 10 retry attempts failed. The last failure: Error executing an HTTP request: libcurl code 7 meaning 'Couldn't connect to server', error details: Failed to connect to 127.0.0.1 port 65001 after 0 ms: Unknown error 111".

...

return _pywrap_file_io.Stat(compat.path_to_str(path))
tensorflow.python.framework.errors_impl.AbortedError: All 10 retry attempts failed. The last failure: Error executing an HTTP request: libcurl code 7 meaning 'Couldn't connect to server', error details: Failed to connect to 127.0.0.1 port 65001 after 0 ms: Unknown error 111
	 when reading metadata of gs://t5-data/vocabs/cc_all.32000/sentencepiece.model
  In call to configurable 'run' (<function run at 0x2b1711e429d0>)

Is it a GCS related issue? How do I address this bug? plz

Hi! I am facing the same issue. Have you been able to solve it?

Hi! I am facing the same issue. Have you been able to solve it?

Maybe you can try export CURL_CA_BUNDLE=/etc/ssl/certs/ca-bundle.crt, or this may be a network issue