allenai/wimbd

error after geting cloud_id and api_key

Closed this issue · 3 comments

I have obtained a cloud_id and an api_key. However, when attempting to execute the following code, I encountered errors. Do you know how to fix it?

`from wimbd.es import es_init, get_indices

es = es_init()
print(get_indices(return_mapping=True))`

Error:
Traceback (most recent call last):
File "/home/taof/wimbd/search_test.py", line 4, in
print(get_indices(return_mapping=True))
File "/home/taof/wimbd/wimbd/es/init.py", line 56, in get_indices
indices = es.cat.indices(format="json")
File "/home/taof/wimbd/env/lib/python3.9/site-packages/elasticsearch/_sync/client/utils.py", line 414, in wrapped
return api(*args, **kwargs)
File "/home/taof/wimbd/env/lib/python3.9/site-packages/elasticsearch/_sync/client/cat.py", line 701, in indices
return self.perform_request( # type: ignore[return-value]
File "/home/taof/wimbd/env/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 389, in perform_request
return self._client.perform_request(
File "/home/taof/wimbd/env/lib/python3.9/site-packages/elasticsearch/_sync/client/_base.py", line 320, in perform_request
raise HTTP_EXCEPTIONS.get(meta.status, ApiError)(
elasticsearch.AuthorizationException: AuthorizationException(403, 'security_exception', 'action [cluster:monitor/state] is unauthorized for API key id [uDeV9IsBTffG4Z11VjJJ] of user [3344647685], this action is granted by the cluster privileges [read_ccr,transport_client,manage_ccr,monitor,manage,all]')

Hi William,

Since we provide restricted keys this shouldn't work.

We have three config files which gives access to:

  • re_pile, openwebtext, c4, and re_oscar (The Pile, OpenWebText, C4 and Oscar)
  • redpajama-split (RedPajamav1)
  • docs_v1.5_2023-11-02 (Dolma)

If I've given you access to one of those, and you need access to another, please send me an email. If you need access to Dolma, there's another form you have to fill - link.

Hi,

I have submitted a form for accessing Dolma. It would be great if you could provide keys.

Done.