Add config for hf token or ask user
Opened this issue · 4 comments
Add a command to set HUGGINGFACE_READ_TOKEN. If a config or an environment variable is missing ask the user similar to what wandb tool is doing.
The config command can be later used to set additional information that live in the payload to make it easier to deploy without a json
maybe what i was describing with hugie configure is more suitable to setting the token @ivyleavedtoadflax. if you agree, i can work on this but we need to think a better command name as configure and config will be confusing
Sounds like a great idea, let's think about how best to distinguish this from the configuration that we set for individual inference endpoints.
We can add an alias for config/configuration if it's confusing. But I think this command should be different to the command that is used for setting local configuration.
Somehow I think that the configuration is tool specific so if we implement both, config or configure should be about this command that sets the token and we would need to rename how we refer to the payload sent to setup the endpoint and same for the command. It could be params.json and a params modify command. It could be that the command can be placed inside endpoint, for example endpoint configure or endpoint params. Let me know your thoughts
We should prioritise this. For example I was just describing to Gina how to use the tool and she has to set a variable every time to use it which is not ideal or user friendly