/Lionstudy

Study tuning lion optimizer's hyperparameters on LLM fine-tuning tasks under fixed budget.

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

Lionstudy

Study tuning lion optimizer's hyperparameters on LLM fine-tuning tasks under fixed budget.