Study tuning lion optimizer's hyperparameters on LLM fine-tuning tasks under fixed budget.
Primary LanguageJupyter NotebookApache License 2.0Apache-2.0