/schedule_free_optx

Schedule free optimiser implemented in JAX using Optimistix

Primary LanguagePythonApache License 2.0Apache-2.0

Schedule-free optimisers in JAX using Optimistix

An implementation of the new schedule-free SGD and AdamW optimisers in JAX using Optimistix.

Screenshot 2024-05-29 at 10 24 28 PM

Installation

To install, simply download this repo and run

pip install -e .

in your Python environment. Then use from schedule_free_optx import ScheduleFreeSGD, ScheduleFreeAdamW and use them as any other Optimistix optimiser!