Pinned Repositories
Adahessian
TensorFlow implementation for "ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning"
Adan
TensorFlow implementation for "Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models"
Adopt
TensorFlow implementation for "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
models
Neural network models built with TensorFlow.
Note
Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch
Note_rl
Reinforcement learning library for Keras and PyTorch.
optimizers
This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Deep learning
parallel_finder_pytorch
A lightweight utility for training multiple Pytorch models in parallel.
Pool
reinforcement learning, deep reinforcement learning, RL
SOAP
TensorFlow implementation for "SOAP: Improving and Stabilizing Shampoo using Adam"
NoteDance's Repositories
NoteDance/Note
Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch
NoteDance/optimizers
This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Deep learning
NoteDance/models
Neural network models built with TensorFlow.
NoteDance/Pool
reinforcement learning, deep reinforcement learning, RL
NoteDance/Note_rl
Reinforcement learning library for Keras and PyTorch.
NoteDance/SOAP
TensorFlow implementation for "SOAP: Improving and Stabilizing Shampoo using Adam"
NoteDance/Adahessian
TensorFlow implementation for "ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning"
NoteDance/Adan
TensorFlow implementation for "Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models"
NoteDance/Adopt
TensorFlow implementation for "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
NoteDance/dadaptation
D-Adaptation for SGD, Adam, Adan, Lion and AdaGrad
NoteDance/GaLore
TensorFlow reimplementation for "GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection"
NoteDance/Kron
TensorFlow implementation for "PSGD with the Kronecker product pre-conditioner"
NoteDance/LOMO
TensorFlow implementation for "Full Parameter Fine-tuning for Large Language Models with Limited Resources"
NoteDance/Note-documentation
Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch
NoteDance/parallel_finder
A lightweight utility for training multiple Keras models in parallel and comparing their final loss and last-epoch time.
NoteDance/parallel_finder_pytorch
A lightweight utility for training multiple Pytorch models in parallel.
NoteDance/PCGrad
TensorFlow implementation for "Gradient Surgery for Multi-Task Learning"
NoteDance/Pytorch-PCGrad
PyTorch Implementation of "Gradient Surgery for Multi-Task Learning" using multiprocessing
NoteDance/Ranger
TensorFlow implementation for Ranger, Ranger2020, RangerQH, RangerVA
NoteDance/Ranger21
TensorFlow implementation for Ranger21
NoteDance/Ranger25
TensorFlow implementation for Ranger25
NoteDance/SAM
TensorFlow reimplementation for "Sharpness-Aware Minimization for Efficiently Improving Generalization"