kfac

There are 9 repositories under kfac topic.

ikostrikov/pytorch-a2c-ppo-acktr-gail
PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).
Language:Python3.5k 68 229832
tfjgeorge/nngeometry
{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
Language:Python195 6 3120
alecwangcq/KFAC-Pytorch
Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
Language:Python120 4 232
gpauloski/kfac-pytorch
Distributed K-FAC Preconditioner for PyTorch
Language:Python74 4 4224
MaximeRobeyns/bayesian_lora
Bayesian Low-Rank Adaptation for Large Language Models
Language:Python16 4 10
f-dangel/einconv
Convolutions and more as einsum for PyTorch
Language:Python12 3 20
yorkerlin/StructuredNGD-DL
Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning
Language:Python4 2 01
alirezakazemipour/ACKTR-PyTorch
Language:Python1 1 01
rafonsor/unRL
unRL (AKA "unreal") is a set of libraries providing Reinforcement Learning algorithms implemented in PyTorch or Jax.
Language:Python00