inikishev

inikishev's Stars

• pytorch/pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  Language:Python85.8k1.8k48k23.1k

• numpy/numpy

  The fundamental package for scientific computing with Python.

  Language:Python28.5k60013k10.3k

• scipy/scipy

  SciPy library main repository

  Language:Python13.3k35010.6k5.2k

• optuna/optuna

  A hyperparameter optimization framework

  Language:Python11.2k1181.7k1.1k

• facebookresearch/nevergrad

  A Python toolbox for performing gradient-free optimization

  Language:Python4k58267356

• CPJKU/madmom

  Python audio and music signal processing library

  Language:Python1.4k44267206

• facebookresearch/optimizers

  For optimization algorithm research and development.

  Language:Python483161935

• brain-research/guided-evolutionary-strategies

  Guided Evolutionary Strategies

  Language:Jupyter Notebook26715127

• TorchJD/torchjd

  Library for Jacobian descent with PyTorch. It enables optimization of neural networks with multiple losses (e.g. multi-task learning).

  Language:Python1815432

• lixilinx/psgd_torch

  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditioner and more)

  Language:Python146738

• ClashLuke/HeavyBall

  Efficient optimizers

  Language:Python1419229

• CPJKU/beat_this

  Accurate and general beat tracker

  Language:Python1013517

• tuero/perturbations-differential-pytorch

  Differentiable Optimizers with Perturbations in Pytorch

  Language:Python64306

• PiotrDabkowski/torchpwl

  Piecewise Linear Functions (PWL) implementation in PyTorch

  Language:Python49415

• lessw2020/FAdam_PyTorch

  an implementation of FAdam (Fisher Adam) in PyTorch

  Language:Python37410

• konstmish/opt_methods

  Benchmarking optimization methods on convex problems.

  Language:Jupyter Notebook29223

• TheMody/No-learning-rates-needed-Introducing-SALSA-Stable-Armijo-Line-Search-Adaptation

  SaLSa Optimizer implementation (No learning rates needed)

  Language:Python28131

• UbiquitousLearning/Backpropagation_Free_Training_Survey

  Language:Shell17101

• f-dangel/sirfshampoo

  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)

  Language:Python144101

• MathIsAll/ZO-AdaMU

  This project is a implementation in PyTorch for ZO-AdaMU optimization: Adapting Perturbation with the Momentum and Uncertainty in Zeroth-order Optimization.

  Language:Python8002

• BaoWangMath/DP-LSSGD

  Language:Python6110

• kad99kev/PyBoxCar

  BoxCar2D implementation in Python.

  Language:Python6200

• EliaFantini/ZO-AdaMM-vs-FO-AdaMM-convergence-and-minima-shape-comparison

  Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape

  Language:Jupyter Notebook5000

• Jvictormata/adasub

  Language:Jupyter Notebook5100

• Ivonne320/ZO-SGD_vs_FO-SGD

  Language:Jupyter Notebook31

• 0x4249/NNAIF

  Python code for running the numerical experiments in the paper "Neural Network Accelerated Implicit Filtering: Integrating Neural Network Surrogates With Provably Convergent Derivative Free Optimization Methods" by Brian Irwin, Eldad Haber, Raviv Gal, and Avi Ziv.

  Language:Jupyter Notebook2200

• sukiboo/smoothing_based_optimization

  Implementation of smoothing-based optimization algorithms

  Language:Python2200

• andreakiro/zeroptim

  Zero-order optim in deep learning

  Language:Jupyter Notebook1

• bumsu-kim/CARS_Refactored

  Curvature-Aware Random Search

  Language:Jupyter Notebook1

• CorgiTaco/Feature-Recycler

  Fixes the "Feature order cycle" error that occurs when various mods add placed features in different orders between their biomes.

  Language:Java1101