NaHenn

NaHenn's Stars

• jettify/pytorch-optimizer

  torch-optimizer -- collection of optimizers for Pytorch

  Language:Python3k3364297

• goodfeli/dlbook_notation

  LaTeX files for the Deep Learning book notation

  Language:TeX1.7k703351

• hiroyuki-kasai/SGDLibrary

  MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20

  Language:MATLAB21519985

• google/spectral-density

  Hessian spectral density estimation in TF and Jax

  Language:Python1126228

• lixilinx/psgd_torch

  Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner and more)

  Language:Python108738

• LeoYu/neural-tangent-kernel-UCI

  Testing Nerual Tangent Kernel (NTK) on small UCI datasets

  Language:Python837024

• BallisticLA/RandLAPACK

  A high-performance C++ library for randomized numerical linear algebra

  Language:C++606256

• BallisticLA/parla

  Python Algorithms for Randomized Linear Algebra

  Language:Python46515

• keskarnitish/minSQN

  Optimization using Stochastic quasi-Newton methods

  Language:Matlab435116

• timlautk/BCD-for-DNNs-PyTorch

  Code for Global Convergence of Block Coordinate Descent in Deep Learning (ICML 2019)

  Language:Jupyter Notebook34309

• OptMLGroup/SQN

  Sampled Quasi-Newton Methods for Deep Learning

  Language:Python21615

• gowerrobert/StochOpt.jl

  A suite of stochastic optimization methods for solving the empirical risk minimization problem.

  Language:Julia16319

• dalab/subsampled_cubic_regularization

  Source code for "Sub-sampled Cubic Regularization for Non-convex Optimization", JM Kohler, A Lucchi, https://arxiv.org/abs/1705.05933

  Language:Jupyter Notebook155010

• BallisticLA/marla

  Matlab Algorithms for Randomized Linear Algebra

  Language:MATLAB14303

• git-xp/Non-Convex-Newton

  Language:Matlab14306

• leventsagun/hessian-for-basicDL

  can calculate the Hessian matrix and/or its spectrum for simple neural nets

  Language:Python10403

• vojha-code/Multi-Output-Neural-Tree

  We propose an algorithm and a new method to tackle the classification problems. We propose a multi-output neural tree (MONT) algorithm, which is an evolutionary learning algorithm trained by the non-dominated sorting genetic algorithm (NSGA)-III.

  Language:Python8200

• gowerrobert/StochOptMatlab

  A suite of stochastic optimization methods, including the stochastic block BFGS method, for minimizing an average of functions (empirical risk minimization)

  Language:MATLAB7306

• nathansiae/Stochastic-Average-Newton

  Language:Python7205

• zouzias/REK-C

  Randomized Extended Kaczmarz (C)

  Language:C530

• amkatrutsa/preckacz

  Implementation of the preconditioned Kaczmarz method https://arxiv.org/abs/1903.01806

  Language:Python4503

• sgoldt/nn2pp

  Utilities to train two-layer neural networks

  Language:C++4214

• hfassold/omni_optimizer

  A wrapper for several SoA adaptive-gradient optimizer, including my novel 'AdaFamily' algorithm

  Language:Python3100

• hfassold/nlp_finetuning_adafamily

  Demonstrates finetuning of a NLP model with novel 'AdaFamily' optimizer and 'mini-batch trimming'

  Language:Python2100

• LIONS-EPFL/Subquadratic-Overparameterization

  Code for Subquadratic Overparameterization for Shallow Neural Networks NeurIPS 2021.

  Language:Jupyter Notebook2300

• OxfordML/MUBs_TraceEstimators

  A python implementation of the MUBs Stochastic Trace Estimator.

  Language:C++2230

• stats285/Alpha

  Alpha pattern for XYZW based Science.

  Language:Python2001

• vojha-code/Neural-Tree-Software

  Software: The Adaptive Approximation Software Toolbox (Neural Tree Algorithm) is a function approximation and feature selection tool that uses genetic programming for constructing tree like structure to construct an adaptive multi-layer perceptron. This standalone software toolbox solves prediction problems. The developed algorithm performs multiobjective in which it adaptively creates simple models with high generalization ability.

  Language:Java2100

• kiranchhatre/BEAM-Bayes-Opt

  [LOD 2022] Parallel Bayesian Optimization of Multi-agent Systems

  Language:Python10

• yutongLi1997/Similarity-Fusion-GRMF

  Language:Jupyter Notebook1202