/committe-learning

Python package for simulating the dynamics of committee machines

Primary LanguagePython

committe-learning

This is a Python package for studyding low-dimnesional sufficient statistics of two-layer neural network.

This is a work in progress and unfortunately there is no documentation, but feel free to contact me with any questions.

Paper using this

  • Luca Arnaboldi, Florent Krzakala, Bruno Loureiro, Ludovic Stephan Escaping mediocrity: how two-layer networks learn hard single-index models with SGD, 2023 https://arxiv.org/abs/2305.18502.
  • Luca Arnaboldi, Ludovic Stephan, Florent Krzakala, Bruno Loureiro From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks, 2023 https://arxiv.org/abs/2305.18502.