/deep-learning-research-lab

A distributed computing infrastructure for simulations, model training & fine-tuning.

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

Deep Learning Research Lab

This library implements a distributed computing infrastructure for simulations, model training & fine-tuning. It allowed the empirical, practical study we conducted while working on our paper Implicit Regularization Towards Rank Minimization in ReLU Networks (Nadav Timor, Gal Vardi, Ohad Shamir, ALT 2023), which solves a principle open question on deep learning.