loss-landscape

There are 11 repositories under loss-landscape topic.

  • xxxnell/how-do-vits-work

    (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

    Language:Python79674177

  • logancyang/loss-landscape-anim

    Create animations for the optimization trajectory of neural nets

    Language:Python1243322

  • ayulockin/LossLandscape

    Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi Hu, and Balaji Lakshminarayanan.

    Language:Jupyter Notebook60404

  • sayakpaul/Sharpness-Aware-Minimization-TensorFlow

    Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.

    Language:Jupyter Notebook603812

  • shamsbasir/investigating_mitigating_failure_modes_in_pinns

    This repository contains the code and models for our paper "Investigating and Mitigating Failure Modes in Physics-informed Neural Networks(PINNs)"

    Language:Jupyter Notebook15605

  • VITA-Group/LTH-Pass

    [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangyang Wang

    Language:Python10701

  • gg-dema/Git_merge

    analytic solution to the git-merge algorithm, derived from "Git Re-Basin: Merging Models modulo Permutation Symmetries"

    Language:Jupyter Notebook4100

  • HJHGJGHHG/Optimizer-papers

    Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。

    Language:Python4200

  • sungyoon-lee/LossLandscapeMatters

    [NeurIPS 2021] Towards Better Understanding of Training Certifiably Robust Models against Adversarial Examples | ⛰️⚠️

    Language:Python4212

  • mortfer/keras-gsam

    Surrogate Gap Guided Sharpness-Aware Minimization (GSAM) implementation for keras/tensorflow 2

    Language:Python2100

  • pxl-th/Yama.jl

    Visualize loss landscape

    Language:Julia1301