loss-landscape

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

Create animations for the optimization trajectory of neural nets

Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi Hu, and Balaji Lakshminarayanan.

Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.

Landscaper is a comprehensive Python framework designed for exploring the loss landscapes of deep learning models.

This repository contains the code and models for our paper "Investigating and Mitigating Failure Modes in Physics-informed Neural Networks(PINNs)"

[TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangyang Wang

Lookahead optimizer wrapper stabilizing optimization trajectories by interpolating fast and slow weights every k steps.

Lookahead optimizer wrapper stabilizing optimization trajectories by interpolating fast and slow weights every k steps.

[ICML 2026] Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization

Source code for NeurIPS-2024 paper "Where Do Large Learning Rates Lead Us"

analytic solution to the git-merge algorithm, derived from "Git Re-Basin: Merging Models modulo Permutation Symmetries"

[NeurIPS 2021] Towards Better Understanding of Training Certifiably Robust Models against Adversarial Examples | ⛰️⚠️

[Int. J. Comput. Vis. 2024] Revisiting Deep Ensemble for Out-of-Distribution Detection: A Loss Landscape Perspective

Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。

Surrogate Gap Guided Sharpness-Aware Minimization (GSAM) implementation for keras/tensorflow 2

code and difference of resolution for visualizing the loss landscape of a GAN and understanding what a loss landscape is

Visualize loss landscape

просто мой блоггер для обучения моделек, можно посмотреть веса модели и построить ландшафт

ATLAS: Adaptive Taylor Landscape Analysis System — Budget-optimal, certified loss landscape diagnostics for Transformers on Google Cloud TPUs