[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy
-
Updated
Nov 11, 2023 - Python
[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy
This project outlines 4 experiments to explore the effects of several settings on the bias-variance tradeoff curve
An intuitive derivation of smoothing splines from variational calculus, demonstrating their relationship to reproducing kernel Hilbert spaces (RKHS) and regularized neural networks.
A reproduction of the results from Ribeiro & Schön (2023) on adversarial attacks in overparameterized linear regression. Developed as an undergraduate research project funded by the PICME-CNPq Scientific Initiation program.
To associate your repository with the overparameterization topic, visit your repo's landing page and select "manage topics."