For interpolating kernel machines, the minimum norm ERM solution is the most stable
We study the average CVloo stability of kernel ridge-less regression and derive corresponding risk bounds. We show that the interpolating solution with minimum norm has the best CVloo stability, which in turn is controlled by the condition number of the empirical kernel matrix. The latter can be cha...
Main Authors: | Rangamani, Akshay, Rosasco, Lorenzo, Poggio, Tomaso |
---|---|
Format: | Technical Report |
Published: |
Center for Brains, Minds and Machines (CBMM)
2020
|
Online Access: | https://hdl.handle.net/1721.1/125927 |
Similar Items
-
Deep Convolutional Networks are Hierarchical Kernel Machines
by: Anselmi, Fabio, et al.
Published: (2015) -
The Janus effects of SGD vs GD: high noise and low rank
by: Xu, Mengjia, et al.
Published: (2023) -
Learning and Invariance in a Family of Hierarchical Kernels
by: Wibisono, Andre, et al.
Published: (2010) -
On Generalization Bounds for Neural Networks with Low Rank Layers
by: Pinto, Andrea, et al.
Published: (2024) -
Feature learning in deep classifiers through Intermediate Neural Collapse
by: Rangamani, Akshay, et al.
Published: (2023)