Feature learning in deep classifiers through Intermediate Neural Collapse

In this paper, we conduct an empirical study of the feature learning process in deep classifiers. Recent research has identified a training phenomenon called Neural Collapse (NC), in which the top-layer feature embeddings of samples from the same class tend to concentrate around their means, and the...

Full description

Bibliographic Details
Main Authors: Rangamani, Akshay, Lindegaard, Marius, Galanti, Tomer, Poggio, Tomaso
Format: Article
Published: Center for Brains, Minds and Machines (CBMM) 2023
Online Access:https://hdl.handle.net/1721.1/148239

Similar Items