Formation of Representations in Neural Networks
Understanding neural representations will help open the black box of neural networks and advance our scientific understanding of modern AI systems. However, how complex, structured, and transferable representations emerge in modern neural networks has remained a mystery. Building on previous results...
Main Authors: | Ziyin, Liu, Chuang, Isaac, Galanti, Tomer, Poggio, Tomaso |
---|---|
Format: | Article |
Published: |
Center for Brains, Minds and Machines (CBMM)
2024
|
Online Access: | https://hdl.handle.net/1721.1/157132 |
Similar Items
-
On the Power of Decision Trees in Auto-Regressive Language Modeling
by: Gan, Yulu, et al.
Published: (2024) -
On Generalization Bounds for Neural Networks with Low Rank Layers
by: Pinto, Andrea, et al.
Published: (2024) -
Self-Assembly of a Biologically Plausible Learning Circuit
by: Liao, Qianli, et al.
Published: (2024) -
A Homogeneous Transformer Architecture
by: Gan, Yulu, et al.
Published: (2023) -
The Relationship between Linguistic Representations in Biological
and Artificial Neural Networks
by: Kauf, Carina
Published: (2024)