On the Complexity of Neural Computation in Superposition

Recent advances in the understanding of neural networks suggest that superposition, the ability of a single neuron to represent multiple features simultaneously, is a key mechanism underlying the computational efficiency of large-scale networks. This paper explores the theoretical foundations of com...

Full description

Bibliographic Details
Main Authors: Adler, Micah, Shavit, Nir
Format: Article
Language:en_US
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/1721.1/157073

Similar Items