Characterizing the sparseness of neural codes.

It is often suggested that efficient neural codes for natural visual information should be 'sparse'. However, the term 'sparse' has been used in two different ways--firstly to describe codes in which few neurons are active at any time ('population sparseness'), and seco...

Full description

Bibliographic Details
Main Authors: Willmore, B, Tolhurst, D
Format: Journal article
Language:English
Published: 2001
_version_ 1797061281767751680
author Willmore, B
Tolhurst, D
author_facet Willmore, B
Tolhurst, D
author_sort Willmore, B
collection OXFORD
description It is often suggested that efficient neural codes for natural visual information should be 'sparse'. However, the term 'sparse' has been used in two different ways--firstly to describe codes in which few neurons are active at any time ('population sparseness'), and secondly to describe codes in which each neuron's lifetime response distribution has high kurtosis ('lifetime sparseness'). Although these ideas are related, they are not identical, and the most common measure of lifetime sparseness--the kurtosis of the lifetime response distributions of the neurons--provides no information about population sparseness. We have measured the population sparseness and lifetime kurtosis of several biologically inspired coding schemes. We used three measures of population sparseness (population kurtosis, Treves-Rolls sparseness and 'activity sparseness'), and found them to be in close agreement with one another. However, we also measured the lifetime kurtosis of the cells in each code. We found that lifetime kurtosis is uncorrelated with population sparseness for the codes we used. Lifetime kurtosis is not, therefore, a useful measure of the population sparseness of a code. Moreover, the Gabor-like codes, which are often assumed to have high population sparseness (since they have high lifetime kurtosis), actually turned out to have rather low population sparseness. Surprisingly, principal components filters produced the codes with the highest population sparseness.
first_indexed 2024-03-06T20:28:51Z
format Journal article
id oxford-uuid:305d8eb9-0e12-4971-a3b8-879ab32e226d
institution University of Oxford
language English
last_indexed 2024-03-06T20:28:51Z
publishDate 2001
record_format dspace
spelling oxford-uuid:305d8eb9-0e12-4971-a3b8-879ab32e226d2022-03-26T13:00:55ZCharacterizing the sparseness of neural codes.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:305d8eb9-0e12-4971-a3b8-879ab32e226dEnglishSymplectic Elements at Oxford2001Willmore, BTolhurst, DIt is often suggested that efficient neural codes for natural visual information should be 'sparse'. However, the term 'sparse' has been used in two different ways--firstly to describe codes in which few neurons are active at any time ('population sparseness'), and secondly to describe codes in which each neuron's lifetime response distribution has high kurtosis ('lifetime sparseness'). Although these ideas are related, they are not identical, and the most common measure of lifetime sparseness--the kurtosis of the lifetime response distributions of the neurons--provides no information about population sparseness. We have measured the population sparseness and lifetime kurtosis of several biologically inspired coding schemes. We used three measures of population sparseness (population kurtosis, Treves-Rolls sparseness and 'activity sparseness'), and found them to be in close agreement with one another. However, we also measured the lifetime kurtosis of the cells in each code. We found that lifetime kurtosis is uncorrelated with population sparseness for the codes we used. Lifetime kurtosis is not, therefore, a useful measure of the population sparseness of a code. Moreover, the Gabor-like codes, which are often assumed to have high population sparseness (since they have high lifetime kurtosis), actually turned out to have rather low population sparseness. Surprisingly, principal components filters produced the codes with the highest population sparseness.
spellingShingle Willmore, B
Tolhurst, D
Characterizing the sparseness of neural codes.
title Characterizing the sparseness of neural codes.
title_full Characterizing the sparseness of neural codes.
title_fullStr Characterizing the sparseness of neural codes.
title_full_unstemmed Characterizing the sparseness of neural codes.
title_short Characterizing the sparseness of neural codes.
title_sort characterizing the sparseness of neural codes
work_keys_str_mv AT willmoreb characterizingthesparsenessofneuralcodes
AT tolhurstd characterizingthesparsenessofneuralcodes