Music in our ears: the biological bases of musical timbre perception.

Timbre is the attribute of sound that allows humans and other animals to distinguish among different sound sources. Studies based on psychophysical judgments of musical timbre, ecological analyses of sound's physical characteristics as well as machine learning approaches have all suggested that...

Full description

Bibliographic Details
Main Authors: Kailash Patil, Daniel Pressnitzer, Shihab Shamma, Mounya Elhilali
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2012-01-01
Series:PLoS Computational Biology
Online Access:http://europepmc.org/articles/PMC3486808?pdf=render
_version_ 1818585807399682048
author Kailash Patil
Daniel Pressnitzer
Shihab Shamma
Mounya Elhilali
author_facet Kailash Patil
Daniel Pressnitzer
Shihab Shamma
Mounya Elhilali
author_sort Kailash Patil
collection DOAJ
description Timbre is the attribute of sound that allows humans and other animals to distinguish among different sound sources. Studies based on psychophysical judgments of musical timbre, ecological analyses of sound's physical characteristics as well as machine learning approaches have all suggested that timbre is a multifaceted attribute that invokes both spectral and temporal sound features. Here, we explored the neural underpinnings of musical timbre. We used a neuro-computational framework based on spectro-temporal receptive fields, recorded from over a thousand neurons in the mammalian primary auditory cortex as well as from simulated cortical neurons, augmented with a nonlinear classifier. The model was able to perform robust instrument classification irrespective of pitch and playing style, with an accuracy of 98.7%. Using the same front end, the model was also able to reproduce perceptual distance judgments between timbres as perceived by human listeners. The study demonstrates that joint spectro-temporal features, such as those observed in the mammalian primary auditory cortex, are critical to provide the rich-enough representation necessary to account for perceptual judgments of timbre by human listeners, as well as recognition of musical instruments.
first_indexed 2024-12-16T08:42:56Z
format Article
id doaj.art-4724b34ae29b48fe86b54021a319275d
institution Directory Open Access Journal
issn 1553-734X
1553-7358
language English
last_indexed 2024-12-16T08:42:56Z
publishDate 2012-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS Computational Biology
spelling doaj.art-4724b34ae29b48fe86b54021a319275d2022-12-21T22:37:40ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582012-01-01811e100275910.1371/journal.pcbi.1002759Music in our ears: the biological bases of musical timbre perception.Kailash PatilDaniel PressnitzerShihab ShammaMounya ElhilaliTimbre is the attribute of sound that allows humans and other animals to distinguish among different sound sources. Studies based on psychophysical judgments of musical timbre, ecological analyses of sound's physical characteristics as well as machine learning approaches have all suggested that timbre is a multifaceted attribute that invokes both spectral and temporal sound features. Here, we explored the neural underpinnings of musical timbre. We used a neuro-computational framework based on spectro-temporal receptive fields, recorded from over a thousand neurons in the mammalian primary auditory cortex as well as from simulated cortical neurons, augmented with a nonlinear classifier. The model was able to perform robust instrument classification irrespective of pitch and playing style, with an accuracy of 98.7%. Using the same front end, the model was also able to reproduce perceptual distance judgments between timbres as perceived by human listeners. The study demonstrates that joint spectro-temporal features, such as those observed in the mammalian primary auditory cortex, are critical to provide the rich-enough representation necessary to account for perceptual judgments of timbre by human listeners, as well as recognition of musical instruments.http://europepmc.org/articles/PMC3486808?pdf=render
spellingShingle Kailash Patil
Daniel Pressnitzer
Shihab Shamma
Mounya Elhilali
Music in our ears: the biological bases of musical timbre perception.
PLoS Computational Biology
title Music in our ears: the biological bases of musical timbre perception.
title_full Music in our ears: the biological bases of musical timbre perception.
title_fullStr Music in our ears: the biological bases of musical timbre perception.
title_full_unstemmed Music in our ears: the biological bases of musical timbre perception.
title_short Music in our ears: the biological bases of musical timbre perception.
title_sort music in our ears the biological bases of musical timbre perception
url http://europepmc.org/articles/PMC3486808?pdf=render
work_keys_str_mv AT kailashpatil musicinourearsthebiologicalbasesofmusicaltimbreperception
AT danielpressnitzer musicinourearsthebiologicalbasesofmusicaltimbreperception
AT shihabshamma musicinourearsthebiologicalbasesofmusicaltimbreperception
AT mounyaelhilali musicinourearsthebiologicalbasesofmusicaltimbreperception