Audiovisualization of real-time neuroimaging data.
Advancements in brain imaging techniques have significantly expanded the size and complexity of real-time neuroimaging and behavioral data. However, identifying patterns, trends and synchronies within these datasets presents a significant computational challenge. Here, we demonstrate an approach tha...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0297435 |
| _version_ | 1797295148676153344 |
|---|---|
| author | David N Thibodeaux Mohammed A Shaik Sharon H Kim Venkatakaushik Voleti Hanzhi T Zhao Sam E Benezra Chinwendu J Nwokeabia Elizabeth M C Hillman |
| author_facet | David N Thibodeaux Mohammed A Shaik Sharon H Kim Venkatakaushik Voleti Hanzhi T Zhao Sam E Benezra Chinwendu J Nwokeabia Elizabeth M C Hillman |
| author_sort | David N Thibodeaux |
| collection | DOAJ |
| description | Advancements in brain imaging techniques have significantly expanded the size and complexity of real-time neuroimaging and behavioral data. However, identifying patterns, trends and synchronies within these datasets presents a significant computational challenge. Here, we demonstrate an approach that can translate time-varying neuroimaging data into unique audiovisualizations consisting of audible representations of dynamic data merged with simplified, color-coded movies of spatial components and behavioral recordings. Multiple variables can be encoded as different musical instruments, letting the observer differentiate and track multiple dynamic parameters in parallel. This representation enables intuitive assimilation of these datasets for behavioral correlates and spatiotemporal features such as patterns, rhythms and motifs that could be difficult to detect through conventional data interrogation methods. These audiovisual representations provide a novel perception of the organization and patterns of real-time activity in the brain, and offer an intuitive and compelling method for complex data visualization for a wider range of applications. |
| first_indexed | 2024-03-07T21:42:33Z |
| format | Article |
| id | doaj.art-719fec1d81764b4e8d90487c4c2e7f31 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-03-07T21:42:33Z |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-719fec1d81764b4e8d90487c4c2e7f312024-02-26T05:31:57ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-01192e029743510.1371/journal.pone.0297435Audiovisualization of real-time neuroimaging data.David N ThibodeauxMohammed A ShaikSharon H KimVenkatakaushik VoletiHanzhi T ZhaoSam E BenezraChinwendu J NwokeabiaElizabeth M C HillmanAdvancements in brain imaging techniques have significantly expanded the size and complexity of real-time neuroimaging and behavioral data. However, identifying patterns, trends and synchronies within these datasets presents a significant computational challenge. Here, we demonstrate an approach that can translate time-varying neuroimaging data into unique audiovisualizations consisting of audible representations of dynamic data merged with simplified, color-coded movies of spatial components and behavioral recordings. Multiple variables can be encoded as different musical instruments, letting the observer differentiate and track multiple dynamic parameters in parallel. This representation enables intuitive assimilation of these datasets for behavioral correlates and spatiotemporal features such as patterns, rhythms and motifs that could be difficult to detect through conventional data interrogation methods. These audiovisual representations provide a novel perception of the organization and patterns of real-time activity in the brain, and offer an intuitive and compelling method for complex data visualization for a wider range of applications.https://doi.org/10.1371/journal.pone.0297435 |
| spellingShingle | David N Thibodeaux Mohammed A Shaik Sharon H Kim Venkatakaushik Voleti Hanzhi T Zhao Sam E Benezra Chinwendu J Nwokeabia Elizabeth M C Hillman Audiovisualization of real-time neuroimaging data. PLoS ONE |
| title | Audiovisualization of real-time neuroimaging data. |
| title_full | Audiovisualization of real-time neuroimaging data. |
| title_fullStr | Audiovisualization of real-time neuroimaging data. |
| title_full_unstemmed | Audiovisualization of real-time neuroimaging data. |
| title_short | Audiovisualization of real-time neuroimaging data. |
| title_sort | audiovisualization of real time neuroimaging data |
| url | https://doi.org/10.1371/journal.pone.0297435 |
| work_keys_str_mv | AT davidnthibodeaux audiovisualizationofrealtimeneuroimagingdata AT mohammedashaik audiovisualizationofrealtimeneuroimagingdata AT sharonhkim audiovisualizationofrealtimeneuroimagingdata AT venkatakaushikvoleti audiovisualizationofrealtimeneuroimagingdata AT hanzhitzhao audiovisualizationofrealtimeneuroimagingdata AT samebenezra audiovisualizationofrealtimeneuroimagingdata AT chinwendujnwokeabia audiovisualizationofrealtimeneuroimagingdata AT elizabethmchillman audiovisualizationofrealtimeneuroimagingdata |