Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
IntroductionIt has proven a hard challenge to stimulate climate action with climate data. While scientists communicate through words, numbers, and diagrams, artists use movement, images, and sound. Sonification, the translation of data into sound, and visualization, offer techniques for representing...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-01-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1020102/full |
| _version_ | 1828054987434885120 |
|---|---|
| author | PerMagnus Lindborg Sara Lenzi Manni Chen |
| author_facet | PerMagnus Lindborg Sara Lenzi Manni Chen |
| author_sort | PerMagnus Lindborg |
| collection | DOAJ |
| description | IntroductionIt has proven a hard challenge to stimulate climate action with climate data. While scientists communicate through words, numbers, and diagrams, artists use movement, images, and sound. Sonification, the translation of data into sound, and visualization, offer techniques for representing climate data with often innovative and exciting results. The concept of sonification was initially defined in terms of engineering, and while this view remains dominant, researchers increasingly make use of knowledge from electroacoustic music (EAM) to make sonifications more convincing.MethodsThe Aesthetic Perspective Space (APS) is a two-dimensional model that bridges utilitarian-oriented sonification and music. We started with a review of 395 sonification projects, from which a corpus of 32 that target climate change was chosen; a subset of 18 also integrate visualization of the data. To clarify relationships with climate data sources, we determined topics and subtopics in a hierarchical classification. Media duration and lexical diversity in descriptions were determined. We developed a protocol to span the APS dimensions, Intentionality and Indexicality, and evaluated its circumplexity.ResultsWe constructed 25 scales to cover a range of qualitative characteristics applicable to sonification and sonification-visualization projects, and through exploratory factor analysis, identified five essential aspects of the project descriptions, labeled Action, Technical, Context, Perspective, and Visualization. Through linear regression modeling, we investigated the prediction of aesthetic perspective from essential aspects, media duration, and lexical diversity. Significant regressions across the corpus were identified for Perspective (ß = 0.41***) and lexical diversity (ß = −0.23*) on Intentionality, and for Perspective (ß = 0.36***) and Duration (logarithmic; ß = −0.25*) on Indexicality.DiscussionWe discuss how these relationships play out in specific projects, also within the corpus subset that integrated data visualization, as well as broader implications of aesthetics on design techniques for multimodal representations aimed at conveying scientific data. Our approach is informed by the ongoing discussion in sound design and auditory perception research communities on the relationship between sonification and EAM. Through its analysis of topics, qualitative characteristics, and aesthetics across a range of projects, our study contributes to the development of empirically founded design techniques, applicable to climate science communication and other fields. |
| first_indexed | 2024-04-10T20:31:27Z |
| format | Article |
| id | doaj.art-1f087ad5e2fd4fafab4cc74aafa1c27f |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-10T20:31:27Z |
| publishDate | 2023-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-1f087ad5e2fd4fafab4cc74aafa1c27f2023-01-25T06:04:06ZengFrontiers Media S.A.Frontiers in Psychology1664-10782023-01-011310.3389/fpsyg.2022.10201021020102Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projectsPerMagnus Lindborg0Sara Lenzi1Manni Chen2SoundLab, School of Creative Media, City University of Hong Kong, Kowloon, Hong Kong SAR, ChinaCritical Alarms Laboratory, Faculty of Industrial Design Engineering, Delft University of Technology, Delft, NetherlandsSoundLab, School of Creative Media, City University of Hong Kong, Kowloon, Hong Kong SAR, ChinaIntroductionIt has proven a hard challenge to stimulate climate action with climate data. While scientists communicate through words, numbers, and diagrams, artists use movement, images, and sound. Sonification, the translation of data into sound, and visualization, offer techniques for representing climate data with often innovative and exciting results. The concept of sonification was initially defined in terms of engineering, and while this view remains dominant, researchers increasingly make use of knowledge from electroacoustic music (EAM) to make sonifications more convincing.MethodsThe Aesthetic Perspective Space (APS) is a two-dimensional model that bridges utilitarian-oriented sonification and music. We started with a review of 395 sonification projects, from which a corpus of 32 that target climate change was chosen; a subset of 18 also integrate visualization of the data. To clarify relationships with climate data sources, we determined topics and subtopics in a hierarchical classification. Media duration and lexical diversity in descriptions were determined. We developed a protocol to span the APS dimensions, Intentionality and Indexicality, and evaluated its circumplexity.ResultsWe constructed 25 scales to cover a range of qualitative characteristics applicable to sonification and sonification-visualization projects, and through exploratory factor analysis, identified five essential aspects of the project descriptions, labeled Action, Technical, Context, Perspective, and Visualization. Through linear regression modeling, we investigated the prediction of aesthetic perspective from essential aspects, media duration, and lexical diversity. Significant regressions across the corpus were identified for Perspective (ß = 0.41***) and lexical diversity (ß = −0.23*) on Intentionality, and for Perspective (ß = 0.36***) and Duration (logarithmic; ß = −0.25*) on Indexicality.DiscussionWe discuss how these relationships play out in specific projects, also within the corpus subset that integrated data visualization, as well as broader implications of aesthetics on design techniques for multimodal representations aimed at conveying scientific data. Our approach is informed by the ongoing discussion in sound design and auditory perception research communities on the relationship between sonification and EAM. Through its analysis of topics, qualitative characteristics, and aesthetics across a range of projects, our study contributes to the development of empirically founded design techniques, applicable to climate science communication and other fields.https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1020102/fullclimate datascience communicationsonificationvisualizationaesthetic perspectivecircumplexity |
| spellingShingle | PerMagnus Lindborg Sara Lenzi Manni Chen Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects Frontiers in Psychology climate data science communication sonification visualization aesthetic perspective circumplexity |
| title | Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects |
| title_full | Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects |
| title_fullStr | Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects |
| title_full_unstemmed | Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects |
| title_short | Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects |
| title_sort | climate data sonification and visualization an analysis of topics aesthetics and characteristics in 32 recent projects |
| topic | climate data science communication sonification visualization aesthetic perspective circumplexity |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1020102/full |
| work_keys_str_mv | AT permagnuslindborg climatedatasonificationandvisualizationananalysisoftopicsaestheticsandcharacteristicsin32recentprojects AT saralenzi climatedatasonificationandvisualizationananalysisoftopicsaestheticsandcharacteristicsin32recentprojects AT mannichen climatedatasonificationandvisualizationananalysisoftopicsaestheticsandcharacteristicsin32recentprojects |