Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode

Software is intangible, invisible, and at the same time pervasive in everyday devices, activities, and services accompanying our life. Therefore, citizens hardly realize its complexity, power, and impact in many aspects of their daily life. In this study, we report on one experiment that aims at let...

Full description

Bibliographic Details
Main Authors: Claudio Panariello, Roberto Bresin
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-05-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnins.2022.862663/full
_version_ 1818193743761637376
author Claudio Panariello
Roberto Bresin
author_facet Claudio Panariello
Roberto Bresin
author_sort Claudio Panariello
collection DOAJ
description Software is intangible, invisible, and at the same time pervasive in everyday devices, activities, and services accompanying our life. Therefore, citizens hardly realize its complexity, power, and impact in many aspects of their daily life. In this study, we report on one experiment that aims at letting citizens make sense of software presence and activity in their everyday lives, through sound: the invisible complexity of the processes involved in the shutdown of a personal computer. We used sonification to map information embedded in software events into the sound domain. The software events involved in a shutdown have names related to the physical world and its actions: write events (information is saved into digital memories), kill events (running processes are terminated), and exit events (running programs are exited). The research study presented in this article has a “double character.” It is an artistic realization that develops specific aesthetic choices, and it has also pedagogical purposes informing the causal listener about the complexity of software behavior. Two different sound design strategies have been applied: one strategy is influenced by the sonic characteristics of the Glitch music scene, which makes deliberate use of glitch-based sound materials, distortions, aliasing, quantization noise, and all the “failures” of digital technologies; and a second strategy based on the sound samples of a subcontrabass Paetzold recorder, an unusual and special acoustic instrument which unique sound has been investigated in the contemporary art music scene. Analysis of quantitative ratings and qualitative comments of 37 participants revealed that the sound design strategies succeeded in communicating the nature of the computer processes. Participants also showed in general an appreciation of the aesthetics of the peculiar sound models used in this study.
first_indexed 2024-12-12T00:51:15Z
format Article
id doaj.art-5428a10ec2084ee7bd4ee1e73a01a467
institution Directory Open Access Journal
issn 1662-453X
language English
last_indexed 2024-12-12T00:51:15Z
publishDate 2022-05-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Neuroscience
spelling doaj.art-5428a10ec2084ee7bd4ee1e73a01a4672022-12-22T00:44:01ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2022-05-011610.3389/fnins.2022.862663862663Sonification of Computer Processes: The Cases of Computer Shutdown and Idle ModeClaudio PanarielloRoberto BresinSoftware is intangible, invisible, and at the same time pervasive in everyday devices, activities, and services accompanying our life. Therefore, citizens hardly realize its complexity, power, and impact in many aspects of their daily life. In this study, we report on one experiment that aims at letting citizens make sense of software presence and activity in their everyday lives, through sound: the invisible complexity of the processes involved in the shutdown of a personal computer. We used sonification to map information embedded in software events into the sound domain. The software events involved in a shutdown have names related to the physical world and its actions: write events (information is saved into digital memories), kill events (running processes are terminated), and exit events (running programs are exited). The research study presented in this article has a “double character.” It is an artistic realization that develops specific aesthetic choices, and it has also pedagogical purposes informing the causal listener about the complexity of software behavior. Two different sound design strategies have been applied: one strategy is influenced by the sonic characteristics of the Glitch music scene, which makes deliberate use of glitch-based sound materials, distortions, aliasing, quantization noise, and all the “failures” of digital technologies; and a second strategy based on the sound samples of a subcontrabass Paetzold recorder, an unusual and special acoustic instrument which unique sound has been investigated in the contemporary art music scene. Analysis of quantitative ratings and qualitative comments of 37 participants revealed that the sound design strategies succeeded in communicating the nature of the computer processes. Participants also showed in general an appreciation of the aesthetics of the peculiar sound models used in this study.https://www.frontiersin.org/articles/10.3389/fnins.2022.862663/fullsonificationsoftware processesaestheticglitchPaetzold recorder
spellingShingle Claudio Panariello
Roberto Bresin
Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
Frontiers in Neuroscience
sonification
software processes
aesthetic
glitch
Paetzold recorder
title Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
title_full Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
title_fullStr Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
title_full_unstemmed Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
title_short Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
title_sort sonification of computer processes the cases of computer shutdown and idle mode
topic sonification
software processes
aesthetic
glitch
Paetzold recorder
url https://www.frontiersin.org/articles/10.3389/fnins.2022.862663/full
work_keys_str_mv AT claudiopanariello sonificationofcomputerprocessesthecasesofcomputershutdownandidlemode
AT robertobresin sonificationofcomputerprocessesthecasesofcomputershutdownandidlemode