Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users
Deafblind persons’ perception and experiences are based on their residual auditive and visual senses, and touch. Their haptic exploration, through movements and orientation towards objects give blind persons direct, independent experience. Few studies explore the aesthetic experiences and...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2018-05-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | http://www.mdpi.com/2414-4088/2/2/24 |
| _version_ | 1811302054107283456 |
|---|---|
| author | Riitta Lahtinen Camilla Groth Russ Palmer |
| author_facet | Riitta Lahtinen Camilla Groth Russ Palmer |
| author_sort | Riitta Lahtinen |
| collection | DOAJ |
| description | Deafblind persons’ perception and experiences are based on their residual auditive and visual senses, and touch. Their haptic exploration, through movements and orientation towards objects give blind persons direct, independent experience. Few studies explore the aesthetic experiences and appreciation of artefacts of deafblind people using cochlear implant (CI) technology, and how they interpret and express their perceived aesthetic experience through another sensory modality. While speech recognition is studied extensively in this area, the aspect of auditive descriptions made by CI users are a less-studied domain. This present research intervention describes and analyses five different deafblind people sharing their interpretation of five statues vocally, using sounds and written descriptions based on their haptic explorations. The participants found new and multimodal ways of expressing their experiences, as well as re-experiencing them through technological aids. We also found that the CI users modify technology to better suit their personal needs. We conclude that CI technology in combination with self-made sound descriptions enhance memorization of haptic art experiences that can be re-called by the recording of the sound descriptions. This research expands the idea of auditive descriptions, and encourages user-produced descriptions as artistic supports to traditional linguistic, audio descriptions. These can be used to create personal auditive–haptic memory collections similar to how sighted create photo albums. |
| first_indexed | 2024-04-13T07:21:04Z |
| format | Article |
| id | doaj.art-35b1456f98c2466685f79c8bec3b441f |
| institution | Directory Open Access Journal |
| issn | 2414-4088 |
| language | English |
| last_indexed | 2024-04-13T07:21:04Z |
| publishDate | 2018-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj.art-35b1456f98c2466685f79c8bec3b441f2022-12-22T02:56:37ZengMDPI AGMultimodal Technologies and Interaction2414-40882018-05-01222410.3390/mti2020024mti2020024Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant UsersRiitta Lahtinen0Camilla Groth1Russ Palmer2ISE Research Group, Faculty of Educational Sciences, University of Helsinki, 00100 Helsinki, FinlandFashion/Textile Futures Research Group, Department of Design, Aalto University School of Arts, Design and Architecture, 00560 Helsinki, FinlandISE Research Group, Faculty of Educational Sciences, University of Helsinki, 00100 Helsinki, FinlandDeafblind persons’ perception and experiences are based on their residual auditive and visual senses, and touch. Their haptic exploration, through movements and orientation towards objects give blind persons direct, independent experience. Few studies explore the aesthetic experiences and appreciation of artefacts of deafblind people using cochlear implant (CI) technology, and how they interpret and express their perceived aesthetic experience through another sensory modality. While speech recognition is studied extensively in this area, the aspect of auditive descriptions made by CI users are a less-studied domain. This present research intervention describes and analyses five different deafblind people sharing their interpretation of five statues vocally, using sounds and written descriptions based on their haptic explorations. The participants found new and multimodal ways of expressing their experiences, as well as re-experiencing them through technological aids. We also found that the CI users modify technology to better suit their personal needs. We conclude that CI technology in combination with self-made sound descriptions enhance memorization of haptic art experiences that can be re-called by the recording of the sound descriptions. This research expands the idea of auditive descriptions, and encourages user-produced descriptions as artistic supports to traditional linguistic, audio descriptions. These can be used to create personal auditive–haptic memory collections similar to how sighted create photo albums.http://www.mdpi.com/2414-4088/2/2/24haptic experiencedeafblindnesstechnological aidscochlear implantaesthetic experiencevocalization as memory |
| spellingShingle | Riitta Lahtinen Camilla Groth Russ Palmer Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users Multimodal Technologies and Interaction haptic experience deafblindness technological aids cochlear implant aesthetic experience vocalization as memory |
| title | Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users |
| title_full | Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users |
| title_fullStr | Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users |
| title_full_unstemmed | Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users |
| title_short | Sound Descriptions of Haptic Experiences of Art Work by Deafblind Cochlear Implant Users |
| title_sort | sound descriptions of haptic experiences of art work by deafblind cochlear implant users |
| topic | haptic experience deafblindness technological aids cochlear implant aesthetic experience vocalization as memory |
| url | http://www.mdpi.com/2414-4088/2/2/24 |
| work_keys_str_mv | AT riittalahtinen sounddescriptionsofhapticexperiencesofartworkbydeafblindcochlearimplantusers AT camillagroth sounddescriptionsofhapticexperiencesofartworkbydeafblindcochlearimplantusers AT russpalmer sounddescriptionsofhapticexperiencesofartworkbydeafblindcochlearimplantusers |