Learning and navigating digitally rendered haptic spatial layouts
Abstract Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired particip...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-12-01
|
| Series: | npj Science of Learning |
| Online Access: | https://doi.org/10.1038/s41539-023-00208-4 |
| _version_ | 1797388545744175104 |
|---|---|
| author | Ruxandra I. Tivadar Benedetta Franceschiello Astrid Minier Micah M. Murray |
| author_facet | Ruxandra I. Tivadar Benedetta Franceschiello Astrid Minier Micah M. Murray |
| author_sort | Ruxandra I. Tivadar |
| collection | DOAJ |
| description | Abstract Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments. |
| first_indexed | 2024-03-08T22:41:22Z |
| format | Article |
| id | doaj.art-72d14a10adb84fcf898de4ba3bd1ac0d |
| institution | Directory Open Access Journal |
| issn | 2056-7936 |
| language | English |
| last_indexed | 2024-03-08T22:41:22Z |
| publishDate | 2023-12-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | npj Science of Learning |
| spelling | doaj.art-72d14a10adb84fcf898de4ba3bd1ac0d2023-12-17T12:07:28ZengNature Portfolionpj Science of Learning2056-79362023-12-018111110.1038/s41539-023-00208-4Learning and navigating digitally rendered haptic spatial layoutsRuxandra I. Tivadar0Benedetta Franceschiello1Astrid Minier2Micah M. Murray3The Department of Radiology, Lausanne University Hospital and University of LausanneThe Department of Radiology, Lausanne University Hospital and University of LausanneThe Department of Radiology, Lausanne University Hospital and University of LausanneThe Department of Radiology, Lausanne University Hospital and University of LausanneAbstract Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.https://doi.org/10.1038/s41539-023-00208-4 |
| spellingShingle | Ruxandra I. Tivadar Benedetta Franceschiello Astrid Minier Micah M. Murray Learning and navigating digitally rendered haptic spatial layouts npj Science of Learning |
| title | Learning and navigating digitally rendered haptic spatial layouts |
| title_full | Learning and navigating digitally rendered haptic spatial layouts |
| title_fullStr | Learning and navigating digitally rendered haptic spatial layouts |
| title_full_unstemmed | Learning and navigating digitally rendered haptic spatial layouts |
| title_short | Learning and navigating digitally rendered haptic spatial layouts |
| title_sort | learning and navigating digitally rendered haptic spatial layouts |
| url | https://doi.org/10.1038/s41539-023-00208-4 |
| work_keys_str_mv | AT ruxandraitivadar learningandnavigatingdigitallyrenderedhapticspatiallayouts AT benedettafranceschiello learningandnavigatingdigitallyrenderedhapticspatiallayouts AT astridminier learningandnavigatingdigitallyrenderedhapticspatiallayouts AT micahmmurray learningandnavigatingdigitallyrenderedhapticspatiallayouts |