Visuo-Haptic Exploration for Multimodal Memory
When faced with a novel object, we explore it to understand its shape. This way we combine information coming from different senses, as touch, proprioception and vision, together with the motor information embedded in our motor execution plan. The exploration process provides a structure and constra...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2019-05-01
|
| Series: | Frontiers in Integrative Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fnint.2019.00015/full |
| _version_ | 1818082580758528000 |
|---|---|
| author | Alessandra Sciutti Federica Damonte Federica Damonte Marta Alloisio Marta Alloisio Giulio Sandini |
| author_facet | Alessandra Sciutti Federica Damonte Federica Damonte Marta Alloisio Marta Alloisio Giulio Sandini |
| author_sort | Alessandra Sciutti |
| collection | DOAJ |
| description | When faced with a novel object, we explore it to understand its shape. This way we combine information coming from different senses, as touch, proprioception and vision, together with the motor information embedded in our motor execution plan. The exploration process provides a structure and constrains this rich flow of inputs, supporting the formation of a unified percept and the memorization of the object features. However, how the exploration strategies are planned is still an open question. In particular, is the exploration strategy used to memorize an object different from the exploration strategy adopted in a recall task? To address this question we used iCube, a sensorized cube which measures its orientation in space and the location of the contacts on its faces. Participants were required to explore the cube faces where little pins were positioned in varying number. Participants had to explore the cube twice and individuate potential differences between the two presentations, which could be performed either haptically alone, or with also vision available. The haptic and visuo-haptic (VH) exploratory strategies changed significantly when finalized to memorize the structure of the object with respect to when the same object was explored to recall and compare it with its memorized instance. These findings indicate that exploratory strategies are adapted not only to the property of the object to be analyzed but also to the prospective use of the resulting representation, be it memorization or recall. The results are discussed in light of the possibility of a systematic modeling of natural VH exploration strategies. |
| first_indexed | 2024-12-10T19:24:22Z |
| format | Article |
| id | doaj.art-7dd91c7edbed48f3b5be3c8b586d6068 |
| institution | Directory Open Access Journal |
| issn | 1662-5145 |
| language | English |
| last_indexed | 2024-12-10T19:24:22Z |
| publishDate | 2019-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Integrative Neuroscience |
| spelling | doaj.art-7dd91c7edbed48f3b5be3c8b586d60682022-12-22T01:36:24ZengFrontiers Media S.A.Frontiers in Integrative Neuroscience1662-51452019-05-011310.3389/fnint.2019.00015357819Visuo-Haptic Exploration for Multimodal MemoryAlessandra Sciutti0Federica Damonte1Federica Damonte2Marta Alloisio3Marta Alloisio4Giulio Sandini5Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, ItalyCognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, ItalyDIBRIS, Università di Genova, Genoa, ItalyCognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, ItalyDIBRIS, Università di Genova, Genoa, ItalyCognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, ItalyWhen faced with a novel object, we explore it to understand its shape. This way we combine information coming from different senses, as touch, proprioception and vision, together with the motor information embedded in our motor execution plan. The exploration process provides a structure and constrains this rich flow of inputs, supporting the formation of a unified percept and the memorization of the object features. However, how the exploration strategies are planned is still an open question. In particular, is the exploration strategy used to memorize an object different from the exploration strategy adopted in a recall task? To address this question we used iCube, a sensorized cube which measures its orientation in space and the location of the contacts on its faces. Participants were required to explore the cube faces where little pins were positioned in varying number. Participants had to explore the cube twice and individuate potential differences between the two presentations, which could be performed either haptically alone, or with also vision available. The haptic and visuo-haptic (VH) exploratory strategies changed significantly when finalized to memorize the structure of the object with respect to when the same object was explored to recall and compare it with its memorized instance. These findings indicate that exploratory strategies are adapted not only to the property of the object to be analyzed but also to the prospective use of the resulting representation, be it memorization or recall. The results are discussed in light of the possibility of a systematic modeling of natural VH exploration strategies.https://www.frontiersin.org/article/10.3389/fnint.2019.00015/fullhapticvisionactive explorationbimodal perceptionperception and action |
| spellingShingle | Alessandra Sciutti Federica Damonte Federica Damonte Marta Alloisio Marta Alloisio Giulio Sandini Visuo-Haptic Exploration for Multimodal Memory Frontiers in Integrative Neuroscience haptic vision active exploration bimodal perception perception and action |
| title | Visuo-Haptic Exploration for Multimodal Memory |
| title_full | Visuo-Haptic Exploration for Multimodal Memory |
| title_fullStr | Visuo-Haptic Exploration for Multimodal Memory |
| title_full_unstemmed | Visuo-Haptic Exploration for Multimodal Memory |
| title_short | Visuo-Haptic Exploration for Multimodal Memory |
| title_sort | visuo haptic exploration for multimodal memory |
| topic | haptic vision active exploration bimodal perception perception and action |
| url | https://www.frontiersin.org/article/10.3389/fnint.2019.00015/full |
| work_keys_str_mv | AT alessandrasciutti visuohapticexplorationformultimodalmemory AT federicadamonte visuohapticexplorationformultimodalmemory AT federicadamonte visuohapticexplorationformultimodalmemory AT martaalloisio visuohapticexplorationformultimodalmemory AT martaalloisio visuohapticexplorationformultimodalmemory AT giuliosandini visuohapticexplorationformultimodalmemory |