EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study
In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-03-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/7/4/37 |
| _version_ | 1797603998867390464 |
|---|---|
| author | Birte Richter Felix Putze Gabriel Ivucic Mara Brandt Christian Schütze Rafael Reisenhofer Britta Wrede Tanja Schultz |
| author_facet | Birte Richter Felix Putze Gabriel Ivucic Mara Brandt Christian Schütze Rafael Reisenhofer Britta Wrede Tanja Schultz |
| author_sort | Birte Richter |
| collection | DOAJ |
| description | In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies. |
| first_indexed | 2024-03-11T04:41:03Z |
| format | Article |
| id | doaj.art-0999dfe7789e4672b4c41dd36627365e |
| institution | Directory Open Access Journal |
| issn | 2414-4088 |
| language | English |
| last_indexed | 2024-03-11T04:41:03Z |
| publishDate | 2023-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj.art-0999dfe7789e4672b4c41dd36627365e2023-11-17T20:42:21ZengMDPI AGMultimodal Technologies and Interaction2414-40882023-03-01743710.3390/mti7040037EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot StudyBirte Richter0Felix Putze1Gabriel Ivucic2Mara Brandt3Christian Schütze4Rafael Reisenhofer5Britta Wrede6Tanja Schultz7Medical Assistance Systems, Medical School OWL, Bielefeld University, 33615 Bielefeld, GermanyCognitive Systems Lab, University of Bremen, 28359 Bremen, GermanyCognitive Systems Lab, University of Bremen, 28359 Bremen, GermanyMedical Assistance Systems, Medical School OWL, Bielefeld University, 33615 Bielefeld, GermanyMedical Assistance Systems, Medical School OWL, Bielefeld University, 33615 Bielefeld, GermanyCognitive Systems Lab, University of Bremen, 28359 Bremen, GermanySoftware Engineering for Cognitive Robots and Systems, University of Bremen, 28359 Bremen, GermanyCognitive Systems Lab, University of Bremen, 28359 Bremen, GermanyIn this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.https://www.mdpi.com/2414-4088/7/4/37human–robot interactionLabLinkingelectroencephalographyneural correlates of distractionrole of hesitations in spoken communication |
| spellingShingle | Birte Richter Felix Putze Gabriel Ivucic Mara Brandt Christian Schütze Rafael Reisenhofer Britta Wrede Tanja Schultz EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study Multimodal Technologies and Interaction human–robot interaction LabLinking electroencephalography neural correlates of distraction role of hesitations in spoken communication |
| title | EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study |
| title_full | EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study |
| title_fullStr | EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study |
| title_full_unstemmed | EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study |
| title_short | EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study |
| title_sort | eeg correlates of distractions and hesitations in human robot interaction a lablinking pilot study |
| topic | human–robot interaction LabLinking electroencephalography neural correlates of distraction role of hesitations in spoken communication |
| url | https://www.mdpi.com/2414-4088/7/4/37 |
| work_keys_str_mv | AT birterichter eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT felixputze eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT gabrielivucic eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT marabrandt eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT christianschutze eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT rafaelreisenhofer eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT brittawrede eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy AT tanjaschultz eegcorrelatesofdistractionsandhesitationsinhumanrobotinteractionalablinkingpilotstudy |