Recent advancements in multimodal human–robot interaction
Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robot...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-05-01
|
| Series: | Frontiers in Neurorobotics |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnbot.2023.1084000/full |
| _version_ | 1827949957671288832 |
|---|---|
| author | Hang Su Wen Qi Jiahao Chen Chenguang Yang Juan Sandoval Med Amine Laribi |
| author_facet | Hang Su Wen Qi Jiahao Chen Chenguang Yang Juan Sandoval Med Amine Laribi |
| author_sort | Hang Su |
| collection | DOAJ |
| description | Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript. |
| first_indexed | 2024-04-09T13:19:30Z |
| format | Article |
| id | doaj.art-fe8a4d44a18e498db89ec21ce7ea7bc5 |
| institution | Directory Open Access Journal |
| issn | 1662-5218 |
| language | English |
| last_indexed | 2024-04-09T13:19:30Z |
| publishDate | 2023-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neurorobotics |
| spelling | doaj.art-fe8a4d44a18e498db89ec21ce7ea7bc52023-05-11T11:18:09ZengFrontiers Media S.A.Frontiers in Neurorobotics1662-52182023-05-011710.3389/fnbot.2023.10840001084000Recent advancements in multimodal human–robot interactionHang Su0Wen Qi1Jiahao Chen2Chenguang Yang3Juan Sandoval4Med Amine Laribi5Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, ItalySchool of Future Technology, South China University of Technology, Guangzhou, ChinaState Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, ChinaBristol Robotics Laboratory, University of the West of England, Bristol, United KingdomDepartment of GMSC, Pprime Institute, CNRS, ENSMA, University of Poitiers, Poitiers, FranceDepartment of GMSC, Pprime Institute, CNRS, ENSMA, University of Poitiers, Poitiers, FranceRobotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript.https://www.frontiersin.org/articles/10.3389/fnbot.2023.1084000/fullmulti-modal signal processingmulti-modal feedbackmulti-modal human–robot interactionphysical human–robot interactionhuman–robot interaction |
| spellingShingle | Hang Su Wen Qi Jiahao Chen Chenguang Yang Juan Sandoval Med Amine Laribi Recent advancements in multimodal human–robot interaction Frontiers in Neurorobotics multi-modal signal processing multi-modal feedback multi-modal human–robot interaction physical human–robot interaction human–robot interaction |
| title | Recent advancements in multimodal human–robot interaction |
| title_full | Recent advancements in multimodal human–robot interaction |
| title_fullStr | Recent advancements in multimodal human–robot interaction |
| title_full_unstemmed | Recent advancements in multimodal human–robot interaction |
| title_short | Recent advancements in multimodal human–robot interaction |
| title_sort | recent advancements in multimodal human robot interaction |
| topic | multi-modal signal processing multi-modal feedback multi-modal human–robot interaction physical human–robot interaction human–robot interaction |
| url | https://www.frontiersin.org/articles/10.3389/fnbot.2023.1084000/full |
| work_keys_str_mv | AT hangsu recentadvancementsinmultimodalhumanrobotinteraction AT wenqi recentadvancementsinmultimodalhumanrobotinteraction AT jiahaochen recentadvancementsinmultimodalhumanrobotinteraction AT chenguangyang recentadvancementsinmultimodalhumanrobotinteraction AT juansandoval recentadvancementsinmultimodalhumanrobotinteraction AT medaminelaribi recentadvancementsinmultimodalhumanrobotinteraction |