A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction
Human–machine interaction (HMI) establishes an interconnected bridge between humans and robots and plays a significant role in industry and medical fields. However, the conventional interface is bulky and rigid with a single function. It lacks feedback information to be provided to the user, limitin...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-11-01
|
| Series: | Advanced Intelligent Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1002/aisy.202300291 |
| _version_ | 1797449895023476736 |
|---|---|
| author | Kai Feng Ming Lei Xianli Wang Bingpu Zhou Qingsong Xu |
| author_facet | Kai Feng Ming Lei Xianli Wang Bingpu Zhou Qingsong Xu |
| author_sort | Kai Feng |
| collection | DOAJ |
| description | Human–machine interaction (HMI) establishes an interconnected bridge between humans and robots and plays a significant role in industry and medical fields. However, the conventional interface is bulky and rigid with a single function. It lacks feedback information to be provided to the user, limiting its application scenarios and the ability to complete complex tasks in a dynamic environment. Herein, a flexible bidirectional (FBD) interface with integrated multimodal sensing and haptic feedback and the development of an FBD‐based closed‐loop HMI platform are presented. The proposed FBD interface offers programmable haptic feedback through a coin vibration motor array to endow the user with better performance in missions. The multimodal sensing array can perceive signals of joint movement and the pressure imposed on the skin. In addition, the FBD interface exhibits significant advantages of flexibility and a compact structure. The experimental tests verify that the multimodal sensing module can accurately perceive various static and dynamic movements of a human. Furthermore, the actuation module can provide diverse haptic vibrations to convey different information to the user. Moreover, successful applications in the scenarios of bilateral robotic teleoperation and assistance of disabled people indicate great potential of the FBD interface for broad applications. |
| first_indexed | 2024-03-09T14:32:37Z |
| format | Article |
| id | doaj.art-61f465e0b0c9438fa53719b7b9262304 |
| institution | Directory Open Access Journal |
| issn | 2640-4567 |
| language | English |
| last_indexed | 2024-03-09T14:32:37Z |
| publishDate | 2023-11-01 |
| publisher | Wiley |
| record_format | Article |
| series | Advanced Intelligent Systems |
| spelling | doaj.art-61f465e0b0c9438fa53719b7b92623042023-11-27T21:14:08ZengWileyAdvanced Intelligent Systems2640-45672023-11-01511n/an/a10.1002/aisy.202300291A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine InteractionKai Feng0Ming Lei1Xianli Wang2Bingpu Zhou3Qingsong Xu4Department of Electromechanical Engineering Faculty of Science and Technology University of Macau Taipa Macau ChinaInstitute of Applied Physics and Materials Engineering University of Macau Taipa Macau ChinaDepartment of Electromechanical Engineering Faculty of Science and Technology University of Macau Taipa Macau ChinaInstitute of Applied Physics and Materials Engineering University of Macau Taipa Macau ChinaDepartment of Electromechanical Engineering Faculty of Science and Technology University of Macau Taipa Macau ChinaHuman–machine interaction (HMI) establishes an interconnected bridge between humans and robots and plays a significant role in industry and medical fields. However, the conventional interface is bulky and rigid with a single function. It lacks feedback information to be provided to the user, limiting its application scenarios and the ability to complete complex tasks in a dynamic environment. Herein, a flexible bidirectional (FBD) interface with integrated multimodal sensing and haptic feedback and the development of an FBD‐based closed‐loop HMI platform are presented. The proposed FBD interface offers programmable haptic feedback through a coin vibration motor array to endow the user with better performance in missions. The multimodal sensing array can perceive signals of joint movement and the pressure imposed on the skin. In addition, the FBD interface exhibits significant advantages of flexibility and a compact structure. The experimental tests verify that the multimodal sensing module can accurately perceive various static and dynamic movements of a human. Furthermore, the actuation module can provide diverse haptic vibrations to convey different information to the user. Moreover, successful applications in the scenarios of bilateral robotic teleoperation and assistance of disabled people indicate great potential of the FBD interface for broad applications.https://doi.org/10.1002/aisy.202300291bidirectional interfacesclosed-loop human–machine interaction systemsflexible wearable interfaceshaptic feedbackmultimodal sensing |
| spellingShingle | Kai Feng Ming Lei Xianli Wang Bingpu Zhou Qingsong Xu A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction Advanced Intelligent Systems bidirectional interfaces closed-loop human–machine interaction systems flexible wearable interfaces haptic feedback multimodal sensing |
| title | A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction |
| title_full | A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction |
| title_fullStr | A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction |
| title_full_unstemmed | A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction |
| title_short | A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction |
| title_sort | flexible bidirectional interface with integrated multimodal sensing and haptic feedback for closed loop human machine interaction |
| topic | bidirectional interfaces closed-loop human–machine interaction systems flexible wearable interfaces haptic feedback multimodal sensing |
| url | https://doi.org/10.1002/aisy.202300291 |
| work_keys_str_mv | AT kaifeng aflexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT minglei aflexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT xianliwang aflexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT bingpuzhou aflexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT qingsongxu aflexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT kaifeng flexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT minglei flexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT xianliwang flexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT bingpuzhou flexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction AT qingsongxu flexiblebidirectionalinterfacewithintegratedmultimodalsensingandhapticfeedbackforclosedloophumanmachineinteraction |