A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
Human-Cyber-Physical Systems (HCPS), as an emerging paradigm centered around humans, provide a promising direction for the advancement of various domains, such as intelligent manufacturing and aerospace. In contrast to Cyber-Physical Systems (CPS), the development of HCPS emphasizes the expansion of...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/180133 |
| _version_ | 1824453673616408576 |
|---|---|
| author | Qi, Wenqian Chen, Chun-Hsien Niu, Tongzhi Lyu, Shuhui Sun, Shouqian |
| author2 | School of Mechanical and Aerospace Engineering |
| author_facet | School of Mechanical and Aerospace Engineering Qi, Wenqian Chen, Chun-Hsien Niu, Tongzhi Lyu, Shuhui Sun, Shouqian |
| author_sort | Qi, Wenqian |
| collection | NTU |
| description | Human-Cyber-Physical Systems (HCPS), as an emerging paradigm centered around humans, provide a promising direction for the advancement of various domains, such as intelligent manufacturing and aerospace. In contrast to Cyber-Physical Systems (CPS), the development of HCPS emphasizes the expansion of human capabilities. Humans no longer solely function as operators or agents working in collaboration with computers and machines but extend their roles to include system design and innovation management. This paper proposes a Multisensory Interaction Framework for HCPS (MS-HCPS) that leverages human senses to facilitate system creation and management. Additionally, the introduced Multisensory Graph Convolutional Network (MS-GCN) model calculates recommendation values for multiple senses, elucidating their relevance to system development. Furthermore, the effectiveness of the proposed framework and model is validated through three practical engineering scenarios. This study explores the research on multisensory interaction in HCPS from a human sensory perspective, aiming to facilitate the progress and development of HCPS across various domains. |
| first_indexed | 2025-02-19T03:10:09Z |
| format | Journal Article |
| id | ntu-10356/180133 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2025-02-19T03:10:09Z |
| publishDate | 2024 |
| record_format | dspace |
| spelling | ntu-10356/1801332024-09-18T05:46:23Z A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks Qi, Wenqian Chen, Chun-Hsien Niu, Tongzhi Lyu, Shuhui Sun, Shouqian School of Mechanical and Aerospace Engineering Engineering Multisensory interaction Graph convolutional networks Human-Cyber-Physical Systems (HCPS), as an emerging paradigm centered around humans, provide a promising direction for the advancement of various domains, such as intelligent manufacturing and aerospace. In contrast to Cyber-Physical Systems (CPS), the development of HCPS emphasizes the expansion of human capabilities. Humans no longer solely function as operators or agents working in collaboration with computers and machines but extend their roles to include system design and innovation management. This paper proposes a Multisensory Interaction Framework for HCPS (MS-HCPS) that leverages human senses to facilitate system creation and management. Additionally, the introduced Multisensory Graph Convolutional Network (MS-GCN) model calculates recommendation values for multiple senses, elucidating their relevance to system development. Furthermore, the effectiveness of the proposed framework and model is validated through three practical engineering scenarios. This study explores the research on multisensory interaction in HCPS from a human sensory perspective, aiming to facilitate the progress and development of HCPS across various domains. This work was supported by the National Key R & D Program of China (No. 2020YFC1523301-2). 2024-09-18T05:46:23Z 2024-09-18T05:46:23Z 2024 Journal Article Qi, W., Chen, C., Niu, T., Lyu, S. & Sun, S. (2024). A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks. Advanced Engineering Informatics, 61, 102482-. https://dx.doi.org/10.1016/j.aei.2024.102482 1474-0346 https://hdl.handle.net/10356/180133 10.1016/j.aei.2024.102482 2-s2.0-85187791301 61 102482 en Advanced Engineering Informatics © 2024 Elsevier Ltd. All rights reserved. |
| spellingShingle | Engineering Multisensory interaction Graph convolutional networks Qi, Wenqian Chen, Chun-Hsien Niu, Tongzhi Lyu, Shuhui Sun, Shouqian A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks |
| title | A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks |
| title_full | A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks |
| title_fullStr | A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks |
| title_full_unstemmed | A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks |
| title_short | A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks |
| title_sort | multisensory interaction framework for human cyber physical system based on graph convolutional networks |
| topic | Engineering Multisensory interaction Graph convolutional networks |
| url | https://hdl.handle.net/10356/180133 |
| work_keys_str_mv | AT qiwenqian amultisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT chenchunhsien amultisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT niutongzhi amultisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT lyushuhui amultisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT sunshouqian amultisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT qiwenqian multisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT chenchunhsien multisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT niutongzhi multisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT lyushuhui multisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks AT sunshouqian multisensoryinteractionframeworkforhumancyberphysicalsystembasedongraphconvolutionalnetworks |