Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator
Abstract Rapid advancements of artificial intelligence of things (AIoT) technology pave the way for developing a digital‐twin‐based remote interactive system for advanced robotic‐enabled industrial automation and virtual shopping. The embedded multifunctional perception system is urged for better in...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-07-01
|
| Series: | Advanced Science |
| Subjects: | |
| Online Access: | https://doi.org/10.1002/advs.202100230 |
| _version_ | 1818862699293966336 |
|---|---|
| author | Zhongda Sun Minglu Zhu Zixuan Zhang Zhaocong Chen Qiongfeng Shi Xuechuan Shan Raye Chen Hua Yeow Chengkuo Lee |
| author_facet | Zhongda Sun Minglu Zhu Zixuan Zhang Zhaocong Chen Qiongfeng Shi Xuechuan Shan Raye Chen Hua Yeow Chengkuo Lee |
| author_sort | Zhongda Sun |
| collection | DOAJ |
| description | Abstract Rapid advancements of artificial intelligence of things (AIoT) technology pave the way for developing a digital‐twin‐based remote interactive system for advanced robotic‐enabled industrial automation and virtual shopping. The embedded multifunctional perception system is urged for better interaction and user experience. To realize such a system, a smart soft robotic manipulator is presented that consists of a triboelectric nanogenerator tactile (T‐TENG) and length (L‐TENG) sensor, as well as a poly(vinylidene fluoride) (PVDF) pyroelectric temperature sensor. With the aid of machine learning (ML) for data processing, the fusion of the T‐TENG and L‐TENG sensors can realize the automatic recognition of the grasped objects with the accuracy of 97.143% for 28 different shapes of objects, while the temperature distribution can also be obtained through the pyroelectric sensor. By leveraging the IoT and artificial intelligence (AI) analytics, a digital‐twin‐based virtual shop is successfully implemented to provide the users with real‐time feedback about the details of the product. In general, by offering a more immersive experience in human–machine interactions, the proposed remote interactive system shows the great potential of being the advanced human–machine interface for the applications of the unmanned working space. |
| first_indexed | 2024-12-19T10:04:01Z |
| format | Article |
| id | doaj.art-0c7de72cd788431da85ed69e847acd3a |
| institution | Directory Open Access Journal |
| issn | 2198-3844 |
| language | English |
| last_indexed | 2024-12-19T10:04:01Z |
| publishDate | 2021-07-01 |
| publisher | Wiley |
| record_format | Article |
| series | Advanced Science |
| spelling | doaj.art-0c7de72cd788431da85ed69e847acd3a2022-12-21T20:26:34ZengWileyAdvanced Science2198-38442021-07-01814n/an/a10.1002/advs.202100230Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic ManipulatorZhongda Sun0Minglu Zhu1Zixuan Zhang2Zhaocong Chen3Qiongfeng Shi4Xuechuan Shan5Raye Chen Hua Yeow6Chengkuo Lee7Department of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeDepartment of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeDepartment of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeDepartment of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeDepartment of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeInstitute of Manufacturing Technology and National University of Singapore (SIMTech‐NUS) Joint Lab on Large‐Area Flexible Hybrid Electronics National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeDepartment of Biomedical Engineering National University of Singapore #04‐08, Engineering Block 4, 4 Engineering Drive 3 Singapore 117583 SingaporeDepartment of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 SingaporeAbstract Rapid advancements of artificial intelligence of things (AIoT) technology pave the way for developing a digital‐twin‐based remote interactive system for advanced robotic‐enabled industrial automation and virtual shopping. The embedded multifunctional perception system is urged for better interaction and user experience. To realize such a system, a smart soft robotic manipulator is presented that consists of a triboelectric nanogenerator tactile (T‐TENG) and length (L‐TENG) sensor, as well as a poly(vinylidene fluoride) (PVDF) pyroelectric temperature sensor. With the aid of machine learning (ML) for data processing, the fusion of the T‐TENG and L‐TENG sensors can realize the automatic recognition of the grasped objects with the accuracy of 97.143% for 28 different shapes of objects, while the temperature distribution can also be obtained through the pyroelectric sensor. By leveraging the IoT and artificial intelligence (AI) analytics, a digital‐twin‐based virtual shop is successfully implemented to provide the users with real‐time feedback about the details of the product. In general, by offering a more immersive experience in human–machine interactions, the proposed remote interactive system shows the great potential of being the advanced human–machine interface for the applications of the unmanned working space.https://doi.org/10.1002/advs.202100230artificial intelligenceobject recognitionsoft manipulatortriboelectricvirtual/augmented reality |
| spellingShingle | Zhongda Sun Minglu Zhu Zixuan Zhang Zhaocong Chen Qiongfeng Shi Xuechuan Shan Raye Chen Hua Yeow Chengkuo Lee Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator Advanced Science artificial intelligence object recognition soft manipulator triboelectric virtual/augmented reality |
| title | Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator |
| title_full | Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator |
| title_fullStr | Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator |
| title_full_unstemmed | Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator |
| title_short | Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self‐Powered Sensor Enhanced Soft Robotic Manipulator |
| title_sort | artificial intelligence of things aiot enabled virtual shop applications using self powered sensor enhanced soft robotic manipulator |
| topic | artificial intelligence object recognition soft manipulator triboelectric virtual/augmented reality |
| url | https://doi.org/10.1002/advs.202100230 |
| work_keys_str_mv | AT zhongdasun artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT mingluzhu artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT zixuanzhang artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT zhaocongchen artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT qiongfengshi artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT xuechuanshan artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT rayechenhuayeow artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator AT chengkuolee artificialintelligenceofthingsaiotenabledvirtualshopapplicationsusingselfpoweredsensorenhancedsoftroboticmanipulator |