An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing
With increasingly advanced Internet of Things (IoT) technology, the composition of workshop equipment has become more and more complex. Based on this, the rate of system performance degradation and the probability of fault have both increased. Owing to this, not only has the difficulty of constructi...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/17/6472 |
| _version_ | 1797493158991364096 |
|---|---|
| author | Liping Wang Dunbing Tang Changchun Liu Qingwei Nie Zhen Wang Linqi Zhang |
| author_facet | Liping Wang Dunbing Tang Changchun Liu Qingwei Nie Zhen Wang Linqi Zhang |
| author_sort | Liping Wang |
| collection | DOAJ |
| description | With increasingly advanced Internet of Things (IoT) technology, the composition of workshop equipment has become more and more complex. Based on this, the rate of system performance degradation and the probability of fault have both increased. Owing to this, not only has the difficulty of constructing the remaining useful life (RUL) model increased but also the improvement in speed of maintenance personnel cannot keep up with the speed of equipment replacement. Therefore, an augmented reality (AR)-assisted prognostics and health management system based on deep learning for IoT-enabled manufacturing is proposed in this paper. Firstly, the feature extraction model based on Convolutional Neural Network-Particle Swarm Optimization (PSO-CNN) is proposed with the purpose of excavating the internal associations in large amounts of production data. Based on this, the high-accuracy RUL prediction is accomplished by Gate Recurrent Unit (GRU)-attention, which can capture the long-term and short-term dependencies of time series and successfully solve the gradient disappearance problem of RNN. Moreover, more attention will be paid to important content with the help of the attention mechanism. Additionally, high-efficiency maintenance guidance and visible instructions can be accomplished by AR. On top of this, the remote expert can offer help when maintenance personnel encounters tough problems. Finally, a real case was implemented in a typical IoT-enabled workshop, which validated the effectiveness of the proposed approach. |
| first_indexed | 2024-03-10T01:16:00Z |
| format | Article |
| id | doaj.art-4a5fec6e3e4648d4a42d8932446c0f46 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T01:16:00Z |
| publishDate | 2022-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-4a5fec6e3e4648d4a42d8932446c0f462023-11-23T14:09:03ZengMDPI AGSensors1424-82202022-08-012217647210.3390/s22176472An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled ManufacturingLiping Wang0Dunbing Tang1Changchun Liu2Qingwei Nie3Zhen Wang4Linqi Zhang5College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, ChinaCollege of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, ChinaCollege of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, ChinaCollege of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, ChinaCollege of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, ChinaCollege of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, ChinaWith increasingly advanced Internet of Things (IoT) technology, the composition of workshop equipment has become more and more complex. Based on this, the rate of system performance degradation and the probability of fault have both increased. Owing to this, not only has the difficulty of constructing the remaining useful life (RUL) model increased but also the improvement in speed of maintenance personnel cannot keep up with the speed of equipment replacement. Therefore, an augmented reality (AR)-assisted prognostics and health management system based on deep learning for IoT-enabled manufacturing is proposed in this paper. Firstly, the feature extraction model based on Convolutional Neural Network-Particle Swarm Optimization (PSO-CNN) is proposed with the purpose of excavating the internal associations in large amounts of production data. Based on this, the high-accuracy RUL prediction is accomplished by Gate Recurrent Unit (GRU)-attention, which can capture the long-term and short-term dependencies of time series and successfully solve the gradient disappearance problem of RNN. Moreover, more attention will be paid to important content with the help of the attention mechanism. Additionally, high-efficiency maintenance guidance and visible instructions can be accomplished by AR. On top of this, the remote expert can offer help when maintenance personnel encounters tough problems. Finally, a real case was implemented in a typical IoT-enabled workshop, which validated the effectiveness of the proposed approach.https://www.mdpi.com/1424-8220/22/17/6472augmented realityPSO-CNNGRU-attentionRUL predictionIoT-enabled manufacturing |
| spellingShingle | Liping Wang Dunbing Tang Changchun Liu Qingwei Nie Zhen Wang Linqi Zhang An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing Sensors augmented reality PSO-CNN GRU-attention RUL prediction IoT-enabled manufacturing |
| title | An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing |
| title_full | An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing |
| title_fullStr | An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing |
| title_full_unstemmed | An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing |
| title_short | An Augmented Reality-Assisted Prognostics and Health Management System Based on Deep Learning for IoT-Enabled Manufacturing |
| title_sort | augmented reality assisted prognostics and health management system based on deep learning for iot enabled manufacturing |
| topic | augmented reality PSO-CNN GRU-attention RUL prediction IoT-enabled manufacturing |
| url | https://www.mdpi.com/1424-8220/22/17/6472 |
| work_keys_str_mv | AT lipingwang anaugmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT dunbingtang anaugmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT changchunliu anaugmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT qingweinie anaugmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT zhenwang anaugmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT linqizhang anaugmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT lipingwang augmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT dunbingtang augmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT changchunliu augmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT qingweinie augmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT zhenwang augmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing AT linqizhang augmentedrealityassistedprognosticsandhealthmanagementsystembasedondeeplearningforiotenabledmanufacturing |