An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition
The industrial manufacturing sector is undergoing a tremendous revolution moving from traditional production processes to intelligent techniques. Under this revolution, known as Industry 4.0 (I40), a robot is no longer static equipment but an active workforce to the factory production alongside huma...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-01-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/3/941 |
| _version_ | 1827658828071567360 |
|---|---|
| author | Kahiomba Sonia Kiangala Zenghui Wang |
| author_facet | Kahiomba Sonia Kiangala Zenghui Wang |
| author_sort | Kahiomba Sonia Kiangala |
| collection | DOAJ |
| description | The industrial manufacturing sector is undergoing a tremendous revolution moving from traditional production processes to intelligent techniques. Under this revolution, known as Industry 4.0 (I40), a robot is no longer static equipment but an active workforce to the factory production alongside human operators. Safety becomes crucial for humans and robots to ensure a smooth production run in such environments. The loss of operating moving robots in plant evacuation can be avoided with the adequate safety induction for them. Operators are subject to frequent safety inductions to react in emergencies, but very little is done for robots. Our research proposes an experimental safety response mechanism for a small manufacturing plant, through which an autonomous robot learns the obstacle-free trajectory to the closest safety exit in emergencies. We implement a reinforcement learning (RL) algorithm, Q-learning, to enable the path learning abilities of the robot. After obtaining the robot optimal path selection options with Q-learning, we code the outcome as a rule-based system for the safety response. We also program a speech recognition system for operators to react timeously, with a voice command, to an emergency that requires stopping all plant activities even when they are far away from the emergency stops (ESTOPs) button. An ESTOP or a voice command sent directly to the factory central controller can give the factory an emergency signal. We tested this functionality on real hardware from an S7-1200 Siemens programmable logic controller (PLC). We simulate a simple and small manufacturing environment overview to test our safety procedure. Our results show that the safety response mechanism successfully generates paths without obstacles to the closest safety exits from all the factory locations. Our research benefits any manufacturing SME intending to implement the initial and primary use of autonomous moving robots (AMR) in their factories. It also impacts manufacturing SMEs using legacy devices such as traditional PLCs by offering them intelligent strategies to incorporate current state-of-the-art technologies such as speech recognition to improve their performances. Our research empowers SMEs to adopt advanced and innovative technological concepts within their operations. |
| first_indexed | 2024-03-09T23:09:08Z |
| format | Article |
| id | doaj.art-bde5bd40c81e44ac94b180c9e6b8375c |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T23:09:08Z |
| publishDate | 2022-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-bde5bd40c81e44ac94b180c9e6b8375c2023-11-23T17:47:56ZengMDPI AGSensors1424-82202022-01-0122394110.3390/s22030941An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech RecognitionKahiomba Sonia Kiangala0Zenghui Wang1College of Science, Engineering and Technology (CSET), University of South Africa, Johannesburg 1710, South AfricaDepartment of Electrical and Mining Engineering, University of South Africa, Johannesburg 1710, South AfricaThe industrial manufacturing sector is undergoing a tremendous revolution moving from traditional production processes to intelligent techniques. Under this revolution, known as Industry 4.0 (I40), a robot is no longer static equipment but an active workforce to the factory production alongside human operators. Safety becomes crucial for humans and robots to ensure a smooth production run in such environments. The loss of operating moving robots in plant evacuation can be avoided with the adequate safety induction for them. Operators are subject to frequent safety inductions to react in emergencies, but very little is done for robots. Our research proposes an experimental safety response mechanism for a small manufacturing plant, through which an autonomous robot learns the obstacle-free trajectory to the closest safety exit in emergencies. We implement a reinforcement learning (RL) algorithm, Q-learning, to enable the path learning abilities of the robot. After obtaining the robot optimal path selection options with Q-learning, we code the outcome as a rule-based system for the safety response. We also program a speech recognition system for operators to react timeously, with a voice command, to an emergency that requires stopping all plant activities even when they are far away from the emergency stops (ESTOPs) button. An ESTOP or a voice command sent directly to the factory central controller can give the factory an emergency signal. We tested this functionality on real hardware from an S7-1200 Siemens programmable logic controller (PLC). We simulate a simple and small manufacturing environment overview to test our safety procedure. Our results show that the safety response mechanism successfully generates paths without obstacles to the closest safety exits from all the factory locations. Our research benefits any manufacturing SME intending to implement the initial and primary use of autonomous moving robots (AMR) in their factories. It also impacts manufacturing SMEs using legacy devices such as traditional PLCs by offering them intelligent strategies to incorporate current state-of-the-art technologies such as speech recognition to improve their performances. Our research empowers SMEs to adopt advanced and innovative technological concepts within their operations.https://www.mdpi.com/1424-8220/22/3/941autonomous moving robotobstacle-free path planningQ-learning algorithmreinforcement learning (RL)safety responsesmart manufacturing |
| spellingShingle | Kahiomba Sonia Kiangala Zenghui Wang An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition Sensors autonomous moving robot obstacle-free path planning Q-learning algorithm reinforcement learning (RL) safety response smart manufacturing |
| title | An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition |
| title_full | An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition |
| title_fullStr | An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition |
| title_full_unstemmed | An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition |
| title_short | An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition |
| title_sort | experimental safety response mechanism for an autonomous moving robot in a smart manufacturing environment using q learning algorithm and speech recognition |
| topic | autonomous moving robot obstacle-free path planning Q-learning algorithm reinforcement learning (RL) safety response smart manufacturing |
| url | https://www.mdpi.com/1424-8220/22/3/941 |
| work_keys_str_mv | AT kahiombasoniakiangala anexperimentalsafetyresponsemechanismforanautonomousmovingrobotinasmartmanufacturingenvironmentusingqlearningalgorithmandspeechrecognition AT zenghuiwang anexperimentalsafetyresponsemechanismforanautonomousmovingrobotinasmartmanufacturingenvironmentusingqlearningalgorithmandspeechrecognition AT kahiombasoniakiangala experimentalsafetyresponsemechanismforanautonomousmovingrobotinasmartmanufacturingenvironmentusingqlearningalgorithmandspeechrecognition AT zenghuiwang experimentalsafetyresponsemechanismforanautonomousmovingrobotinasmartmanufacturingenvironmentusingqlearningalgorithmandspeechrecognition |