Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods

This study integrates path planning, fuzzy theory, neural networks, image processing, range sensors, webcam, global navigation satellite system (GNSS), and real-time kinematic (RTK) positioning system into an intelligent wheeled mobile robot (WMR) for outdoor patrolling. The robot system uses ultras...

Full description

Bibliographic Details
Main Authors: Wu-Chiang Chang, Jih-Gau Juang
Format: Article
Language:English
Published: MDPI AG 2021-09-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/11/19/8857
_version_ 1827680990587256832
author Wu-Chiang Chang
Jih-Gau Juang
author_facet Wu-Chiang Chang
Jih-Gau Juang
author_sort Wu-Chiang Chang
collection DOAJ
description This study integrates path planning, fuzzy theory, neural networks, image processing, range sensors, webcam, global navigation satellite system (GNSS), and real-time kinematic (RTK) positioning system into an intelligent wheeled mobile robot (WMR) for outdoor patrolling. The robot system uses ultrasound sensors, laser sensors, and fuzzy controllers to detect obstacles and avoid them. The starting position and the goal position of the WMR in an outdoor environment are given by the GNSS RTK positioning system. Real-time position correction of the robot is performed through the differential global positioning system. The robot system applies the ant algorithm and the Dijkstra algorithm to find the shortest path for patrol tasks. The convolutional neural network image processing is utilized to identify intruders that are appearing in the patrol path. When the WMR detects an intruder by the face detection and recognition methods, the robot captures the photo of this person by the webcam and acquires the location information of this person by the RTK positioning system. Then the WMR sends the location and photo of the intruder to the control center by Wi-Fi and asks for help.
first_indexed 2024-03-10T07:07:04Z
format Article
id doaj.art-cc0594ff64234dfca9605ed707763f3f
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T07:07:04Z
publishDate 2021-09-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-cc0594ff64234dfca9605ed707763f3f2023-11-22T15:44:02ZengMDPI AGApplied Sciences2076-34172021-09-011119885710.3390/app11198857Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition MethodsWu-Chiang Chang0Jih-Gau Juang1Department of Communications, Navigation and Control Engineering, National Taiwan Ocean University, Keelung 202, TaiwanDepartment of Communications, Navigation and Control Engineering, National Taiwan Ocean University, Keelung 202, TaiwanThis study integrates path planning, fuzzy theory, neural networks, image processing, range sensors, webcam, global navigation satellite system (GNSS), and real-time kinematic (RTK) positioning system into an intelligent wheeled mobile robot (WMR) for outdoor patrolling. The robot system uses ultrasound sensors, laser sensors, and fuzzy controllers to detect obstacles and avoid them. The starting position and the goal position of the WMR in an outdoor environment are given by the GNSS RTK positioning system. Real-time position correction of the robot is performed through the differential global positioning system. The robot system applies the ant algorithm and the Dijkstra algorithm to find the shortest path for patrol tasks. The convolutional neural network image processing is utilized to identify intruders that are appearing in the patrol path. When the WMR detects an intruder by the face detection and recognition methods, the robot captures the photo of this person by the webcam and acquires the location information of this person by the RTK positioning system. Then the WMR sends the location and photo of the intruder to the control center by Wi-Fi and asks for help.https://www.mdpi.com/2076-3417/11/19/8857image processingfuzzy theoryGNSSrange sensorpath planning
spellingShingle Wu-Chiang Chang
Jih-Gau Juang
Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods
Applied Sciences
image processing
fuzzy theory
GNSS
range sensor
path planning
title Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods
title_full Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods
title_fullStr Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods
title_full_unstemmed Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods
title_short Automatic Outdoor Patrol Robot Based on Sensor Fusion and Face Recognition Methods
title_sort automatic outdoor patrol robot based on sensor fusion and face recognition methods
topic image processing
fuzzy theory
GNSS
range sensor
path planning
url https://www.mdpi.com/2076-3417/11/19/8857
work_keys_str_mv AT wuchiangchang automaticoutdoorpatrolrobotbasedonsensorfusionandfacerecognitionmethods
AT jihgaujuang automaticoutdoorpatrolrobotbasedonsensorfusionandfacerecognitionmethods