Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection

The existing ultrasonic obstacle avoidance robot only uses an ultrasonic sensor in the process of obstacle avoidance, which can only be avoided according to the fixed obstacle avoidance route. Obstacle avoidance cannot follow additional information. At the same time, existing robots rarely involve t...

Full description

Bibliographic Details
Main Authors: Jianwei Zhao, Jianhua Fang, Shouzhong Wang, Kun Wang, Chengxiang Liu, Tao Han
Format: Article
Language:English
Published: MDPI AG 2021-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/20/6777
_version_ 1797513181984194560
author Jianwei Zhao
Jianhua Fang
Shouzhong Wang
Kun Wang
Chengxiang Liu
Tao Han
author_facet Jianwei Zhao
Jianhua Fang
Shouzhong Wang
Kun Wang
Chengxiang Liu
Tao Han
author_sort Jianwei Zhao
collection DOAJ
description The existing ultrasonic obstacle avoidance robot only uses an ultrasonic sensor in the process of obstacle avoidance, which can only be avoided according to the fixed obstacle avoidance route. Obstacle avoidance cannot follow additional information. At the same time, existing robots rarely involve the obstacle avoidance strategy of avoiding pits. In this study, on the basis of ultrasonic sensor obstacle avoidance, visual information is added so the robot in the process of obstacle avoidance can refer to the direction indicated by road signs to avoid obstacles, at the same time, the study added an infrared ranging sensor, so the robot can avoid potholes. Aiming at this situation, this paper proposes an intelligent obstacle avoidance design of an autonomous mobile robot based on a multi-sensor in a multi-obstruction environment. A CascadeClassifier is used to train positive and negative samples for road signs with similar color and shape. A multi-sensor information fusion is used for path planning and the obstacle avoidance logic of the intelligent robot is designed to realize autonomous obstacle avoidance. The infrared sensor is used to obtain the environmental information of the ground depression on the wheel path, the ultrasonic sensor is used to obtain the distance information of the surrounding obstacles and road signs, and the information of the road signs obtained by the camera is processed by the computer and transmitted to the main controller. The environment information obtained is processed by the microprocessor and the control command is output to the execution unit. The feasibility of the design is verified by analyzing the distance acquired by the ultrasonic sensor, infrared distance measuring sensors, and the model obtained by training the sample of the road sign, as well as by experiments in the complex environment constructed manually.
first_indexed 2024-03-10T06:13:03Z
format Article
id doaj.art-27db42d6574048779ede77dda8352a72
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T06:13:03Z
publishDate 2021-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-27db42d6574048779ede77dda8352a722023-11-22T19:57:18ZengMDPI AGSensors1424-82202021-10-012120677710.3390/s21206777Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign DetectionJianwei Zhao0Jianhua Fang1Shouzhong Wang2Kun Wang3Chengxiang Liu4Tao Han5School of Mechatronic Engineering, China University of Mining and Technology, Beijing 100089, ChinaSchool of Mechatronic Engineering, China University of Mining and Technology, Beijing 100089, ChinaBeijing Special Engineering and Design Institute, Beijing 100028, ChinaSchool of Mechatronic Engineering, China University of Mining and Technology, Beijing 100089, ChinaSchool of Mechatronic Engineering, China University of Mining and Technology, Beijing 100089, ChinaSchool of Mechatronic Engineering, China University of Mining and Technology, Beijing 100089, ChinaThe existing ultrasonic obstacle avoidance robot only uses an ultrasonic sensor in the process of obstacle avoidance, which can only be avoided according to the fixed obstacle avoidance route. Obstacle avoidance cannot follow additional information. At the same time, existing robots rarely involve the obstacle avoidance strategy of avoiding pits. In this study, on the basis of ultrasonic sensor obstacle avoidance, visual information is added so the robot in the process of obstacle avoidance can refer to the direction indicated by road signs to avoid obstacles, at the same time, the study added an infrared ranging sensor, so the robot can avoid potholes. Aiming at this situation, this paper proposes an intelligent obstacle avoidance design of an autonomous mobile robot based on a multi-sensor in a multi-obstruction environment. A CascadeClassifier is used to train positive and negative samples for road signs with similar color and shape. A multi-sensor information fusion is used for path planning and the obstacle avoidance logic of the intelligent robot is designed to realize autonomous obstacle avoidance. The infrared sensor is used to obtain the environmental information of the ground depression on the wheel path, the ultrasonic sensor is used to obtain the distance information of the surrounding obstacles and road signs, and the information of the road signs obtained by the camera is processed by the computer and transmitted to the main controller. The environment information obtained is processed by the microprocessor and the control command is output to the execution unit. The feasibility of the design is verified by analyzing the distance acquired by the ultrasonic sensor, infrared distance measuring sensors, and the model obtained by training the sample of the road sign, as well as by experiments in the complex environment constructed manually.https://www.mdpi.com/1424-8220/21/20/6777intelligent robotmulti sensorAdaboostobstacle avoidanceobject detection
spellingShingle Jianwei Zhao
Jianhua Fang
Shouzhong Wang
Kun Wang
Chengxiang Liu
Tao Han
Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection
Sensors
intelligent robot
multi sensor
Adaboost
obstacle avoidance
object detection
title Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection
title_full Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection
title_fullStr Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection
title_full_unstemmed Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection
title_short Obstacle Avoidance of Multi-Sensor Intelligent Robot Based on Road Sign Detection
title_sort obstacle avoidance of multi sensor intelligent robot based on road sign detection
topic intelligent robot
multi sensor
Adaboost
obstacle avoidance
object detection
url https://www.mdpi.com/1424-8220/21/20/6777
work_keys_str_mv AT jianweizhao obstacleavoidanceofmultisensorintelligentrobotbasedonroadsigndetection
AT jianhuafang obstacleavoidanceofmultisensorintelligentrobotbasedonroadsigndetection
AT shouzhongwang obstacleavoidanceofmultisensorintelligentrobotbasedonroadsigndetection
AT kunwang obstacleavoidanceofmultisensorintelligentrobotbasedonroadsigndetection
AT chengxiangliu obstacleavoidanceofmultisensorintelligentrobotbasedonroadsigndetection
AT taohan obstacleavoidanceofmultisensorintelligentrobotbasedonroadsigndetection