Improvement of vision measurement system for cutting head position of boom-type roadheader

In the vision measurement system for cutting head position of cantilever roadheader based on infrared LED characteristics, the stability of external calibration and the accuracy of infrared LED spot center extraction have an important influence on the cutting head position detection accuracy. The ex...

Full description

Bibliographic Details
Main Authors: ZHANG Xuhui1,2, XIE Nan1, ZHANG Chao1, YANG Wenjuan1, ZHANG Kaixin1, ZHOU Chuang1
Format: Article
Language:zho
Published: Editorial Department of Industry and Mine Automation 2021-07-01
Series:Gong-kuang zidonghua
Subjects:
Online Access:http://www.gkzdh.cn/HTMLFiles/2021/7/%E5%B7%A5%E7%9F%BF%E8%87%AA%E5%8A%A8%E5%8C%96202107001.html
_version_ 1818652461932478464
author ZHANG Xuhui1,2
XIE Nan1
ZHANG Chao1
YANG Wenjuan1
ZHANG Kaixin1
ZHOU Chuang1
author_facet ZHANG Xuhui1,2
XIE Nan1
ZHANG Chao1
YANG Wenjuan1
ZHANG Kaixin1
ZHOU Chuang1
author_sort ZHANG Xuhui1,2
collection DOAJ
description In the vision measurement system for cutting head position of cantilever roadheader based on infrared LED characteristics, the stability of external calibration and the accuracy of infrared LED spot center extraction have an important influence on the cutting head position detection accuracy. The existing external parameter calibration method relies on experience to swing the cutting arm to the center position (unknown), and the calibration results have large fluctuations. In order to solve the above problem, a multi-point fixed external parameter calibration method is proposed. This method controls the cutting arm of the roadheader to swing to the four known limit positions of upper left corner, upper right corner, lower left corner and lower right corner respectively, and collects the target images. The method calculates the value of the external parameter matrix, which can improve the stability of the external parameter calibration effectively. The existing gray-scale centroid method uses the grayscale value of the pixel as the weight to calculate the spot centroid. And the accuracy can only reach the pixel level, which only roughly meets the practical application requirements. In order to solve this problem, a sub-pixel edge detection algorithm is proposed to improve the spot center extraction method. Firstly, the gray-scale centroid method is used for coarse extraction of the spot center. Secondly, the sub-pixel level edge detection algorithm is used to find the sub-pixel level edge coordinates. Finally, the least squares method is used to fit the spot center to achieve accurate extraction of the spot center. The experimental results show that the improved spot center extraction method reduces the maximum measurement error of the target LED lamp spacing from 3.2 mm to 1 mm, which improves the detection accuracy. The external parameter matrix obtained by the multi-point fixed external parameter calibration method is relatively stable, the maximum variation of displacement in the translation matrix is 15 mm, and the maximum variation of angle in the rotation matrix is 1°. Before the improvement of the vision measurement system, the measurement error of the cutting head swing angle was within [-1.2°,1.7°]. After the improvement, the error of the horizontal swing angle of the cutting head is within [-0.5°,0.5°] and the error of the vertical swing angle is within [-0.6°,0.6°]. The results show that the improved method improves the detection accuracy of the cutting head swing angle effectively.
first_indexed 2024-12-17T02:22:23Z
format Article
id doaj.art-09da6c3ad54b4d4e802777d893bb9b8c
institution Directory Open Access Journal
issn 1671-251X
language zho
last_indexed 2024-12-17T02:22:23Z
publishDate 2021-07-01
publisher Editorial Department of Industry and Mine Automation
record_format Article
series Gong-kuang zidonghua
spelling doaj.art-09da6c3ad54b4d4e802777d893bb9b8c2022-12-21T22:07:14ZzhoEditorial Department of Industry and Mine AutomationGong-kuang zidonghua1671-251X2021-07-014771710.13272/j.issn.1671-251x.2021010057Improvement of vision measurement system for cutting head position of boom-type roadheaderZHANG Xuhui1,20XIE Nan11ZHANG Chao12YANG Wenjuan13ZHANG Kaixin14ZHOU Chuang151.College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, China;2.Shaanxi Key Laboratory of Mine Electromechanical Equipment Intelligent Monitoring, Xi'an 710054, China1.College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, China;1.College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, China1.College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, China;1.College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, China1.College of Mechanical Engineering, Xi'an University of Science and Technology, Xi'an 710054, ChinaIn the vision measurement system for cutting head position of cantilever roadheader based on infrared LED characteristics, the stability of external calibration and the accuracy of infrared LED spot center extraction have an important influence on the cutting head position detection accuracy. The existing external parameter calibration method relies on experience to swing the cutting arm to the center position (unknown), and the calibration results have large fluctuations. In order to solve the above problem, a multi-point fixed external parameter calibration method is proposed. This method controls the cutting arm of the roadheader to swing to the four known limit positions of upper left corner, upper right corner, lower left corner and lower right corner respectively, and collects the target images. The method calculates the value of the external parameter matrix, which can improve the stability of the external parameter calibration effectively. The existing gray-scale centroid method uses the grayscale value of the pixel as the weight to calculate the spot centroid. And the accuracy can only reach the pixel level, which only roughly meets the practical application requirements. In order to solve this problem, a sub-pixel edge detection algorithm is proposed to improve the spot center extraction method. Firstly, the gray-scale centroid method is used for coarse extraction of the spot center. Secondly, the sub-pixel level edge detection algorithm is used to find the sub-pixel level edge coordinates. Finally, the least squares method is used to fit the spot center to achieve accurate extraction of the spot center. The experimental results show that the improved spot center extraction method reduces the maximum measurement error of the target LED lamp spacing from 3.2 mm to 1 mm, which improves the detection accuracy. The external parameter matrix obtained by the multi-point fixed external parameter calibration method is relatively stable, the maximum variation of displacement in the translation matrix is 15 mm, and the maximum variation of angle in the rotation matrix is 1°. Before the improvement of the vision measurement system, the measurement error of the cutting head swing angle was within [-1.2°,1.7°]. After the improvement, the error of the horizontal swing angle of the cutting head is within [-0.5°,0.5°] and the error of the vertical swing angle is within [-0.6°,0.6°]. The results show that the improved method improves the detection accuracy of the cutting head swing angle effectively.http://www.gkzdh.cn/HTMLFiles/2021/7/%E5%B7%A5%E7%9F%BF%E8%87%AA%E5%8A%A8%E5%8C%96202107001.htmlcantilever roadheader, cutting head position detection,explosion-proof industrial camera, vision measurement,external parameter calibration,spot center extraction
spellingShingle ZHANG Xuhui1,2
XIE Nan1
ZHANG Chao1
YANG Wenjuan1
ZHANG Kaixin1
ZHOU Chuang1
Improvement of vision measurement system for cutting head position of boom-type roadheader
Gong-kuang zidonghua
cantilever roadheader, cutting head position detection,explosion-proof industrial camera, vision measurement,external parameter calibration,spot center extraction
title Improvement of vision measurement system for cutting head position of boom-type roadheader
title_full Improvement of vision measurement system for cutting head position of boom-type roadheader
title_fullStr Improvement of vision measurement system for cutting head position of boom-type roadheader
title_full_unstemmed Improvement of vision measurement system for cutting head position of boom-type roadheader
title_short Improvement of vision measurement system for cutting head position of boom-type roadheader
title_sort improvement of vision measurement system for cutting head position of boom type roadheader
topic cantilever roadheader, cutting head position detection,explosion-proof industrial camera, vision measurement,external parameter calibration,spot center extraction
url http://www.gkzdh.cn/HTMLFiles/2021/7/%E5%B7%A5%E7%9F%BF%E8%87%AA%E5%8A%A8%E5%8C%96202107001.html
work_keys_str_mv AT zhangxuhui12 improvementofvisionmeasurementsystemforcuttingheadpositionofboomtyperoadheader
AT xienan1 improvementofvisionmeasurementsystemforcuttingheadpositionofboomtyperoadheader
AT zhangchao1 improvementofvisionmeasurementsystemforcuttingheadpositionofboomtyperoadheader
AT yangwenjuan1 improvementofvisionmeasurementsystemforcuttingheadpositionofboomtyperoadheader
AT zhangkaixin1 improvementofvisionmeasurementsystemforcuttingheadpositionofboomtyperoadheader
AT zhouchuang1 improvementofvisionmeasurementsystemforcuttingheadpositionofboomtyperoadheader