Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review

The realization of intelligent mining is the only method for realizing high-quality development in the coal industry. As the forefront working link in mine production, achieving automatic roadway tunneling control is key to improving production efficiency, enhancing intelligence, and reducing accide...

Full description

Bibliographic Details
Main Authors: Yuxin Du, He Zhang, Liang Liang, Jianhua Zhang, Bin Song
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10255651/
_version_ 1797672240785915904
author Yuxin Du
He Zhang
Liang Liang
Jianhua Zhang
Bin Song
author_facet Yuxin Du
He Zhang
Liang Liang
Jianhua Zhang
Bin Song
author_sort Yuxin Du
collection DOAJ
description The realization of intelligent mining is the only method for realizing high-quality development in the coal industry. As the forefront working link in mine production, achieving automatic roadway tunneling control is key to improving production efficiency, enhancing intelligence, and reducing accident rates at fully mechanized tunneling working faces. Among various detection techniques, machine vision technology stands out with advantages of non-contact measurement, rich information acquisition, and high detection accuracy. The detection and control of tunneling equipment groups based on machine vision has become a research hotspot in the intelligence process of coal mines. This study first introduces the key technologies of a visual detection system, including camera calibration, image preprocessing, feature extraction, visual matching, target segmentation and recognition, visual measurement, and 3D reconstruction. It then elaborates on detection principles, workflows, limitations, precautions, and development status of various vision detection systems in practical application scenarios at tunneling faces, such as tunneling equipments, anchoring systems, transportation systems, and safety auxiliary systems, which significantly improve production safety and efficiency. Finally, considering challenging work conditions and strong interference in mines, the successful adaptation of machine vision to excavation sites relies on addressing technical challenges related to poor environment adaptability, limited imaging field of view, and low intelligence level. Furthermore, according to existing research results and the current technical status, this paper forecasts key technologies that need to be developed in the future for coal mine intelligent equipment systems based on machine vision, including multi-sensor information fusion, equipment group collaborative control, and digital twin-driven remote monitoring.
first_indexed 2024-03-11T21:27:10Z
format Article
id doaj.art-b62ef43161d94347b050be3fb7c30260
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-11T21:27:10Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-b62ef43161d94347b050be3fb7c302602023-09-27T23:00:19ZengIEEEIEEE Access2169-35362023-01-011110287110289810.1109/ACCESS.2023.331704810255651Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A ReviewYuxin Du0He Zhang1Liang Liang2Jianhua Zhang3https://orcid.org/0009-0009-7276-8987Bin Song4School of Electrical and Control Engineering, Xuzhou University of Technology, Xuzhou, ChinaZhongwei (Jiangsu) Urban Construction Design Company Ltd., Xuzhou, ChinaSchool of Electrical and Control Engineering, Xuzhou University of Technology, Xuzhou, ChinaSchool of Electrical and Control Engineering, Xuzhou University of Technology, Xuzhou, ChinaSchool of Electrical and Control Engineering, Xuzhou University of Technology, Xuzhou, ChinaThe realization of intelligent mining is the only method for realizing high-quality development in the coal industry. As the forefront working link in mine production, achieving automatic roadway tunneling control is key to improving production efficiency, enhancing intelligence, and reducing accident rates at fully mechanized tunneling working faces. Among various detection techniques, machine vision technology stands out with advantages of non-contact measurement, rich information acquisition, and high detection accuracy. The detection and control of tunneling equipment groups based on machine vision has become a research hotspot in the intelligence process of coal mines. This study first introduces the key technologies of a visual detection system, including camera calibration, image preprocessing, feature extraction, visual matching, target segmentation and recognition, visual measurement, and 3D reconstruction. It then elaborates on detection principles, workflows, limitations, precautions, and development status of various vision detection systems in practical application scenarios at tunneling faces, such as tunneling equipments, anchoring systems, transportation systems, and safety auxiliary systems, which significantly improve production safety and efficiency. Finally, considering challenging work conditions and strong interference in mines, the successful adaptation of machine vision to excavation sites relies on addressing technical challenges related to poor environment adaptability, limited imaging field of view, and low intelligence level. Furthermore, according to existing research results and the current technical status, this paper forecasts key technologies that need to be developed in the future for coal mine intelligent equipment systems based on machine vision, including multi-sensor information fusion, equipment group collaborative control, and digital twin-driven remote monitoring.https://ieeexplore.ieee.org/document/10255651/Machine visioncoal machinery equipmentdetection and measurementroadway fully mechanized tunneling facesunmanned coal mine
spellingShingle Yuxin Du
He Zhang
Liang Liang
Jianhua Zhang
Bin Song
Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review
IEEE Access
Machine vision
coal machinery equipment
detection and measurement
roadway fully mechanized tunneling faces
unmanned coal mine
title Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review
title_full Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review
title_fullStr Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review
title_full_unstemmed Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review
title_short Applications of Machine Vision in Coal Mine Fully Mechanized Tunneling Faces: A Review
title_sort applications of machine vision in coal mine fully mechanized tunneling faces a review
topic Machine vision
coal machinery equipment
detection and measurement
roadway fully mechanized tunneling faces
unmanned coal mine
url https://ieeexplore.ieee.org/document/10255651/
work_keys_str_mv AT yuxindu applicationsofmachinevisionincoalminefullymechanizedtunnelingfacesareview
AT hezhang applicationsofmachinevisionincoalminefullymechanizedtunnelingfacesareview
AT liangliang applicationsofmachinevisionincoalminefullymechanizedtunnelingfacesareview
AT jianhuazhang applicationsofmachinevisionincoalminefullymechanizedtunnelingfacesareview
AT binsong applicationsofmachinevisionincoalminefullymechanizedtunnelingfacesareview