Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM

The belt surface of the mine belt conveyor can cause serious wear under the condition of long-term high-load operation, which can have a negative impact on production, bring economic losses, even endanger personal safety, and cause serious production accidents. Manual detection requires a lot of man...

Full description

Bibliographic Details
Main Authors: Lijie Yang, Guangyu Chen, Jiehui Liu, Jinxi Guo
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10428009/
_version_ 1827344925958602752
author Lijie Yang
Guangyu Chen
Jiehui Liu
Jinxi Guo
author_facet Lijie Yang
Guangyu Chen
Jiehui Liu
Jinxi Guo
author_sort Lijie Yang
collection DOAJ
description The belt surface of the mine belt conveyor can cause serious wear under the condition of long-term high-load operation, which can have a negative impact on production, bring economic losses, even endanger personal safety, and cause serious production accidents. Manual detection requires a lot of manpower and material resources, and is highly dependent on empirical judgment, which is with low efficiency and security risks. Therefore, in this study, we introduce a new conveyor belt wear detection algorithm Retinex-YOLOv8-EfficientNet-NAM (RYEN algorithm) based on deep learning and machine vision technology to replace manual detection, improving detection efficiency and recognition accuracy. The wear degree of belt is reclassified and defined according to the mechanical properties and wear texture characteristics of belt with different wear degrees, and a new special data set for belt wear detection is established. Aiming at the low brightness, high noise and complex working conditions of the underground mine, Gaussian filtering and bilateral filtering are used as the central surround function of the improved Retinex algorithm, and then channel fusion is performed with the image after histogram equalization and adaptive brightness adjustment. The improved Retinex multi-image fusion algorithm is used to preprocess the collected image. EfficientNet has the performance of reasonably allocating the input resolution, network depth, and channel width, and can maximize the performance of the network with limited resources. EfficientNet is used to replace Darknet53 of YOLOv8 as the backbone of the feature extraction network, which improves the detection accuracy under limited computing resources. A lightweight attention module NAM is added to the improved network, which improves the detection speed without reducing the detection accuracy. Experimental results show that RYEN algorithm effectively maintains the smoothness of the image during the image preprocessing stage, improves the brightness and contrast of the image, and better preserves the edge information of the image. RYEN algorithm achieves a detection speed of 66FPS and an average accuracy of 98.57%. Compared with the original YOLOv8 algorithm, the accuracy of RYEN algorithm is increased by 6.4% and the speed is increased by 13.2%. In comparison experiments with similar methods, RYEN algorithm occupies less hardware resources, has strong generalization ability, good performance, and has high detection speed and accuracy.
first_indexed 2024-03-07T22:57:37Z
format Article
id doaj.art-d36affce6f284170949fac2f40146350
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-07T22:57:37Z
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-d36affce6f284170949fac2f401463502024-02-23T00:00:41ZengIEEEIEEE Access2169-35362024-01-0112253092532410.1109/ACCESS.2024.336383410428009Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAMLijie Yang0Guangyu Chen1https://orcid.org/0009-0003-2705-1422Jiehui Liu2Jinxi Guo3School of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaSchool of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaSchool of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaSchool of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan, ChinaThe belt surface of the mine belt conveyor can cause serious wear under the condition of long-term high-load operation, which can have a negative impact on production, bring economic losses, even endanger personal safety, and cause serious production accidents. Manual detection requires a lot of manpower and material resources, and is highly dependent on empirical judgment, which is with low efficiency and security risks. Therefore, in this study, we introduce a new conveyor belt wear detection algorithm Retinex-YOLOv8-EfficientNet-NAM (RYEN algorithm) based on deep learning and machine vision technology to replace manual detection, improving detection efficiency and recognition accuracy. The wear degree of belt is reclassified and defined according to the mechanical properties and wear texture characteristics of belt with different wear degrees, and a new special data set for belt wear detection is established. Aiming at the low brightness, high noise and complex working conditions of the underground mine, Gaussian filtering and bilateral filtering are used as the central surround function of the improved Retinex algorithm, and then channel fusion is performed with the image after histogram equalization and adaptive brightness adjustment. The improved Retinex multi-image fusion algorithm is used to preprocess the collected image. EfficientNet has the performance of reasonably allocating the input resolution, network depth, and channel width, and can maximize the performance of the network with limited resources. EfficientNet is used to replace Darknet53 of YOLOv8 as the backbone of the feature extraction network, which improves the detection accuracy under limited computing resources. A lightweight attention module NAM is added to the improved network, which improves the detection speed without reducing the detection accuracy. Experimental results show that RYEN algorithm effectively maintains the smoothness of the image during the image preprocessing stage, improves the brightness and contrast of the image, and better preserves the edge information of the image. RYEN algorithm achieves a detection speed of 66FPS and an average accuracy of 98.57%. Compared with the original YOLOv8 algorithm, the accuracy of RYEN algorithm is increased by 6.4% and the speed is increased by 13.2%. In comparison experiments with similar methods, RYEN algorithm occupies less hardware resources, has strong generalization ability, good performance, and has high detection speed and accuracy.https://ieeexplore.ieee.org/document/10428009/Conveyor belt wear inspectionRetinex-YOLOv8-EfficientNet-NAMmachine visiondeep learningYOLOv8
spellingShingle Lijie Yang
Guangyu Chen
Jiehui Liu
Jinxi Guo
Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM
IEEE Access
Conveyor belt wear inspection
Retinex-YOLOv8-EfficientNet-NAM
machine vision
deep learning
YOLOv8
title Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM
title_full Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM
title_fullStr Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM
title_full_unstemmed Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM
title_short Wear State Detection of Conveyor Belt in Underground Mine Based on Retinex- YOLOv8-EfficientNet-NAM
title_sort wear state detection of conveyor belt in underground mine based on retinex yolov8 efficientnet nam
topic Conveyor belt wear inspection
Retinex-YOLOv8-EfficientNet-NAM
machine vision
deep learning
YOLOv8
url https://ieeexplore.ieee.org/document/10428009/
work_keys_str_mv AT lijieyang wearstatedetectionofconveyorbeltinundergroundminebasedonretinexyolov8efficientnetnam
AT guangyuchen wearstatedetectionofconveyorbeltinundergroundminebasedonretinexyolov8efficientnetnam
AT jiehuiliu wearstatedetectionofconveyorbeltinundergroundminebasedonretinexyolov8efficientnetnam
AT jinxiguo wearstatedetectionofconveyorbeltinundergroundminebasedonretinexyolov8efficientnetnam