A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition

Detection of the loading volume of mining trucks is an important task in open pit mining. Aiming at the addressing the current problems of low accuracy and high cost of the detection of the loading volume of mining trucks, this paper proposes a mining truck loading volume detection model based on de...

Full description

Bibliographic Details
Main Authors: Xiaoyu Sun, Xuerao Li, Dong Xiao, Yu Chen, Baohua Wang
Format: Article
Language:English
Published: MDPI AG 2021-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/2/635
_version_ 1827600077125844992
author Xiaoyu Sun
Xuerao Li
Dong Xiao
Yu Chen
Baohua Wang
author_facet Xiaoyu Sun
Xuerao Li
Dong Xiao
Yu Chen
Baohua Wang
author_sort Xiaoyu Sun
collection DOAJ
description Detection of the loading volume of mining trucks is an important task in open pit mining. Aiming at the addressing the current problems of low accuracy and high cost of the detection of the loading volume of mining trucks, this paper proposes a mining truck loading volume detection model based on deep learning and image recognition. The training and test data of the model consists of 6000 sets of images taken in a laboratory environment. After image preprocessing, the VGG16 network model is used to pre classify the ore images. The classification results are displayed and the possibility of each category is determined. Then, the loading volume of mining trucks is calculated by using the classification results and the least squares algorithm. By using the labeled image data of five kinds of mining truck loading volume, the arbitrary loading volume detection of mining trucks is realized, which effectively solves the problem of a lack of labeled data types caused by the difficulty in obtaining mine data. Root mean square error (RMSE) and mean absolute error (MAE) are used to evaluate the fitting effect of the model. The experimental results show that the model has high prediction accuracy. The average absolute error is 17.85 <inline-formula><math display="inline"><semantics><mrow><msup><mrow><mrow><mi>cm</mi></mrow></mrow><mn>3</mn></msup></mrow></semantics></math></inline-formula>. In addition, this paper uses 400 real mining truck images of open-pit mines to verify the model and the average absolute error is 2.53 <inline-formula><math display="inline"><semantics><mrow><msup><mi mathvariant="normal">m</mi><mn>3</mn></msup></mrow></semantics></math></inline-formula>. The experimental results show that the model has good generality and can be applied well to the actual production of open-pit mines.
first_indexed 2024-03-09T04:27:52Z
format Article
id doaj.art-831148b230bc4b1ba3819e1b44fcc861
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T04:27:52Z
publishDate 2021-01-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-831148b230bc4b1ba3819e1b44fcc8612023-12-03T13:38:37ZengMDPI AGSensors1424-82202021-01-0121263510.3390/s21020635A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image RecognitionXiaoyu Sun0Xuerao Li1Dong Xiao2Yu Chen3Baohua Wang4School of Resources and Civil Engineering, Northeastern University, Shenyang 110004, ChinaSchool of Resources and Civil Engineering, Northeastern University, Shenyang 110004, ChinaInformation Science and Engineering School, Northeastern University, Shenyang 110004, ChinaSchool of Resources and Civil Engineering, Northeastern University, Shenyang 110004, ChinaSchool of Resources and Civil Engineering, Northeastern University, Shenyang 110004, ChinaDetection of the loading volume of mining trucks is an important task in open pit mining. Aiming at the addressing the current problems of low accuracy and high cost of the detection of the loading volume of mining trucks, this paper proposes a mining truck loading volume detection model based on deep learning and image recognition. The training and test data of the model consists of 6000 sets of images taken in a laboratory environment. After image preprocessing, the VGG16 network model is used to pre classify the ore images. The classification results are displayed and the possibility of each category is determined. Then, the loading volume of mining trucks is calculated by using the classification results and the least squares algorithm. By using the labeled image data of five kinds of mining truck loading volume, the arbitrary loading volume detection of mining trucks is realized, which effectively solves the problem of a lack of labeled data types caused by the difficulty in obtaining mine data. Root mean square error (RMSE) and mean absolute error (MAE) are used to evaluate the fitting effect of the model. The experimental results show that the model has high prediction accuracy. The average absolute error is 17.85 <inline-formula><math display="inline"><semantics><mrow><msup><mrow><mrow><mi>cm</mi></mrow></mrow><mn>3</mn></msup></mrow></semantics></math></inline-formula>. In addition, this paper uses 400 real mining truck images of open-pit mines to verify the model and the average absolute error is 2.53 <inline-formula><math display="inline"><semantics><mrow><msup><mi mathvariant="normal">m</mi><mn>3</mn></msup></mrow></semantics></math></inline-formula>. The experimental results show that the model has good generality and can be applied well to the actual production of open-pit mines.https://www.mdpi.com/1424-8220/21/2/635open pit mineloading volumeimage recognitionVGG16least square algorithm
spellingShingle Xiaoyu Sun
Xuerao Li
Dong Xiao
Yu Chen
Baohua Wang
A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition
Sensors
open pit mine
loading volume
image recognition
VGG16
least square algorithm
title A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition
title_full A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition
title_fullStr A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition
title_full_unstemmed A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition
title_short A Method of Mining Truck Loading Volume Detection Based on Deep Learning and Image Recognition
title_sort method of mining truck loading volume detection based on deep learning and image recognition
topic open pit mine
loading volume
image recognition
VGG16
least square algorithm
url https://www.mdpi.com/1424-8220/21/2/635
work_keys_str_mv AT xiaoyusun amethodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT xueraoli amethodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT dongxiao amethodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT yuchen amethodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT baohuawang amethodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT xiaoyusun methodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT xueraoli methodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT dongxiao methodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT yuchen methodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition
AT baohuawang methodofminingtruckloadingvolumedetectionbasedondeeplearningandimagerecognition