Study on recognition of coal and gangue based on multimode feature and image fusion.

Aiming at the problems of low accuracy of coal gangue recognition and difficult recognition of mixed gangue rate, a coal rock recognition method based on modal fusion of RGB and infrared is proposed. A fully mechanized coal gangue transportation test bed is built, RGB images are obtained by camera,...

Full description

Bibliographic Details
Main Authors: Lijuan Zhao, Liguo Han, Haining Zhang, Zifeng Liu, Feng Gao, Shijie Yang, Yadong Wang
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2023-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0281397
_version_ 1797924653596934144
author Lijuan Zhao
Liguo Han
Haining Zhang
Zifeng Liu
Feng Gao
Shijie Yang
Yadong Wang
author_facet Lijuan Zhao
Liguo Han
Haining Zhang
Zifeng Liu
Feng Gao
Shijie Yang
Yadong Wang
author_sort Lijuan Zhao
collection DOAJ
description Aiming at the problems of low accuracy of coal gangue recognition and difficult recognition of mixed gangue rate, a coal rock recognition method based on modal fusion of RGB and infrared is proposed. A fully mechanized coal gangue transportation test bed is built, RGB images are obtained by camera, and infrared images are obtained by industrial microwave heating system and infrared thermal imager. the image data of the whole coal, whole gangue, and coal gangue with different gangue mixing as training and test samples, identify the released coal gangue and its mixing rate. The AlexNet, VGG-16, ResNet-18 classification networks and their convolutional neural networks with modal feature fusion are constructed. results: The classification accuracy of ResNet networks on RGB and infrared image data is higher than AlexNet and VGG-16 networks. The early convergence network performance of ResNet is verified through the convergence of different models. The recognition rate of the network is 97.92 the confusion matrix statistics, which verifies the feasibility of the application of modal fusion method in the field of coal gangue recognition. The fusion of modal features and early models of ResNet coal gangue, which is the basic premise for realizing intelligent coal caving.
first_indexed 2024-04-10T15:05:28Z
format Article
id doaj.art-81139e9becb44cdb8fab574e45fd3bdd
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-04-10T15:05:28Z
publishDate 2023-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-81139e9becb44cdb8fab574e45fd3bdd2023-02-15T05:31:08ZengPublic Library of Science (PLoS)PLoS ONE1932-62032023-01-01182e028139710.1371/journal.pone.0281397Study on recognition of coal and gangue based on multimode feature and image fusion.Lijuan ZhaoLiguo HanHaining ZhangZifeng LiuFeng GaoShijie YangYadong WangAiming at the problems of low accuracy of coal gangue recognition and difficult recognition of mixed gangue rate, a coal rock recognition method based on modal fusion of RGB and infrared is proposed. A fully mechanized coal gangue transportation test bed is built, RGB images are obtained by camera, and infrared images are obtained by industrial microwave heating system and infrared thermal imager. the image data of the whole coal, whole gangue, and coal gangue with different gangue mixing as training and test samples, identify the released coal gangue and its mixing rate. The AlexNet, VGG-16, ResNet-18 classification networks and their convolutional neural networks with modal feature fusion are constructed. results: The classification accuracy of ResNet networks on RGB and infrared image data is higher than AlexNet and VGG-16 networks. The early convergence network performance of ResNet is verified through the convergence of different models. The recognition rate of the network is 97.92 the confusion matrix statistics, which verifies the feasibility of the application of modal fusion method in the field of coal gangue recognition. The fusion of modal features and early models of ResNet coal gangue, which is the basic premise for realizing intelligent coal caving.https://doi.org/10.1371/journal.pone.0281397
spellingShingle Lijuan Zhao
Liguo Han
Haining Zhang
Zifeng Liu
Feng Gao
Shijie Yang
Yadong Wang
Study on recognition of coal and gangue based on multimode feature and image fusion.
PLoS ONE
title Study on recognition of coal and gangue based on multimode feature and image fusion.
title_full Study on recognition of coal and gangue based on multimode feature and image fusion.
title_fullStr Study on recognition of coal and gangue based on multimode feature and image fusion.
title_full_unstemmed Study on recognition of coal and gangue based on multimode feature and image fusion.
title_short Study on recognition of coal and gangue based on multimode feature and image fusion.
title_sort study on recognition of coal and gangue based on multimode feature and image fusion
url https://doi.org/10.1371/journal.pone.0281397
work_keys_str_mv AT lijuanzhao studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion
AT liguohan studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion
AT hainingzhang studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion
AT zifengliu studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion
AT fenggao studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion
AT shijieyang studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion
AT yadongwang studyonrecognitionofcoalandganguebasedonmultimodefeatureandimagefusion