Instance segmentation using semi-supervised learning for fire recognition
Fire disaster brings enormous danger to the safety of human life and property, and it is important to identify the fire situation in time through image processing technology. The current instance segmentation algorithms suffer from problems such as inadequate fire images and annotations, low recogni...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-12-01
|
| Series: | Heliyon |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2405844022036635 |
| _version_ | 1797960894686167040 |
|---|---|
| author | Guangmin Sun Yuxuan Wen Yu Li |
| author_facet | Guangmin Sun Yuxuan Wen Yu Li |
| author_sort | Guangmin Sun |
| collection | DOAJ |
| description | Fire disaster brings enormous danger to the safety of human life and property, and it is important to identify the fire situation in time through image processing technology. The current instance segmentation algorithms suffer from problems such as inadequate fire images and annotations, low recognition accuracy, and slow inference speed for fire recognition tasks. In this paper, we propose a semi-supervised learning-based fire instance segmentation method based on deep learning image processing technology. We used a lightweight version of the SOLOv2 network and optimized the network structure to improve accuracy. We propose a semi-supervised learning method based on fire features. To reduce the negative impact of error pseudo-labels on the model training, the pseudo-labels are matched by the color and morphological features of flames and smoke at the pseudo-label generation stage, and some images are screened for strong image enhancement before entering the next round of training for the student model. We further exploit the potential of the model with a limited dataset and improve the model accuracy without affecting the inference efficiency of the model. Experiments show that our proposed algorithm can successfully improve the accuracy of fire instance segmentation with good inference speed. |
| first_indexed | 2024-04-11T00:51:08Z |
| format | Article |
| id | doaj.art-67a1a265870e4cbe8ed3fe552e8f490d |
| institution | Directory Open Access Journal |
| issn | 2405-8440 |
| language | English |
| last_indexed | 2024-04-11T00:51:08Z |
| publishDate | 2022-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Heliyon |
| spelling | doaj.art-67a1a265870e4cbe8ed3fe552e8f490d2023-01-05T08:40:10ZengElsevierHeliyon2405-84402022-12-01812e12375Instance segmentation using semi-supervised learning for fire recognitionGuangmin Sun0Yuxuan Wen1Yu Li2Corresponding author.; Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, ChinaFaculty of Information Technology, Beijing University of Technology, Beijing, 100124, ChinaFaculty of Information Technology, Beijing University of Technology, Beijing, 100124, ChinaFire disaster brings enormous danger to the safety of human life and property, and it is important to identify the fire situation in time through image processing technology. The current instance segmentation algorithms suffer from problems such as inadequate fire images and annotations, low recognition accuracy, and slow inference speed for fire recognition tasks. In this paper, we propose a semi-supervised learning-based fire instance segmentation method based on deep learning image processing technology. We used a lightweight version of the SOLOv2 network and optimized the network structure to improve accuracy. We propose a semi-supervised learning method based on fire features. To reduce the negative impact of error pseudo-labels on the model training, the pseudo-labels are matched by the color and morphological features of flames and smoke at the pseudo-label generation stage, and some images are screened for strong image enhancement before entering the next round of training for the student model. We further exploit the potential of the model with a limited dataset and improve the model accuracy without affecting the inference efficiency of the model. Experiments show that our proposed algorithm can successfully improve the accuracy of fire instance segmentation with good inference speed.http://www.sciencedirect.com/science/article/pii/S2405844022036635Fire image recognitionInstance segmentationDeep learningSemi-supervised learningSelf-training |
| spellingShingle | Guangmin Sun Yuxuan Wen Yu Li Instance segmentation using semi-supervised learning for fire recognition Heliyon Fire image recognition Instance segmentation Deep learning Semi-supervised learning Self-training |
| title | Instance segmentation using semi-supervised learning for fire recognition |
| title_full | Instance segmentation using semi-supervised learning for fire recognition |
| title_fullStr | Instance segmentation using semi-supervised learning for fire recognition |
| title_full_unstemmed | Instance segmentation using semi-supervised learning for fire recognition |
| title_short | Instance segmentation using semi-supervised learning for fire recognition |
| title_sort | instance segmentation using semi supervised learning for fire recognition |
| topic | Fire image recognition Instance segmentation Deep learning Semi-supervised learning Self-training |
| url | http://www.sciencedirect.com/science/article/pii/S2405844022036635 |
| work_keys_str_mv | AT guangminsun instancesegmentationusingsemisupervisedlearningforfirerecognition AT yuxuanwen instancesegmentationusingsemisupervisedlearningforfirerecognition AT yuli instancesegmentationusingsemisupervisedlearningforfirerecognition |