Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation

Conflagration is the major safety issue of electric vehicles (EVs). Due to their well-kept appearance and structure, which demonstrate salient visual changes after combustion, EV bodies are recognized as an important basis for on-spot inspection of burnt EVs and make application using semantic segme...

Full description

Bibliographic Details
Main Authors: Jiankun Pu, Wei Zhang
Format: Article
Language:English
Published: MDPI AG 2022-05-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/11/11/1738
_version_ 1797493709964574720
author Jiankun Pu
Wei Zhang
author_facet Jiankun Pu
Wei Zhang
author_sort Jiankun Pu
collection DOAJ
description Conflagration is the major safety issue of electric vehicles (EVs). Due to their well-kept appearance and structure, which demonstrate salient visual changes after combustion, EV bodies are recognized as an important basis for on-spot inspection of burnt EVs and make application using semantic segmentation possible. The combination of deep learning-based semantic segmentation and recognition of visual traces of burnt EVs would provide preliminary analytical results of fire spread trends and output status descriptions of burnt EVs for further investigation. In this paper, a dataset of image traces of burnt EVs was built, and a two-branch network structure that splits the whole task into two sub-tasks separately concentrated on foreground extraction and severity segmentation is proposed. The proposed network is trained on the dataset via the transfer learning method and is tested using 5-fold cross validation. The foreground extraction branch achieved a mean intersection over union (mIoU) of 95.16% in the burnt EV foreground extraction task, and the burnt severity branch achieved a mIoU of 66.96% for the severity segmentation task. By jointly training two branches and applying a foreground mask to 3-class severity output, the mIoU was improved to 68.92%.
first_indexed 2024-03-10T01:23:57Z
format Article
id doaj.art-7d24ff50ff9543ab81aec8f845510d16
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-10T01:23:57Z
publishDate 2022-05-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-7d24ff50ff9543ab81aec8f845510d162023-11-23T13:55:06ZengMDPI AGElectronics2079-92922022-05-011111173810.3390/electronics11111738Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic SegmentationJiankun Pu0Wei Zhang1School of Microelectronics, Tianjin University, Tianjin 300072, ChinaSchool of Microelectronics, Tianjin University, Tianjin 300072, ChinaConflagration is the major safety issue of electric vehicles (EVs). Due to their well-kept appearance and structure, which demonstrate salient visual changes after combustion, EV bodies are recognized as an important basis for on-spot inspection of burnt EVs and make application using semantic segmentation possible. The combination of deep learning-based semantic segmentation and recognition of visual traces of burnt EVs would provide preliminary analytical results of fire spread trends and output status descriptions of burnt EVs for further investigation. In this paper, a dataset of image traces of burnt EVs was built, and a two-branch network structure that splits the whole task into two sub-tasks separately concentrated on foreground extraction and severity segmentation is proposed. The proposed network is trained on the dataset via the transfer learning method and is tested using 5-fold cross validation. The foreground extraction branch achieved a mean intersection over union (mIoU) of 95.16% in the burnt EV foreground extraction task, and the burnt severity branch achieved a mIoU of 66.96% for the severity segmentation task. By jointly training two branches and applying a foreground mask to 3-class severity output, the mIoU was improved to 68.92%.https://www.mdpi.com/2079-9292/11/11/1738deep learningsemantic segmentationelectric vehicle fire
spellingShingle Jiankun Pu
Wei Zhang
Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation
Electronics
deep learning
semantic segmentation
electric vehicle fire
title Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation
title_full Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation
title_fullStr Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation
title_full_unstemmed Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation
title_short Electric Vehicle Fire Trace Recognition Based on Multi-Task Semantic Segmentation
title_sort electric vehicle fire trace recognition based on multi task semantic segmentation
topic deep learning
semantic segmentation
electric vehicle fire
url https://www.mdpi.com/2079-9292/11/11/1738
work_keys_str_mv AT jiankunpu electricvehiclefiretracerecognitionbasedonmultitasksemanticsegmentation
AT weizhang electricvehiclefiretracerecognitionbasedonmultitasksemanticsegmentation