Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios

In this study, we propose using a thermal imaging camera (TIC) with a deep learning model as an intelligent human detection approach during emergency evacuations in a low-visibility smoky fire scenarios. We use low-wavelength infrared (LWIR) images taken by a TIC qualified with the National Fire Pro...

Full description

Bibliographic Details
Main Authors: Pei-Fen Tsai, Chia-Hung Liao, Shyan-Ming Yuan
Format: Article
Language:English
Published: MDPI AG 2022-07-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/14/5351
_version_ 1797443842454061056
author Pei-Fen Tsai
Chia-Hung Liao
Shyan-Ming Yuan
author_facet Pei-Fen Tsai
Chia-Hung Liao
Shyan-Ming Yuan
author_sort Pei-Fen Tsai
collection DOAJ
description In this study, we propose using a thermal imaging camera (TIC) with a deep learning model as an intelligent human detection approach during emergency evacuations in a low-visibility smoky fire scenarios. We use low-wavelength infrared (LWIR) images taken by a TIC qualified with the National Fire Protection Association (NFPA) 1801 standards as input to the YOLOv4 model for real-time object detection. The model trained with a single Nvidia GeForce 2070 can achieve >95% precision for the location of people in a low-visibility smoky scenario with 30.1 frames per second (FPS). This real-time result can be reported to control centers as useful information to help provide timely rescue and provide protection to firefighters before entering dangerous smoky fire situations.
first_indexed 2024-03-09T13:02:54Z
format Article
id doaj.art-870afb98ddc14f18b2542f227f4a59da
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T13:02:54Z
publishDate 2022-07-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-870afb98ddc14f18b2542f227f4a59da2023-11-30T21:52:17ZengMDPI AGSensors1424-82202022-07-012214535110.3390/s22145351Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke ScenariosPei-Fen Tsai0Chia-Hung Liao1Shyan-Ming Yuan2Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 300, TaiwanDepartment of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 300, TaiwanDepartment of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 300, TaiwanIn this study, we propose using a thermal imaging camera (TIC) with a deep learning model as an intelligent human detection approach during emergency evacuations in a low-visibility smoky fire scenarios. We use low-wavelength infrared (LWIR) images taken by a TIC qualified with the National Fire Protection Association (NFPA) 1801 standards as input to the YOLOv4 model for real-time object detection. The model trained with a single Nvidia GeForce 2070 can achieve >95% precision for the location of people in a low-visibility smoky scenario with 30.1 frames per second (FPS). This real-time result can be reported to control centers as useful information to help provide timely rescue and provide protection to firefighters before entering dangerous smoky fire situations.https://www.mdpi.com/1424-8220/22/14/5351thermal imaging cameraLWIRinfrared thermal cameraconvolutional neural networkevacuation in firehuman detection
spellingShingle Pei-Fen Tsai
Chia-Hung Liao
Shyan-Ming Yuan
Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
Sensors
thermal imaging camera
LWIR
infrared thermal camera
convolutional neural network
evacuation in fire
human detection
title Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
title_full Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
title_fullStr Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
title_full_unstemmed Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
title_short Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios
title_sort using deep learning with thermal imaging for human detection in heavy smoke scenarios
topic thermal imaging camera
LWIR
infrared thermal camera
convolutional neural network
evacuation in fire
human detection
url https://www.mdpi.com/1424-8220/22/14/5351
work_keys_str_mv AT peifentsai usingdeeplearningwiththermalimagingforhumandetectioninheavysmokescenarios
AT chiahungliao usingdeeplearningwiththermalimagingforhumandetectioninheavysmokescenarios
AT shyanmingyuan usingdeeplearningwiththermalimagingforhumandetectioninheavysmokescenarios