Danger detection technology based on multimodal and multilog data for public safety services

Recently, public safety services have attracted significant attention for their ability to protect people from crimes. Rapid detection of dangerous situations (that is, abnormal situations where someone may be harmed or killed) is required in public safety services to reduce the time required to res...

Full description

Bibliographic Details
Main Authors: Hyunho Park, Eunjung Kwon, Sungwon Byon, Won-Jae Shin, Eui-Suk Jung, Yong-Tae Lee
Format: Article
Language:English
Published: Electronics and Telecommunications Research Institute (ETRI) 2022-04-01
Series:ETRI Journal
Subjects:
Online Access:https://doi.org/10.4218/etrij.2020-0372
Description
Summary:Recently, public safety services have attracted significant attention for their ability to protect people from crimes. Rapid detection of dangerous situations (that is, abnormal situations where someone may be harmed or killed) is required in public safety services to reduce the time required to respond to such situations. This study proposes a novel danger detection technology based on multimodal data, which includes data from multiple sensors (for example, accelerometer, gyroscope, heart rate, air pressure, and global positioning system sensors), and multilog data, which includes contextual logs of humans and places (for example, contextual logs of human activities and crime-ridden districts) over time. To recognize human activity (for example, walk, sit, and punch), the proposed technology uses multimodal data analysis with an attitude heading reference system and long short-term memory. The proposed technology also includes multilog data analysis for detecting whether recognized activities of humans are dangerous. The proposed danger detection technology will benefit public safety services by improving danger detection capabilities.
ISSN:1225-6463