Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region

The spread of surveillance cameras has necessitated the monitoring of large quantities of surveillance video feeds. A manual monitoring system is near impossible due to the large man‐hour requirements. Recently, automatic abnormal activity detection has been an area of interest among researchers. A...

Full description

Bibliographic Details
Main Authors: Michael George, Babita Roslind Jose, Jimson Mathew, Pranjali Kokare
Format: Article
Language:English
Published: Wiley 2019-02-01
Series:IET Computer Vision
Subjects:
Online Access:https://doi.org/10.1049/iet-cvi.2018.5240
_version_ 1797684812083888128
author Michael George
Babita Roslind Jose
Jimson Mathew
Pranjali Kokare
author_facet Michael George
Babita Roslind Jose
Jimson Mathew
Pranjali Kokare
author_sort Michael George
collection DOAJ
description The spread of surveillance cameras has necessitated the monitoring of large quantities of surveillance video feeds. A manual monitoring system is near impossible due to the large man‐hour requirements. Recently, automatic abnormal activity detection has been an area of interest among researchers. A spatio‐temporal feature, histogram of optical flow orientation and magnitude (HOFM), has produced impressive ability in detecting abnormal activities. The authors propose a novel non‐uniform spatio‐temporal region resembling parallelepipeds, from which they extract the HOFM features. Autoencoders can be configured to detect abnormal patterns. The authors have used these abilities of the autoencoders to detect abnormalities in the HOFM features extracted from their novel spatio‐temporal regions of the video feeds. The autoencoders are trained on the HOFM features of the videos containing no abnormalities. The autoencoders are then fed with the HOFM features of the videos to be tested for abnormal activities, and these are detected based on the abilities of the autoencoders to reconstruct these features. The proposed method is tested on the standard abnormality detection datasets: UCSD Ped1, UCSD Ped2, Subway Entrance, Subway Exit, and UMN.
first_indexed 2024-03-12T00:35:11Z
format Article
id doaj.art-76d379861c9a4c20b2a1fbbc0eca0afd
institution Directory Open Access Journal
issn 1751-9632
1751-9640
language English
last_indexed 2024-03-12T00:35:11Z
publishDate 2019-02-01
publisher Wiley
record_format Article
series IET Computer Vision
spelling doaj.art-76d379861c9a4c20b2a1fbbc0eca0afd2023-09-15T09:51:44ZengWileyIET Computer Vision1751-96321751-96402019-02-01131233010.1049/iet-cvi.2018.5240Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal regionMichael George0Babita Roslind Jose1Jimson Mathew2Pranjali Kokare3Division of Electronics and Communication Engg.School of Engineering, Cochin University of Science and TechnologyKochi682022IndiaDivision of Electronics and Communication Engg.School of Engineering, Cochin University of Science and TechnologyKochi682022IndiaDepartment of Computer Science and EngineeringIndian Institute of Technology PatnaPatna801103IndiaDepartment of Computer Science and EngineeringIndian Institute of Technology PatnaPatna801103IndiaThe spread of surveillance cameras has necessitated the monitoring of large quantities of surveillance video feeds. A manual monitoring system is near impossible due to the large man‐hour requirements. Recently, automatic abnormal activity detection has been an area of interest among researchers. A spatio‐temporal feature, histogram of optical flow orientation and magnitude (HOFM), has produced impressive ability in detecting abnormal activities. The authors propose a novel non‐uniform spatio‐temporal region resembling parallelepipeds, from which they extract the HOFM features. Autoencoders can be configured to detect abnormal patterns. The authors have used these abilities of the autoencoders to detect abnormalities in the HOFM features extracted from their novel spatio‐temporal regions of the video feeds. The autoencoders are trained on the HOFM features of the videos containing no abnormalities. The autoencoders are then fed with the HOFM features of the videos to be tested for abnormal activities, and these are detected based on the abilities of the autoencoders to reconstruct these features. The proposed method is tested on the standard abnormality detection datasets: UCSD Ped1, UCSD Ped2, Subway Entrance, Subway Exit, and UMN.https://doi.org/10.1049/iet-cvi.2018.5240standard abnormality detection datasetsautoencoder-based abnormal activity detectionparallelepiped spatio-temporal regionsurveillance camerasmanual monitoring systemautomatic abnormal activity detection
spellingShingle Michael George
Babita Roslind Jose
Jimson Mathew
Pranjali Kokare
Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region
IET Computer Vision
standard abnormality detection datasets
autoencoder-based abnormal activity detection
parallelepiped spatio-temporal region
surveillance cameras
manual monitoring system
automatic abnormal activity detection
title Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region
title_full Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region
title_fullStr Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region
title_full_unstemmed Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region
title_short Autoencoder‐based abnormal activity detection using parallelepiped spatio‐temporal region
title_sort autoencoder based abnormal activity detection using parallelepiped spatio temporal region
topic standard abnormality detection datasets
autoencoder-based abnormal activity detection
parallelepiped spatio-temporal region
surveillance cameras
manual monitoring system
automatic abnormal activity detection
url https://doi.org/10.1049/iet-cvi.2018.5240
work_keys_str_mv AT michaelgeorge autoencoderbasedabnormalactivitydetectionusingparallelepipedspatiotemporalregion
AT babitaroslindjose autoencoderbasedabnormalactivitydetectionusingparallelepipedspatiotemporalregion
AT jimsonmathew autoencoderbasedabnormalactivitydetectionusingparallelepipedspatiotemporalregion
AT pranjalikokare autoencoderbasedabnormalactivitydetectionusingparallelepipedspatiotemporalregion