EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos

Surveillance systems regularly create massive video data in the modern technological era, making their analysis challenging for security specialists. Finding anomalous activities manually in these enormous video recordings is a tedious task, as they infrequently occur in the real world. We proposed...

Full description

Bibliographic Details
Main Authors: Sareer Ul Amin, Mohib Ullah, Muhammad Sajjad, Faouzi Alaya Cheikh, Mohammad Hijji, Abdulrahman Hijji, Khan Muhammad
Format: Article
Language:English
Published: MDPI AG 2022-05-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/10/9/1555
_version_ 1797503802337656832
author Sareer Ul Amin
Mohib Ullah
Muhammad Sajjad
Faouzi Alaya Cheikh
Mohammad Hijji
Abdulrahman Hijji
Khan Muhammad
author_facet Sareer Ul Amin
Mohib Ullah
Muhammad Sajjad
Faouzi Alaya Cheikh
Mohammad Hijji
Abdulrahman Hijji
Khan Muhammad
author_sort Sareer Ul Amin
collection DOAJ
description Surveillance systems regularly create massive video data in the modern technological era, making their analysis challenging for security specialists. Finding anomalous activities manually in these enormous video recordings is a tedious task, as they infrequently occur in the real world. We proposed a minimal complex deep learning-based model named EADN for anomaly detection that can operate in a surveillance system. At the model’s input, the video is segmented into salient shots using a shot boundary detection algorithm. Next, the selected sequence of frames is given to a Convolutional Neural Network (CNN) that consists of time-distributed 2D layers for extracting salient spatiotemporal features. The extracted features are enriched with valuable information that is very helpful in capturing abnormal events. Lastly, Long Short-Term Memory (LSTM) cells are employed to learn spatiotemporal features from a sequence of frames per sample of each abnormal event for anomaly detection. Comprehensive experiments are performed on benchmark datasets. Additionally, the quantitative results are compared with state-of-the-art methods, and a substantial improvement is achieved, showing our model’s effectiveness.
first_indexed 2024-03-10T03:55:32Z
format Article
id doaj.art-5a7b84dbb5784b55a4b2ce00e71111f5
institution Directory Open Access Journal
issn 2227-7390
language English
last_indexed 2024-03-10T03:55:32Z
publishDate 2022-05-01
publisher MDPI AG
record_format Article
series Mathematics
spelling doaj.art-5a7b84dbb5784b55a4b2ce00e71111f52023-11-23T08:46:05ZengMDPI AGMathematics2227-73902022-05-01109155510.3390/math10091555EADN: An Efficient Deep Learning Model for Anomaly Detection in VideosSareer Ul Amin0Mohib Ullah1Muhammad Sajjad2Faouzi Alaya Cheikh3Mohammad Hijji4Abdulrahman Hijji5Khan Muhammad6Digital Image Processing Laboratory, Department of Computer Science, Islamia College Peshawar, Peshawar 25000, PakistanSoftware, Data and Digital Ecosystems, Department of Computer Science, Norwegian University for Science and Technology (NTNU), 2815 Gjøvik, NorwayDigital Image Processing Laboratory, Department of Computer Science, Islamia College Peshawar, Peshawar 25000, PakistanSoftware, Data and Digital Ecosystems, Department of Computer Science, Norwegian University for Science and Technology (NTNU), 2815 Gjøvik, NorwayIndustrial Innovation and Robotic Center (IIRC), University of Tabuk, Tabuk 47711, Saudi ArabiaDepartment of Civil and Environmental Engineering, King Fahd University of Petroleum and Minerals (KFUPM), Dharan 31261, Saudi ArabiaVisual Analytics for Knowledge Laboratory (VIS2KNOW Lab), Department of Applied Artificial Intelligence, School of Convergence, College of Computing and Informatics, Sungkyunkwan University, Seoul 03063, KoreaSurveillance systems regularly create massive video data in the modern technological era, making their analysis challenging for security specialists. Finding anomalous activities manually in these enormous video recordings is a tedious task, as they infrequently occur in the real world. We proposed a minimal complex deep learning-based model named EADN for anomaly detection that can operate in a surveillance system. At the model’s input, the video is segmented into salient shots using a shot boundary detection algorithm. Next, the selected sequence of frames is given to a Convolutional Neural Network (CNN) that consists of time-distributed 2D layers for extracting salient spatiotemporal features. The extracted features are enriched with valuable information that is very helpful in capturing abnormal events. Lastly, Long Short-Term Memory (LSTM) cells are employed to learn spatiotemporal features from a sequence of frames per sample of each abnormal event for anomaly detection. Comprehensive experiments are performed on benchmark datasets. Additionally, the quantitative results are compared with state-of-the-art methods, and a substantial improvement is achieved, showing our model’s effectiveness.https://www.mdpi.com/2227-7390/10/9/1555anomaly detectionshots segmentationcomputer visiondeep learninghistogram differencekeyframe extraction
spellingShingle Sareer Ul Amin
Mohib Ullah
Muhammad Sajjad
Faouzi Alaya Cheikh
Mohammad Hijji
Abdulrahman Hijji
Khan Muhammad
EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos
Mathematics
anomaly detection
shots segmentation
computer vision
deep learning
histogram difference
keyframe extraction
title EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos
title_full EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos
title_fullStr EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos
title_full_unstemmed EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos
title_short EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos
title_sort eadn an efficient deep learning model for anomaly detection in videos
topic anomaly detection
shots segmentation
computer vision
deep learning
histogram difference
keyframe extraction
url https://www.mdpi.com/2227-7390/10/9/1555
work_keys_str_mv AT sareerulamin eadnanefficientdeeplearningmodelforanomalydetectioninvideos
AT mohibullah eadnanefficientdeeplearningmodelforanomalydetectioninvideos
AT muhammadsajjad eadnanefficientdeeplearningmodelforanomalydetectioninvideos
AT faouzialayacheikh eadnanefficientdeeplearningmodelforanomalydetectioninvideos
AT mohammadhijji eadnanefficientdeeplearningmodelforanomalydetectioninvideos
AT abdulrahmanhijji eadnanefficientdeeplearningmodelforanomalydetectioninvideos
AT khanmuhammad eadnanefficientdeeplearningmodelforanomalydetectioninvideos