An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video

This paper presents an iterative training framework with a binary classifier to improve the learning capability of a deep learning model for detecting abnormal behaviors in surveillance video. When a deep learning model trained on data from one surveillance video is deployed to monitor another video...

Full description

Bibliographic Details
Main Authors: Cuong H. Tran, Seong G. Kong
Format: Article
Language:English
Published: MDPI AG 2023-07-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/12/15/3275
_version_ 1797586907461320704
author Cuong H. Tran
Seong G. Kong
author_facet Cuong H. Tran
Seong G. Kong
author_sort Cuong H. Tran
collection DOAJ
description This paper presents an iterative training framework with a binary classifier to improve the learning capability of a deep learning model for detecting abnormal behaviors in surveillance video. When a deep learning model trained on data from one surveillance video is deployed to monitor another video stream, its abnormal behavior detection performance often decreases significantly. To ensure the desired performance in new environments, the deep learning model needs to be retrained with additional training data from the new video stream. Iterative training requires manual annotation of the additional training data during the fine-tuning process, which is a tedious and error-prone task. To address this issue, this paper proposes a binary classifier to automatically label false positive data without human intervention. The binary classifier is trained on bounding boxes extracted from the detection model to identify which boxes are true positives or false positives. The proposed learning framework incrementally enhances the performance of the deep learning model for detecting abnormal behaviors in a surveillance video stream through repeated iterative learning cycles. Experimental results demonstrate that the accuracy of the detection model increases from 0.35 (mAP = 0.74) to 0.91 (mAP = 0.99) in just a few iterations.
first_indexed 2024-03-11T00:29:49Z
format Article
id doaj.art-dc69676453314069869f6d34f269ae59
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-11T00:29:49Z
publishDate 2023-07-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-dc69676453314069869f6d34f269ae592023-11-18T22:48:49ZengMDPI AGElectronics2079-92922023-07-011215327510.3390/electronics12153275An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance VideoCuong H. Tran0Seong G. Kong1Department of Computer Engineering, Sejong University, Seoul 05006, Republic of KoreaDepartment of Computer Engineering, Sejong University, Seoul 05006, Republic of KoreaThis paper presents an iterative training framework with a binary classifier to improve the learning capability of a deep learning model for detecting abnormal behaviors in surveillance video. When a deep learning model trained on data from one surveillance video is deployed to monitor another video stream, its abnormal behavior detection performance often decreases significantly. To ensure the desired performance in new environments, the deep learning model needs to be retrained with additional training data from the new video stream. Iterative training requires manual annotation of the additional training data during the fine-tuning process, which is a tedious and error-prone task. To address this issue, this paper proposes a binary classifier to automatically label false positive data without human intervention. The binary classifier is trained on bounding boxes extracted from the detection model to identify which boxes are true positives or false positives. The proposed learning framework incrementally enhances the performance of the deep learning model for detecting abnormal behaviors in a surveillance video stream through repeated iterative learning cycles. Experimental results demonstrate that the accuracy of the detection model increases from 0.35 (mAP = 0.74) to 0.91 (mAP = 0.99) in just a few iterations.https://www.mdpi.com/2079-9292/12/15/3275iterative learningbinary classifierevent detectionsurveillance videodeep learning
spellingShingle Cuong H. Tran
Seong G. Kong
An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video
Electronics
iterative learning
binary classifier
event detection
surveillance video
deep learning
title An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video
title_full An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video
title_fullStr An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video
title_full_unstemmed An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video
title_short An Iterative Learning Scheme with Binary Classifier for Improved Event Detection in Surveillance Video
title_sort iterative learning scheme with binary classifier for improved event detection in surveillance video
topic iterative learning
binary classifier
event detection
surveillance video
deep learning
url https://www.mdpi.com/2079-9292/12/15/3275
work_keys_str_mv AT cuonghtran aniterativelearningschemewithbinaryclassifierforimprovedeventdetectioninsurveillancevideo
AT seonggkong aniterativelearningschemewithbinaryclassifierforimprovedeventdetectioninsurveillancevideo
AT cuonghtran iterativelearningschemewithbinaryclassifierforimprovedeventdetectioninsurveillancevideo
AT seonggkong iterativelearningschemewithbinaryclassifierforimprovedeventdetectioninsurveillancevideo