Integrating Computer Vision Technologies for Smart Surveillance Purpose

Automatic detection of dangerous situations in order to ensure the safety of residents is a new step in the development of video surveillance systems in cities. And dangerous situations are often caused by deviant behavior of people: robbery, brawl, vandalism and etc. But due to the strong variabili...

Full description

Bibliographic Details
Main Authors: Igor Ryabchikov, Nikolay Teslya, Nikita Druzhinin
Format: Article
Language:English
Published: FRUCT 2020-04-01
Series:Proceedings of the XXth Conference of Open Innovations Association FRUCT
Subjects:
Online Access:https://www.fruct.org/publications/fruct26/files/Rya.pdf
_version_ 1818199091506577408
author Igor Ryabchikov
Nikolay Teslya
Nikita Druzhinin
author_facet Igor Ryabchikov
Nikolay Teslya
Nikita Druzhinin
author_sort Igor Ryabchikov
collection DOAJ
description Automatic detection of dangerous situations in order to ensure the safety of residents is a new step in the development of video surveillance systems in cities. And dangerous situations are often caused by deviant behavior of people: robbery, brawl, vandalism and etc. But due to the strong variability of such scenes, their detection is a challenging problem, which still remains unresolved. The key to solving this problem is the recognition of fine-grained features and events of scenes and the application of knowledge management technologies. In this paper, three computer vision technologies for detecting people, tracking people and estimating three-dimensional human poses were integrated with the aim of recognizing the actions and interactions of people in three-dimensional space. For all technologies an open source implementations were used that showed high results in popular computer vision challenges. A dataset was also created using computer graphics to test the developed system, containing scenes of the interaction of people in the city, shot under different point of views. This dataset showed that additional teaching of the human pose estimation component to handle challenging poses of people and camera viewpoints is required.
first_indexed 2024-12-12T02:16:15Z
format Article
id doaj.art-da2461a7012e44c8abbd54ff4500109e
institution Directory Open Access Journal
issn 2305-7254
2343-0737
language English
last_indexed 2024-12-12T02:16:15Z
publishDate 2020-04-01
publisher FRUCT
record_format Article
series Proceedings of the XXth Conference of Open Innovations Association FRUCT
spelling doaj.art-da2461a7012e44c8abbd54ff4500109e2022-12-22T00:41:48ZengFRUCTProceedings of the XXth Conference of Open Innovations Association FRUCT2305-72542343-07372020-04-0126139240110.23919/FRUCT48808.2020.9087479Integrating Computer Vision Technologies for Smart Surveillance PurposeIgor Ryabchikov0Nikolay Teslya1Nikita Druzhinin2SPIIRAS, RussiaSPIIRAS, RussiaITMO University, RussiaAutomatic detection of dangerous situations in order to ensure the safety of residents is a new step in the development of video surveillance systems in cities. And dangerous situations are often caused by deviant behavior of people: robbery, brawl, vandalism and etc. But due to the strong variability of such scenes, their detection is a challenging problem, which still remains unresolved. The key to solving this problem is the recognition of fine-grained features and events of scenes and the application of knowledge management technologies. In this paper, three computer vision technologies for detecting people, tracking people and estimating three-dimensional human poses were integrated with the aim of recognizing the actions and interactions of people in three-dimensional space. For all technologies an open source implementations were used that showed high results in popular computer vision challenges. A dataset was also created using computer graphics to test the developed system, containing scenes of the interaction of people in the city, shot under different point of views. This dataset showed that additional teaching of the human pose estimation component to handle challenging poses of people and camera viewpoints is required.https://www.fruct.org/publications/fruct26/files/Rya.pdfcctvsurveillance cameradeviant behaviorneural networkdataset
spellingShingle Igor Ryabchikov
Nikolay Teslya
Nikita Druzhinin
Integrating Computer Vision Technologies for Smart Surveillance Purpose
Proceedings of the XXth Conference of Open Innovations Association FRUCT
cctv
surveillance camera
deviant behavior
neural network
dataset
title Integrating Computer Vision Technologies for Smart Surveillance Purpose
title_full Integrating Computer Vision Technologies for Smart Surveillance Purpose
title_fullStr Integrating Computer Vision Technologies for Smart Surveillance Purpose
title_full_unstemmed Integrating Computer Vision Technologies for Smart Surveillance Purpose
title_short Integrating Computer Vision Technologies for Smart Surveillance Purpose
title_sort integrating computer vision technologies for smart surveillance purpose
topic cctv
surveillance camera
deviant behavior
neural network
dataset
url https://www.fruct.org/publications/fruct26/files/Rya.pdf
work_keys_str_mv AT igorryabchikov integratingcomputervisiontechnologiesforsmartsurveillancepurpose
AT nikolayteslya integratingcomputervisiontechnologiesforsmartsurveillancepurpose
AT nikitadruzhinin integratingcomputervisiontechnologiesforsmartsurveillancepurpose