Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images
Visual surveillance aims to reliably extract foreground objects. Traditional algorithms usually use a background model image which is generated through the probabilistic modeling of changes over time and space. They detect foreground objects by comparing a background model image with a current image...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9183919/ |
| _version_ | 1818608556595740672 |
|---|---|
| author | Jae-Yeul Kim Jong-Eun Ha |
| author_facet | Jae-Yeul Kim Jong-Eun Ha |
| author_sort | Jae-Yeul Kim |
| collection | DOAJ |
| description | Visual surveillance aims to reliably extract foreground objects. Traditional algorithms usually use a background model image which is generated through the probabilistic modeling of changes over time and space. They detect foreground objects by comparing a background model image with a current image. Hard shadows, illumination changes, camouflage, camera jitter, and ghost object motion make the robust detection of foreground objects difficult in visual surveillance. Recently, various methods based on deep learning have been applied to visual surveillance. It has been shown that deep learning approaches can stably extract salient features, and they give a superior result compared to traditional algorithms. However, they show a good performance only for scenes that are similar to a scene used in training. Without retraining on a new scene, they give a worse result compared to traditional algorithms. In this paper, we propose a stable foreground object detection algorithm through the integration of a background model image used in traditional methods and deep learning methods. A background model image generated by SuBSENSE and multiple images are used as the input of a fully convolutional network. Also, it is shown that it is possible to improve a generalization power by training the proposed network using diverse scenes from an open dataset. We show that the proposed algorithm can have a superior result compared to deep learning-based and traditional algorithms in a new scene without retraining the network. The performance of the proposed algorithm is evaluated using various datasets such as the CDnet 2014, SBI, LASIESTA, and our own datasets. The proposed algorithm shows improvement of 17.5%, 8.9%, and 4.3%, respectively, in FM score compared to three deep learning-based algorithms. |
| first_indexed | 2024-12-16T14:44:32Z |
| format | Article |
| id | doaj.art-bbb53745cc8e4f1eab0dd6645b4858ac |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-16T14:44:32Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-bbb53745cc8e4f1eab0dd6645b4858ac2022-12-21T22:27:49ZengIEEEIEEE Access2169-35362020-01-01815986415987810.1109/ACCESS.2020.30208189183919Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original ImagesJae-Yeul Kim0https://orcid.org/0000-0002-7765-4972Jong-Eun Ha1https://orcid.org/0000-0002-4144-1000Graduate School of Automotive Engineering, Seoul National University of Science and Technology, Seoul, South KoreaDepartment of Mechanics and Automotive Engineering, Seoul National University of Science and Technology, Seoul, South KoreaVisual surveillance aims to reliably extract foreground objects. Traditional algorithms usually use a background model image which is generated through the probabilistic modeling of changes over time and space. They detect foreground objects by comparing a background model image with a current image. Hard shadows, illumination changes, camouflage, camera jitter, and ghost object motion make the robust detection of foreground objects difficult in visual surveillance. Recently, various methods based on deep learning have been applied to visual surveillance. It has been shown that deep learning approaches can stably extract salient features, and they give a superior result compared to traditional algorithms. However, they show a good performance only for scenes that are similar to a scene used in training. Without retraining on a new scene, they give a worse result compared to traditional algorithms. In this paper, we propose a stable foreground object detection algorithm through the integration of a background model image used in traditional methods and deep learning methods. A background model image generated by SuBSENSE and multiple images are used as the input of a fully convolutional network. Also, it is shown that it is possible to improve a generalization power by training the proposed network using diverse scenes from an open dataset. We show that the proposed algorithm can have a superior result compared to deep learning-based and traditional algorithms in a new scene without retraining the network. The performance of the proposed algorithm is evaluated using various datasets such as the CDnet 2014, SBI, LASIESTA, and our own datasets. The proposed algorithm shows improvement of 17.5%, 8.9%, and 4.3%, respectively, in FM score compared to three deep learning-based algorithms.https://ieeexplore.ieee.org/document/9183919/Foreground objects detectionvisual surveillancegeneralization powerdeep learningfully convolutional network |
| spellingShingle | Jae-Yeul Kim Jong-Eun Ha Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images IEEE Access Foreground objects detection visual surveillance generalization power deep learning fully convolutional network |
| title | Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images |
| title_full | Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images |
| title_fullStr | Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images |
| title_full_unstemmed | Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images |
| title_short | Foreground Objects Detection Using a Fully Convolutional Network With a Background Model Image and Multiple Original Images |
| title_sort | foreground objects detection using a fully convolutional network with a background model image and multiple original images |
| topic | Foreground objects detection visual surveillance generalization power deep learning fully convolutional network |
| url | https://ieeexplore.ieee.org/document/9183919/ |
| work_keys_str_mv | AT jaeyeulkim foregroundobjectsdetectionusingafullyconvolutionalnetworkwithabackgroundmodelimageandmultipleoriginalimages AT jongeunha foregroundobjectsdetectionusingafullyconvolutionalnetworkwithabackgroundmodelimageandmultipleoriginalimages |