Masked-RPCA: Moving Object Detection With an Overlaying Model
Moving object detection in a given video sequence is a pivotal step in many computer vision applications such as video surveillance. Robust Principal Component Analysis (RPCA) performs low-rank and sparse decomposition to accomplish such a task when the background is stationary and the foreground is...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Open Journal of Signal Processing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9264716/ |
| _version_ | 1818410598155681792 |
|---|---|
| author | Amirhossein Khalilian-Gourtani Shervin Minaee Yao Wang |
| author_facet | Amirhossein Khalilian-Gourtani Shervin Minaee Yao Wang |
| author_sort | Amirhossein Khalilian-Gourtani |
| collection | DOAJ |
| description | Moving object detection in a given video sequence is a pivotal step in many computer vision applications such as video surveillance. Robust Principal Component Analysis (RPCA) performs low-rank and sparse decomposition to accomplish such a task when the background is stationary and the foreground is dynamic and relatively small. A fundamental issue with the RPCA is the assumption that the low-rank and sparse components are added at each pixel, whereas in reality, the moving foreground is overlaid on the background. We propose the masked decomposition (i.e. an overlaying model) where each element either belongs to the low-rank or the sparse component, decided by a mask. We introduce the Masked-RPCA (MRPCA) algorithm to recover the mask (hence the sparse object) and the low-rank components simultaneously, via a non-convex formulation. An adapted version of the Douglas-Rachford splitting algorithm is utilized to solve the proposed formulation. Our experiments using real-world video sequences show consistently better performance for both cases of static and dynamic background videos compared to RPCA and its variants based on the additive model. Additionally, we show that utilizing non-convex priors in our formulation leads to improved results without any added complexity compared to a relaxed formulation using convex surrogates and methods based on the additive model. |
| first_indexed | 2024-12-14T10:18:04Z |
| format | Article |
| id | doaj.art-3f53c609cc634fa58ebd37afdf4614bd |
| institution | Directory Open Access Journal |
| issn | 2644-1322 |
| language | English |
| last_indexed | 2024-12-14T10:18:04Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Open Journal of Signal Processing |
| spelling | doaj.art-3f53c609cc634fa58ebd37afdf4614bd2022-12-21T23:06:43ZengIEEEIEEE Open Journal of Signal Processing2644-13222020-01-01127428610.1109/OJSP.2020.30393259264716Masked-RPCA: Moving Object Detection With an Overlaying ModelAmirhossein Khalilian-Gourtani0https://orcid.org/0000-0003-1376-9583Shervin Minaee1https://orcid.org/0000-0001-6689-9221Yao Wang2https://orcid.org/0000-0003-3199-3802Electrical and Computer Engineering Department, New York University Tandon School of Engineering, Brooklyn, NY, USASnap, Inc., Machine Learning R&D, Seattle, WA, USAElectrical and Computer Engineering Department, New York University Tandon School of Engineering, Brooklyn, NY, USAMoving object detection in a given video sequence is a pivotal step in many computer vision applications such as video surveillance. Robust Principal Component Analysis (RPCA) performs low-rank and sparse decomposition to accomplish such a task when the background is stationary and the foreground is dynamic and relatively small. A fundamental issue with the RPCA is the assumption that the low-rank and sparse components are added at each pixel, whereas in reality, the moving foreground is overlaid on the background. We propose the masked decomposition (i.e. an overlaying model) where each element either belongs to the low-rank or the sparse component, decided by a mask. We introduce the Masked-RPCA (MRPCA) algorithm to recover the mask (hence the sparse object) and the low-rank components simultaneously, via a non-convex formulation. An adapted version of the Douglas-Rachford splitting algorithm is utilized to solve the proposed formulation. Our experiments using real-world video sequences show consistently better performance for both cases of static and dynamic background videos compared to RPCA and its variants based on the additive model. Additionally, we show that utilizing non-convex priors in our formulation leads to improved results without any added complexity compared to a relaxed formulation using convex surrogates and methods based on the additive model.https://ieeexplore.ieee.org/document/9264716/Moving object detectionforeground-background subtractionnuclear-norm minimizationlow-rank matricessparsity<inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$\ell _0$</tex-math> </inline-formula>-pseudo-norm minimization |
| spellingShingle | Amirhossein Khalilian-Gourtani Shervin Minaee Yao Wang Masked-RPCA: Moving Object Detection With an Overlaying Model IEEE Open Journal of Signal Processing Moving object detection foreground-background subtraction nuclear-norm minimization low-rank matrices sparsity <inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$\ell _0$</tex-math> </inline-formula>-pseudo-norm minimization |
| title | Masked-RPCA: Moving Object Detection With an Overlaying Model |
| title_full | Masked-RPCA: Moving Object Detection With an Overlaying Model |
| title_fullStr | Masked-RPCA: Moving Object Detection With an Overlaying Model |
| title_full_unstemmed | Masked-RPCA: Moving Object Detection With an Overlaying Model |
| title_short | Masked-RPCA: Moving Object Detection With an Overlaying Model |
| title_sort | masked rpca moving object detection with an overlaying model |
| topic | Moving object detection foreground-background subtraction nuclear-norm minimization low-rank matrices sparsity <inline-formula xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <tex-math notation="LaTeX">$\ell _0$</tex-math> </inline-formula>-pseudo-norm minimization |
| url | https://ieeexplore.ieee.org/document/9264716/ |
| work_keys_str_mv | AT amirhosseinkhaliliangourtani maskedrpcamovingobjectdetectionwithanoverlayingmodel AT shervinminaee maskedrpcamovingobjectdetectionwithanoverlayingmodel AT yaowang maskedrpcamovingobjectdetectionwithanoverlayingmodel |