Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast
Salient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2013-03-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/13/3/3409 |
| _version_ | 1811306659037839360 |
|---|---|
| author | Zhiqiang Tian Xuguang Lan Nanning Zheng Jianru Xue Ce Li |
| author_facet | Zhiqiang Tian Xuguang Lan Nanning Zheng Jianru Xue Ce Li |
| author_sort | Zhiqiang Tian |
| collection | DOAJ |
| description | Salient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to simulate the pre-attention behavior. Since most of the methods usually need some ad hoc parameters or high-cost preprocessing, they are difficult to rapidly detect salient object or be implemented by computing parallelism in a smart sensor. In this paper, we propose a novel spatio-temporal saliency perception method based on spatio-temporal hypercomplex spectral contrast (HSC). Firstly, the proposed HSC algorithm represent the features in the HSV (hue, saturation and value) color space and features of motion by a hypercomplex number. Secondly, the spatio-temporal salient objects are efficiently detected by hypercomplex Fourier spectral contrast in parallel. Finally, our saliency perception model also incorporates with the non-uniform sampling, which is a common phenomenon of human vision that directs visual attention to the logarithmic center of the image/video in natural scenes. The experimental results on the public saliency perception datasets demonstrate the effectiveness of the proposed approach compared to eleven state-of-the-art approaches. In addition, we extend the proposed model to moving object extraction in dynamic scenes, and the proposed algorithm is superior to the traditional algorithms. |
| first_indexed | 2024-04-13T08:49:27Z |
| format | Article |
| id | doaj.art-fb2f833aad20473c897888bcb6949875 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-13T08:49:27Z |
| publishDate | 2013-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-fb2f833aad20473c897888bcb69498752022-12-22T02:53:33ZengMDPI AGSensors1424-82202013-03-011333409343110.3390/s130303409Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral ContrastZhiqiang TianXuguang LanNanning ZhengJianru XueCe LiSalient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to simulate the pre-attention behavior. Since most of the methods usually need some ad hoc parameters or high-cost preprocessing, they are difficult to rapidly detect salient object or be implemented by computing parallelism in a smart sensor. In this paper, we propose a novel spatio-temporal saliency perception method based on spatio-temporal hypercomplex spectral contrast (HSC). Firstly, the proposed HSC algorithm represent the features in the HSV (hue, saturation and value) color space and features of motion by a hypercomplex number. Secondly, the spatio-temporal salient objects are efficiently detected by hypercomplex Fourier spectral contrast in parallel. Finally, our saliency perception model also incorporates with the non-uniform sampling, which is a common phenomenon of human vision that directs visual attention to the logarithmic center of the image/video in natural scenes. The experimental results on the public saliency perception datasets demonstrate the effectiveness of the proposed approach compared to eleven state-of-the-art approaches. In addition, we extend the proposed model to moving object extraction in dynamic scenes, and the proposed algorithm is superior to the traditional algorithms.http://www.mdpi.com/1424-8220/13/3/3409spatio-temporalsalient objecthypercomplexvisual attentionvisual perceptionspectral contrast |
| spellingShingle | Zhiqiang Tian Xuguang Lan Nanning Zheng Jianru Xue Ce Li Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast Sensors spatio-temporal salient object hypercomplex visual attention visual perception spectral contrast |
| title | Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast |
| title_full | Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast |
| title_fullStr | Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast |
| title_full_unstemmed | Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast |
| title_short | Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast |
| title_sort | spatio temporal saliency perception via hypercomplex frequency spectral contrast |
| topic | spatio-temporal salient object hypercomplex visual attention visual perception spectral contrast |
| url | http://www.mdpi.com/1424-8220/13/3/3409 |
| work_keys_str_mv | AT zhiqiangtian spatiotemporalsaliencyperceptionviahypercomplexfrequencyspectralcontrast AT xuguanglan spatiotemporalsaliencyperceptionviahypercomplexfrequencyspectralcontrast AT nanningzheng spatiotemporalsaliencyperceptionviahypercomplexfrequencyspectralcontrast AT jianruxue spatiotemporalsaliencyperceptionviahypercomplexfrequencyspectralcontrast AT celi spatiotemporalsaliencyperceptionviahypercomplexfrequencyspectralcontrast |