Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding
<p/> <p>We propose a Stereoscopic Visual Attention- (SVA-) based regional bit allocation optimization for Multiview Video Coding (MVC) by the exploiting visual redundancies from human perceptions. We propose a novel SVA model, where multiple perceptual stimuli including depth, motion, in...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2010-01-01
|
| Series: | EURASIP Journal on Advances in Signal Processing |
| Online Access: | http://asp.eurasipjournals.com/content/2010/848713 |
| _version_ | 1811232235373723648 |
|---|---|
| author | Dai Qionghai Zhang Yun Jiang Gangyi Yu Mei Chen Ken |
| author_facet | Dai Qionghai Zhang Yun Jiang Gangyi Yu Mei Chen Ken |
| author_sort | Dai Qionghai |
| collection | DOAJ |
| description | <p/> <p>We propose a Stereoscopic Visual Attention- (SVA-) based regional bit allocation optimization for Multiview Video Coding (MVC) by the exploiting visual redundancies from human perceptions. We propose a novel SVA model, where multiple perceptual stimuli including depth, motion, intensity, color, and orientation contrast are utilized, to simulate the visual attention mechanisms of human visual system with stereoscopic perception. Then, a semantic region-of-interest (ROI) is extracted based on the saliency maps of SVA. Both objective and subjective evaluations of extracted ROIs indicated that the proposed SVA model based on ROI extraction scheme outperforms the schemes only using spatial or/and temporal visual attention clues. Finally, by using the extracted SVA-based ROIs, a regional bit allocation optimization scheme is presented to allocate more bits on SVA-based ROIs for high image quality and fewer bits on background regions for efficient compression purpose. Experimental results on MVC show that the proposed regional bit allocation algorithm can achieve over <inline-formula> <graphic file="1687-6180-2010-848713-i1.gif"/></inline-formula>% bit-rate saving while maintaining the subjective image quality. Meanwhile, the image quality of ROIs is improved by <inline-formula> <graphic file="1687-6180-2010-848713-i2.gif"/></inline-formula> dB at the cost of insensitive image quality degradation of the background image.</p> |
| first_indexed | 2024-04-12T10:58:55Z |
| format | Article |
| id | doaj.art-571befdaff504f75af7c2b6800a06246 |
| institution | Directory Open Access Journal |
| issn | 1687-6172 1687-6180 |
| language | English |
| last_indexed | 2024-04-12T10:58:55Z |
| publishDate | 2010-01-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | EURASIP Journal on Advances in Signal Processing |
| spelling | doaj.art-571befdaff504f75af7c2b6800a062462022-12-22T03:36:00ZengSpringerOpenEURASIP Journal on Advances in Signal Processing1687-61721687-61802010-01-0120101848713Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video CodingDai QionghaiZhang YunJiang GangyiYu MeiChen Ken<p/> <p>We propose a Stereoscopic Visual Attention- (SVA-) based regional bit allocation optimization for Multiview Video Coding (MVC) by the exploiting visual redundancies from human perceptions. We propose a novel SVA model, where multiple perceptual stimuli including depth, motion, intensity, color, and orientation contrast are utilized, to simulate the visual attention mechanisms of human visual system with stereoscopic perception. Then, a semantic region-of-interest (ROI) is extracted based on the saliency maps of SVA. Both objective and subjective evaluations of extracted ROIs indicated that the proposed SVA model based on ROI extraction scheme outperforms the schemes only using spatial or/and temporal visual attention clues. Finally, by using the extracted SVA-based ROIs, a regional bit allocation optimization scheme is presented to allocate more bits on SVA-based ROIs for high image quality and fewer bits on background regions for efficient compression purpose. Experimental results on MVC show that the proposed regional bit allocation algorithm can achieve over <inline-formula> <graphic file="1687-6180-2010-848713-i1.gif"/></inline-formula>% bit-rate saving while maintaining the subjective image quality. Meanwhile, the image quality of ROIs is improved by <inline-formula> <graphic file="1687-6180-2010-848713-i2.gif"/></inline-formula> dB at the cost of insensitive image quality degradation of the background image.</p>http://asp.eurasipjournals.com/content/2010/848713 |
| spellingShingle | Dai Qionghai Zhang Yun Jiang Gangyi Yu Mei Chen Ken Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding EURASIP Journal on Advances in Signal Processing |
| title | Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding |
| title_full | Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding |
| title_fullStr | Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding |
| title_full_unstemmed | Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding |
| title_short | Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding |
| title_sort | stereoscopic visual attention based regional bit allocation optimization for multiview video coding |
| url | http://asp.eurasipjournals.com/content/2010/848713 |
| work_keys_str_mv | AT daiqionghai stereoscopicvisualattentionbasedregionalbitallocationoptimizationformultiviewvideocoding AT zhangyun stereoscopicvisualattentionbasedregionalbitallocationoptimizationformultiviewvideocoding AT jianggangyi stereoscopicvisualattentionbasedregionalbitallocationoptimizationformultiviewvideocoding AT yumei stereoscopicvisualattentionbasedregionalbitallocationoptimizationformultiviewvideocoding AT chenken stereoscopicvisualattentionbasedregionalbitallocationoptimizationformultiviewvideocoding |