A novel distortion criterion of rate-distortion optimization for depth map coding
In 3D video coding systems, depth maps are not displayed to the viewers, but provide the geometric information to generate virtual views. To ensure the quality of virtual views, the rate-distortion optimization (RDO) in depth map coding adopts the virtual view distortion as the distortion item. The...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/142116 |
| _version_ | 1811682048929169408 |
|---|---|
| author | Zheng, Ziqi Huo, Junyan Li, Bingbing Yuan, Hui Lin, Weisi |
| author2 | School of Computer Science and Engineering |
| author_facet | School of Computer Science and Engineering Zheng, Ziqi Huo, Junyan Li, Bingbing Yuan, Hui Lin, Weisi |
| author_sort | Zheng, Ziqi |
| collection | NTU |
| description | In 3D video coding systems, depth maps are not displayed to the viewers, but provide the geometric information to generate virtual views. To ensure the quality of virtual views, the rate-distortion optimization (RDO) in depth map coding adopts the virtual view distortion as the distortion item. The virtual view distortion comes from the reconstructed color video distortion and depth distortion. It is usually recognized that the virtual view distortion caused by reconstructed color video distortion is independent of that in depth map coding. Preliminary experiments reveal that the virtual view distortion in depth map coding is also influenced by the reconstructed color video distortion. Therefore, we proposed a novel distortion criterion of depth map coding in which the reconstructed color video distortion is modeled and joins into the virtual view distortion calculation. Correspondingly, the associated Lagrange multiplier is also proposed. Experimental results demonstrate that the method by integrating the proposed distortion criterion into RDO for depth map coding can achieve an average 12.72% bitrate saving compared with SSD based RDO method and can also lead a bitrate reduction (0.64%) compared with the existing distortion estimation method in the current 3D-HEVC reference software. With the associated Lagrange multiplier, the proposed distortion criterion can achieve 12.98% bitrate saving compared with SSD based RDO method on average. |
| first_indexed | 2024-10-01T03:50:39Z |
| format | Journal Article |
| id | ntu-10356/142116 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:50:39Z |
| publishDate | 2020 |
| record_format | dspace |
| spelling | ntu-10356/1421162020-06-16T03:07:29Z A novel distortion criterion of rate-distortion optimization for depth map coding Zheng, Ziqi Huo, Junyan Li, Bingbing Yuan, Hui Lin, Weisi School of Computer Science and Engineering Engineering::Computer science and engineering Three Dimensional Video (3DV) Multiview Video Plus Depth (MVD) In 3D video coding systems, depth maps are not displayed to the viewers, but provide the geometric information to generate virtual views. To ensure the quality of virtual views, the rate-distortion optimization (RDO) in depth map coding adopts the virtual view distortion as the distortion item. The virtual view distortion comes from the reconstructed color video distortion and depth distortion. It is usually recognized that the virtual view distortion caused by reconstructed color video distortion is independent of that in depth map coding. Preliminary experiments reveal that the virtual view distortion in depth map coding is also influenced by the reconstructed color video distortion. Therefore, we proposed a novel distortion criterion of depth map coding in which the reconstructed color video distortion is modeled and joins into the virtual view distortion calculation. Correspondingly, the associated Lagrange multiplier is also proposed. Experimental results demonstrate that the method by integrating the proposed distortion criterion into RDO for depth map coding can achieve an average 12.72% bitrate saving compared with SSD based RDO method and can also lead a bitrate reduction (0.64%) compared with the existing distortion estimation method in the current 3D-HEVC reference software. With the associated Lagrange multiplier, the proposed distortion criterion can achieve 12.98% bitrate saving compared with SSD based RDO method on average. 2020-06-16T03:07:29Z 2020-06-16T03:07:29Z 2018 Journal Article Zheng, Z., Huo, J., Li, B., Yuan, H., & Lin, W. (2018). A novel distortion criterion of rate-distortion optimization for depth map coding. Journal of Visual Communication and Image Representation, 54, 145-154. doi:10.1016/j.jvcir.2018.05.010 1047-3203 https://hdl.handle.net/10356/142116 10.1016/j.jvcir.2018.05.010 2-s2.0-85047058139 54 145 154 en Journal of Visual Communication and Image Representation © 2018 Elsevier Inc. All rights reserved. |
| spellingShingle | Engineering::Computer science and engineering Three Dimensional Video (3DV) Multiview Video Plus Depth (MVD) Zheng, Ziqi Huo, Junyan Li, Bingbing Yuan, Hui Lin, Weisi A novel distortion criterion of rate-distortion optimization for depth map coding |
| title | A novel distortion criterion of rate-distortion optimization for depth map coding |
| title_full | A novel distortion criterion of rate-distortion optimization for depth map coding |
| title_fullStr | A novel distortion criterion of rate-distortion optimization for depth map coding |
| title_full_unstemmed | A novel distortion criterion of rate-distortion optimization for depth map coding |
| title_short | A novel distortion criterion of rate-distortion optimization for depth map coding |
| title_sort | novel distortion criterion of rate distortion optimization for depth map coding |
| topic | Engineering::Computer science and engineering Three Dimensional Video (3DV) Multiview Video Plus Depth (MVD) |
| url | https://hdl.handle.net/10356/142116 |
| work_keys_str_mv | AT zhengziqi anoveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT huojunyan anoveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT libingbing anoveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT yuanhui anoveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT linweisi anoveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT zhengziqi noveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT huojunyan noveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT libingbing noveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT yuanhui noveldistortioncriterionofratedistortionoptimizationfordepthmapcoding AT linweisi noveldistortioncriterionofratedistortionoptimizationfordepthmapcoding |