A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique
Super multiview (SMV) 3D displays with a directional diffuser can provide dense viewpoints, wide viewing angles and high image quality. However, traditional SMV 3D rendering pipelines have many disadvantages, such as high time costs, low image quality, incorrect lighting effects and limited viewing...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9086513/ |
| _version_ | 1818323800070029312 |
|---|---|
| author | Shujun Xing Xinzhu Sang Liangcai Cao Yanxin Guan Yuanhang Li |
| author_facet | Shujun Xing Xinzhu Sang Liangcai Cao Yanxin Guan Yuanhang Li |
| author_sort | Shujun Xing |
| collection | DOAJ |
| description | Super multiview (SMV) 3D displays with a directional diffuser can provide dense viewpoints, wide viewing angles and high image quality. However, traditional SMV 3D rendering pipelines have many disadvantages, such as high time costs, low image quality, incorrect lighting effects and limited viewing angles. To overcome the abovementioned drawbacks, we propose a new SMV 3D rendering pipeline based on a hybrid rendering technique (HRT) that effectively combines and improves the Turing multiview rendering technique, the multiple view plus depth (MVD) technique and the deferred shading technique, introducing additional normal information, diffuseness information and shininess information into the SMV 3D rendering pipeline. The SMV HRT pipeline can generate SMV 3D images with accurate lighting in real time when the viewpoint number of an SMV 3D display is greater than 50, the viewing angle is greater than 100 degrees, the resolution of a single viewpoint image is more than 512*512 and the resolution of the LCD panel is 7680*4320; in particular, complex scenes can be generated in real time. The proposed HRT pipeline is the only viable real-time rendering pipeline with accurate lighting effects for super multiview 3D displays with wide viewing angle and high resolution that runs on a common PC with standard graphics hardware. An 8k SMV 3D display with an 80° viewing angle and 100 viewpoints is applied to demonstrate the validity of the HRT method in experiments. When the number of reference views is four, the experimental results show that the rendering frame rate is more than 35 fps on average for complex virtual scenes, and the peak signal-to-noise ratio (PSNR) value of the HRT is greater than 36 dB, illustrating its high image quality and accurate lighting. Compared with state-of-the-art MVD methods, HRT processes more lighting information and is more suitable for virtual scene rendering. Therefore, the HRT method has advantages regarding the image quality of the reconstructed 3D image and can easily achieve real-time rendering for SMV 3D displays with wide viewing angles. |
| first_indexed | 2024-12-13T11:18:27Z |
| format | Article |
| id | doaj.art-4d00301236a34fe4a6cf2d8855a41c8a |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-13T11:18:27Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-4d00301236a34fe4a6cf2d8855a41c8a2022-12-21T23:48:34ZengIEEEIEEE Access2169-35362020-01-018857508575910.1109/ACCESS.2020.29925119086513A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering TechniqueShujun Xing0https://orcid.org/0000-0002-9356-2170Xinzhu Sang1https://orcid.org/0000-0001-5093-8409Liangcai Cao2https://orcid.org/0000-0002-8099-2948Yanxin Guan3https://orcid.org/0000-0002-1433-5384Yuanhang Li4https://orcid.org/0000-0001-5819-3456State Key Laboratory of Precision Measurement Technology and Instruments, Tsinghua University, Beijing, ChinaState Key Laboratory of Information Photonics and Optical Communications, Beijing University of Posts and Telecommunications (BUPT), Beijing, ChinaState Key Laboratory of Precision Measurement Technology and Instruments, Tsinghua University, Beijing, ChinaState Key Laboratory of Information Photonics and Optical Communications, Beijing University of Posts and Telecommunications (BUPT), Beijing, ChinaState Key Laboratory of Information Photonics and Optical Communications, Beijing University of Posts and Telecommunications (BUPT), Beijing, ChinaSuper multiview (SMV) 3D displays with a directional diffuser can provide dense viewpoints, wide viewing angles and high image quality. However, traditional SMV 3D rendering pipelines have many disadvantages, such as high time costs, low image quality, incorrect lighting effects and limited viewing angles. To overcome the abovementioned drawbacks, we propose a new SMV 3D rendering pipeline based on a hybrid rendering technique (HRT) that effectively combines and improves the Turing multiview rendering technique, the multiple view plus depth (MVD) technique and the deferred shading technique, introducing additional normal information, diffuseness information and shininess information into the SMV 3D rendering pipeline. The SMV HRT pipeline can generate SMV 3D images with accurate lighting in real time when the viewpoint number of an SMV 3D display is greater than 50, the viewing angle is greater than 100 degrees, the resolution of a single viewpoint image is more than 512*512 and the resolution of the LCD panel is 7680*4320; in particular, complex scenes can be generated in real time. The proposed HRT pipeline is the only viable real-time rendering pipeline with accurate lighting effects for super multiview 3D displays with wide viewing angle and high resolution that runs on a common PC with standard graphics hardware. An 8k SMV 3D display with an 80° viewing angle and 100 viewpoints is applied to demonstrate the validity of the HRT method in experiments. When the number of reference views is four, the experimental results show that the rendering frame rate is more than 35 fps on average for complex virtual scenes, and the peak signal-to-noise ratio (PSNR) value of the HRT is greater than 36 dB, illustrating its high image quality and accurate lighting. Compared with state-of-the-art MVD methods, HRT processes more lighting information and is more suitable for virtual scene rendering. Therefore, the HRT method has advantages regarding the image quality of the reconstructed 3D image and can easily achieve real-time rendering for SMV 3D displays with wide viewing angles.https://ieeexplore.ieee.org/document/9086513/3D displaysuper multiview displayreal-time renderingwide viewing anglecomputer-generated 3D image |
| spellingShingle | Shujun Xing Xinzhu Sang Liangcai Cao Yanxin Guan Yuanhang Li A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique IEEE Access 3D display super multiview display real-time rendering wide viewing angle computer-generated 3D image |
| title | A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique |
| title_full | A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique |
| title_fullStr | A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique |
| title_full_unstemmed | A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique |
| title_short | A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique |
| title_sort | real time super multiview rendering pipeline for wide viewing angle and high resolution 3d displays based on a hybrid rendering technique |
| topic | 3D display super multiview display real-time rendering wide viewing angle computer-generated 3D image |
| url | https://ieeexplore.ieee.org/document/9086513/ |
| work_keys_str_mv | AT shujunxing arealtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT xinzhusang arealtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT liangcaicao arealtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT yanxinguan arealtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT yuanhangli arealtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT shujunxing realtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT xinzhusang realtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT liangcaicao realtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT yanxinguan realtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique AT yuanhangli realtimesupermultiviewrenderingpipelineforwideviewingangleandhighresolution3ddisplaysbasedonahybridrenderingtechnique |