Display adaptive 3D content remapping

Glasses-free automultiscopic displays are on the verge of becoming a standard technology in consumer products. These displays are capable of producing the illusion of 3D content without the need of any additional eyewear. However, due to limitations in angular resolution, they can only show a limite...

Full description

Bibliographic Details
Main Authors: Wetzstein, Gordon, Aliaga, Carlos, Raskar, Ramesh, Gutierrez, Diego, Masia Corcoy, Belen
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: Elsevier 2016
Online Access:http://hdl.handle.net/1721.1/102302
https://orcid.org/0000-0002-3254-3224
_version_ 1811088032670941184
author Wetzstein, Gordon
Aliaga, Carlos
Raskar, Ramesh
Gutierrez, Diego
Masia Corcoy, Belen
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Wetzstein, Gordon
Aliaga, Carlos
Raskar, Ramesh
Gutierrez, Diego
Masia Corcoy, Belen
author_sort Wetzstein, Gordon
collection MIT
description Glasses-free automultiscopic displays are on the verge of becoming a standard technology in consumer products. These displays are capable of producing the illusion of 3D content without the need of any additional eyewear. However, due to limitations in angular resolution, they can only show a limited depth of field, which translates into blurred-out areas whenever an object extrudes beyond a certain depth. Moreover, the blurring is device-specific, due to the different constraints of each display. We introduce a novel display-adaptive light field retargeting method, to provide high-quality, blur-free viewing experiences of the same content on a variety of display types, ranging from hand-held devices to movie theaters. We pose the problem as an optimization, which aims at modifying the original light field so that the displayed content appears sharp while preserving the original perception of depth. In particular, we run the optimization on the central view and use warping to synthesize the rest of the light field. We validate our method using existing objective metrics for both image quality (blur) and perceived depth. The proposed framework can also be applied to retargeting disparities in stereoscopic image displays, supporting both dichotomous and non-dichotomous comfort zones.
first_indexed 2024-09-23T13:55:12Z
format Article
id mit-1721.1/102302
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T13:55:12Z
publishDate 2016
publisher Elsevier
record_format dspace
spelling mit-1721.1/1023022022-09-28T17:05:40Z Display adaptive 3D content remapping Wetzstein, Gordon Aliaga, Carlos Raskar, Ramesh Gutierrez, Diego Masia Corcoy, Belen Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Masia, Belen Wetzstein, Gordon Raskar, Ramesh Glasses-free automultiscopic displays are on the verge of becoming a standard technology in consumer products. These displays are capable of producing the illusion of 3D content without the need of any additional eyewear. However, due to limitations in angular resolution, they can only show a limited depth of field, which translates into blurred-out areas whenever an object extrudes beyond a certain depth. Moreover, the blurring is device-specific, due to the different constraints of each display. We introduce a novel display-adaptive light field retargeting method, to provide high-quality, blur-free viewing experiences of the same content on a variety of display types, ranging from hand-held devices to movie theaters. We pose the problem as an optimization, which aims at modifying the original light field so that the displayed content appears sharp while preserving the original perception of depth. In particular, we run the optimization on the central view and use warping to synthesize the rest of the light field. We validate our method using existing objective metrics for both image quality (blur) and perceived depth. The proposed framework can also be applied to retargeting disparities in stereoscopic image displays, supporting both dichotomous and non-dichotomous comfort zones. European Union (Project GOLEM 251415) European Union (Project VERVE 288914) Spanish Ministry of Science and Technology (TIN2010-21543) Media Lab Consortium Members Lincoln Laboratory Massachusetts Institute of Technology. Institute for Soldier Nanotechnologies Samsung (Firm) National Science Foundation (U.S.) (Grant 1116452) National Science Foundation (U.S.) (Grant 1218411) Spanish Ministry of Education (FPU Grant) NVIDIA Corporation (Graduate Fellowship) Natural Sciences and Engineering Research Council of Canada (Postdoctoral Fellowship) United States. Defense Advanced Research Projects Agency. SCENICC Program Alfred P. Sloan Foundation (Sloan Research Fellowship) United States. Defense Advanced Research Projects Agency (Young Faculty Award) 2016-04-28T12:11:14Z 2016-04-28T12:11:14Z 2013-10 2013-05 Article http://purl.org/eprint/type/JournalArticle 00978493 http://hdl.handle.net/1721.1/102302 Masia, Belen, Gordon Wetzstein, Carlos Aliaga, Ramesh Raskar, and Diego Gutierrez. “Display Adaptive 3D Content Remapping.” Computers & Graphics 37, no. 8 (December 2013): 983–996. https://orcid.org/0000-0002-3254-3224 en_US http://dx.doi.org/10.1016/j.cag.2013.06.004 Computers & Graphics Creative Commons Attribution-Noncommercial-NoDerivatives http://creativecommons.org/licenses/by-nc-nd/4.0/ application/pdf Elsevier Other univ. web domain
spellingShingle Wetzstein, Gordon
Aliaga, Carlos
Raskar, Ramesh
Gutierrez, Diego
Masia Corcoy, Belen
Display adaptive 3D content remapping
title Display adaptive 3D content remapping
title_full Display adaptive 3D content remapping
title_fullStr Display adaptive 3D content remapping
title_full_unstemmed Display adaptive 3D content remapping
title_short Display adaptive 3D content remapping
title_sort display adaptive 3d content remapping
url http://hdl.handle.net/1721.1/102302
https://orcid.org/0000-0002-3254-3224
work_keys_str_mv AT wetzsteingordon displayadaptive3dcontentremapping
AT aliagacarlos displayadaptive3dcontentremapping
AT raskarramesh displayadaptive3dcontentremapping
AT gutierrezdiego displayadaptive3dcontentremapping
AT masiacorcoybelen displayadaptive3dcontentremapping