Real-time Image Generation for Compressive Light Field Displays

With the invention of integral imaging and parallax barriers in the beginning of the 20th century, glasses-free 3D displays have become feasible. Only today—more than a century later—glasses-free 3D displays are finally emerging in the consumer market. The technologies being employed in current-gene...

Full description

Bibliographic Details
Main Authors: Wetzstein, Gordon, Lanman, Douglas R., Hirsch, Matthew Waggener, Raskar, Ramesh
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: IOP Publishing 2013
Online Access:http://hdl.handle.net/1721.1/80836
https://orcid.org/0000-0002-3254-3224
_version_ 1826210630739165184
author Wetzstein, Gordon
Lanman, Douglas R.
Hirsch, Matthew Waggener
Raskar, Ramesh
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Wetzstein, Gordon
Lanman, Douglas R.
Hirsch, Matthew Waggener
Raskar, Ramesh
author_sort Wetzstein, Gordon
collection MIT
description With the invention of integral imaging and parallax barriers in the beginning of the 20th century, glasses-free 3D displays have become feasible. Only today—more than a century later—glasses-free 3D displays are finally emerging in the consumer market. The technologies being employed in current-generation devices, however, are fundamentally the same as what was invented 100 years ago. With rapid advances in optical fabrication, digital processing power, and computational perception, a new generation of display technology is emerging: compressive displays exploring the co-design of optical elements and computational processing while taking particular characteristics of the human visual system into account. In this paper, we discuss real-time implementation strategies for emerging compressive light field displays. We consider displays composed of multiple stacked layers of light-attenuating or polarization-rotating layers, such as LCDs. The involved image generation requires iterative tomographic image synthesis. We demonstrate that, for the case of light field display, computed tomographic light field synthesis maps well to operations included in the standard graphics pipeline, facilitating efficient GPU-based implementations with real-time framerates.
first_indexed 2024-09-23T14:52:40Z
format Article
id mit-1721.1/80836
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T14:52:40Z
publishDate 2013
publisher IOP Publishing
record_format dspace
spelling mit-1721.1/808362022-09-29T11:10:50Z Real-time Image Generation for Compressive Light Field Displays Wetzstein, Gordon Lanman, Douglas R. Hirsch, Matthew Waggener Raskar, Ramesh Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Wetzstein, Gordon Lanman, Douglas R. Hirsch, Matthew Waggener Raskar, Ramesh With the invention of integral imaging and parallax barriers in the beginning of the 20th century, glasses-free 3D displays have become feasible. Only today—more than a century later—glasses-free 3D displays are finally emerging in the consumer market. The technologies being employed in current-generation devices, however, are fundamentally the same as what was invented 100 years ago. With rapid advances in optical fabrication, digital processing power, and computational perception, a new generation of display technology is emerging: compressive displays exploring the co-design of optical elements and computational processing while taking particular characteristics of the human visual system into account. In this paper, we discuss real-time implementation strategies for emerging compressive light field displays. We consider displays composed of multiple stacked layers of light-attenuating or polarization-rotating layers, such as LCDs. The involved image generation requires iterative tomographic image synthesis. We demonstrate that, for the case of light field display, computed tomographic light field synthesis maps well to operations included in the standard graphics pipeline, facilitating efficient GPU-based implementations with real-time framerates. United States. Defense Advanced Research Projects Agency. Soldier Centric Imaging via Computational Cameras National Science Foundation (U.S.) (Grant IIS-1116452) United States. Defense Advanced Research Projects Agency. Maximally scalable Optical Sensor Array Imaging with Computation Program Alfred P. Sloan Foundation (Research Fellowship) United States. Defense Advanced Research Projects Agency (Young Faculty Award) 2013-09-20T16:18:05Z 2013-09-20T16:18:05Z 2013-02 Article http://purl.org/eprint/type/ConferencePaper 1742-6596 1742-6588 http://hdl.handle.net/1721.1/80836 Wetzstein, G, D Lanman, M Hirsch, and R Raskar. “Real-time Image Generation for Compressive Light Field Displays.” Journal of Physics: Conference Series 415 (February 22, 2013): 012045. https://orcid.org/0000-0002-3254-3224 en_US http://dx.doi.org/10.1088/1742-6596/415/1/012045 Journal of Physics: Conference Series Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf IOP Publishing MIT Web Domain
spellingShingle Wetzstein, Gordon
Lanman, Douglas R.
Hirsch, Matthew Waggener
Raskar, Ramesh
Real-time Image Generation for Compressive Light Field Displays
title Real-time Image Generation for Compressive Light Field Displays
title_full Real-time Image Generation for Compressive Light Field Displays
title_fullStr Real-time Image Generation for Compressive Light Field Displays
title_full_unstemmed Real-time Image Generation for Compressive Light Field Displays
title_short Real-time Image Generation for Compressive Light Field Displays
title_sort real time image generation for compressive light field displays
url http://hdl.handle.net/1721.1/80836
https://orcid.org/0000-0002-3254-3224
work_keys_str_mv AT wetzsteingordon realtimeimagegenerationforcompressivelightfielddisplays
AT lanmandouglasr realtimeimagegenerationforcompressivelightfielddisplays
AT hirschmatthewwaggener realtimeimagegenerationforcompressivelightfielddisplays
AT raskarramesh realtimeimagegenerationforcompressivelightfielddisplays