Refractive shape from light field distortion

Acquiring transparent, refractive objects is challenging as these kinds of objects can only be observed by analyzing the distortion of reference background patterns. We present a new, single image approach to reconstructing thin transparent surfaces, such as thin solids or surfaces of fluids. Our me...

Full description

Bibliographic Details
Main Authors: Wetzstein, Gordon, Roodnick, David, Heidrich, Wolfgang, Raskar, Ramesh
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers 2013
Online Access:http://hdl.handle.net/1721.1/80775
https://orcid.org/0000-0002-3254-3224
_version_ 1826207555487006720
author Wetzstein, Gordon
Roodnick, David
Heidrich, Wolfgang
Raskar, Ramesh
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Wetzstein, Gordon
Roodnick, David
Heidrich, Wolfgang
Raskar, Ramesh
author_sort Wetzstein, Gordon
collection MIT
description Acquiring transparent, refractive objects is challenging as these kinds of objects can only be observed by analyzing the distortion of reference background patterns. We present a new, single image approach to reconstructing thin transparent surfaces, such as thin solids or surfaces of fluids. Our method is based on observing the distortion of light field background illumination. Light field probes have the potential to encode up to four dimensions in varying colors and intensities: spatial and angular variation on the probe surface; commonly employed reference patterns are only two-dimensional by coding either position or angle on the probe. We show that the additional information can be used to reconstruct refractive surface normals and a sparse set of control points from a single photograph.
first_indexed 2024-09-23T13:51:23Z
format Article
id mit-1721.1/80775
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T13:51:23Z
publishDate 2013
publisher Institute of Electrical and Electronics Engineers
record_format dspace
spelling mit-1721.1/807752022-09-28T16:37:26Z Refractive shape from light field distortion Wetzstein, Gordon Roodnick, David Heidrich, Wolfgang Raskar, Ramesh Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Raskar, Ramesh Heidrich, Wolfgang Acquiring transparent, refractive objects is challenging as these kinds of objects can only be observed by analyzing the distortion of reference background patterns. We present a new, single image approach to reconstructing thin transparent surfaces, such as thin solids or surfaces of fluids. Our method is based on observing the distortion of light field background illumination. Light field probes have the potential to encode up to four dimensions in varying colors and intensities: spatial and angular variation on the probe surface; commonly employed reference patterns are only two-dimensional by coding either position or angle on the probe. We show that the additional information can be used to reconstruct refractive surface normals and a sparse set of control points from a single photograph. 2013-09-17T16:30:53Z 2013-09-17T16:30:53Z 2011-11 Article http://purl.org/eprint/type/ConferencePaper 978-1-4577-1102-2 978-1-4577-1101-5 978-1-4577-1100-8 1550-5499 INSPEC Accession Number: 12491001 http://hdl.handle.net/1721.1/80775 Wetzstein, Gordon, David Roodnick, Wolfgang Heidrich, and Ramesh Raskar. “Refractive shape from light field distortion.” In 2011 International Conference on Computer Vision, 6-13 November 2011, Barcelona, Spain, 1180-1186. Institute of Electrical and Electronics Engineers, 2011. https://orcid.org/0000-0002-3254-3224 en_US http://dx.doi.org/10.1109/ICCV.2011.6126367 2011 IEEE International Conference on Computer Vision, ICCV Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Institute of Electrical and Electronics Engineers Other university web domain
spellingShingle Wetzstein, Gordon
Roodnick, David
Heidrich, Wolfgang
Raskar, Ramesh
Refractive shape from light field distortion
title Refractive shape from light field distortion
title_full Refractive shape from light field distortion
title_fullStr Refractive shape from light field distortion
title_full_unstemmed Refractive shape from light field distortion
title_short Refractive shape from light field distortion
title_sort refractive shape from light field distortion
url http://hdl.handle.net/1721.1/80775
https://orcid.org/0000-0002-3254-3224
work_keys_str_mv AT wetzsteingordon refractiveshapefromlightfielddistortion
AT roodnickdavid refractiveshapefromlightfielddistortion
AT heidrichwolfgang refractiveshapefromlightfielddistortion
AT raskarramesh refractiveshapefromlightfielddistortion