Decomposing global light transport using time of flight imaging

Global light transport is composed of direct and indirect components. In this paper, we take the first steps toward analyzing light transport using high temporal resolution information via time of flight (ToF) images. The time profile at each pixel encodes complex interactions between the incident l...

Full description

Bibliographic Details
Main Authors: Wu, Di, O'Toole, Matthew, Velten, Andreas, Agrawal, Amit, Raskar, Ramesh
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers 2013
Online Access:http://hdl.handle.net/1721.1/80724
https://orcid.org/0000-0002-3254-3224
_version_ 1826207188019838976
author Wu, Di
O'Toole, Matthew
Velten, Andreas
Agrawal, Amit
Raskar, Ramesh
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Wu, Di
O'Toole, Matthew
Velten, Andreas
Agrawal, Amit
Raskar, Ramesh
author_sort Wu, Di
collection MIT
description Global light transport is composed of direct and indirect components. In this paper, we take the first steps toward analyzing light transport using high temporal resolution information via time of flight (ToF) images. The time profile at each pixel encodes complex interactions between the incident light and the scene geometry with spatially-varying material properties. We exploit the time profile to decompose light transport into its constituent direct, subsurface scattering, and interreflection components. We show that the time profile is well modelled using a Gaussian function for the direct and interreflection components, and a decaying exponential function for the subsurface scattering component. We use our direct, subsurface scattering, and interreflection separation algorithm for four computer vision applications: recovering projective depth maps, identifying subsurface scattering objects, measuring parameters of analytical subsurface scattering models, and performing edge detection using ToF images.
first_indexed 2024-09-23T13:45:25Z
format Article
id mit-1721.1/80724
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T13:45:25Z
publishDate 2013
publisher Institute of Electrical and Electronics Engineers
record_format dspace
spelling mit-1721.1/807242022-10-01T16:56:46Z Decomposing global light transport using time of flight imaging Wu, Di O'Toole, Matthew Velten, Andreas Agrawal, Amit Raskar, Ramesh Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Raskar, Ramesh Wu, Di O'Toole, Matthew Velten, Andreas Global light transport is composed of direct and indirect components. In this paper, we take the first steps toward analyzing light transport using high temporal resolution information via time of flight (ToF) images. The time profile at each pixel encodes complex interactions between the incident light and the scene geometry with spatially-varying material properties. We exploit the time profile to decompose light transport into its constituent direct, subsurface scattering, and interreflection components. We show that the time profile is well modelled using a Gaussian function for the direct and interreflection components, and a decaying exponential function for the subsurface scattering component. We use our direct, subsurface scattering, and interreflection separation algorithm for four computer vision applications: recovering projective depth maps, identifying subsurface scattering objects, measuring parameters of analytical subsurface scattering models, and performing edge detection using ToF images. United States. Army Research Office (contract W911NF-07-D-0004) United States. Defense Advanced Research Projects Agency (YFA grant) Massachusetts Institute of Technology. Media Laboratory (Consortium Members) Massachusetts Institute of Technology. Institute for Soldier Nanotechnologies 2013-09-13T16:10:52Z 2013-09-13T16:10:52Z 2012-06 Article http://purl.org/eprint/type/ConferencePaper 978-1-4673-1228-8 978-1-4673-1226-4 978-1-4673-1227-1 1063-6919 INSPEC Accession Number: 12894618 http://hdl.handle.net/1721.1/80724 Di Wu, M. O Toole, A. Velten, A. Agrawal, and R. Raskar. “Decomposing global light transport using time of flight imaging.” In 2012 IEEE Conference on Computer Vision and Pattern Recognition, 366-373. Institute of Electrical and Electronics Engineers, 2012. https://orcid.org/0000-0002-3254-3224 en_US http://dx.doi.org/10.1109/CVPR.2012.6247697 2012 IEEE Conference on Computer Vision and Pattern Recognition Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Institute of Electrical and Electronics Engineers MIT Web Domain
spellingShingle Wu, Di
O'Toole, Matthew
Velten, Andreas
Agrawal, Amit
Raskar, Ramesh
Decomposing global light transport using time of flight imaging
title Decomposing global light transport using time of flight imaging
title_full Decomposing global light transport using time of flight imaging
title_fullStr Decomposing global light transport using time of flight imaging
title_full_unstemmed Decomposing global light transport using time of flight imaging
title_short Decomposing global light transport using time of flight imaging
title_sort decomposing global light transport using time of flight imaging
url http://hdl.handle.net/1721.1/80724
https://orcid.org/0000-0002-3254-3224
work_keys_str_mv AT wudi decomposinggloballighttransportusingtimeofflightimaging
AT otoolematthew decomposinggloballighttransportusingtimeofflightimaging
AT veltenandreas decomposinggloballighttransportusingtimeofflightimaging
AT agrawalamit decomposinggloballighttransportusingtimeofflightimaging
AT raskarramesh decomposinggloballighttransportusingtimeofflightimaging