Phase messaging method for time-of-flight cameras

Ubiquitous light emitting devices and low-cost commercial digital cameras facilitate optical wireless communication system such as visual MIMO where handheld cameras communicate with electronic displays. While intensity-based optical communications are more prevalent in camera-display messaging, we...

Full description

Bibliographic Details
Main Authors: Yuan, Wenjia, Howard, Richard E., Dana, Kristin J., Raskar, Ramesh, Ashok, Ashwin, Gruteser, Marco, Mandayam, Narayan
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2015
Online Access:http://hdl.handle.net/1721.1/92841
https://orcid.org/0000-0002-3254-3224
_version_ 1826202104175263744
author Yuan, Wenjia
Howard, Richard E.
Dana, Kristin J.
Raskar, Ramesh
Ashok, Ashwin
Gruteser, Marco
Mandayam, Narayan
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Yuan, Wenjia
Howard, Richard E.
Dana, Kristin J.
Raskar, Ramesh
Ashok, Ashwin
Gruteser, Marco
Mandayam, Narayan
author_sort Yuan, Wenjia
collection MIT
description Ubiquitous light emitting devices and low-cost commercial digital cameras facilitate optical wireless communication system such as visual MIMO where handheld cameras communicate with electronic displays. While intensity-based optical communications are more prevalent in camera-display messaging, we present a novel method that uses modulated light phase for messaging and time-of-flight (ToF) cameras for receivers. With intensity-based methods, light signals can be degraded by reflections and ambient illumination. By comparison, communication using ToF cameras is more robust against challenging lighting conditions. Additionally, the concept of phase messaging can be combined with intensity messaging for a significant data rate advantage. In this work, we design and construct a phase messaging array (PMA), which is the first of its kind, to communicate to a ToF depth camera by manipulating the phase of the depth camera's infrared light signal. The array enables message variation spatially using a plane of infrared light emitting diodes and temporally by varying the induced phase shift. In this manner, the phase messaging array acts as the transmitter by electronically controlling the light signal phase. The ToF camera acts as the receiver by observing and recording a time-varying depth. We show a complete implementation of a 3×3 prototype array with custom hardware and demonstrating average bit accuracy as high as 97.8%. The prototype data rate with this approach is 1 Kbps that can be extended to approximately 10 Mbps.
first_indexed 2024-09-23T12:01:56Z
format Article
id mit-1721.1/92841
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T12:01:56Z
publishDate 2015
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/928412022-09-27T23:39:05Z Phase messaging method for time-of-flight cameras Yuan, Wenjia Howard, Richard E. Dana, Kristin J. Raskar, Ramesh Ashok, Ashwin Gruteser, Marco Mandayam, Narayan Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Raskar, Ramesh Ubiquitous light emitting devices and low-cost commercial digital cameras facilitate optical wireless communication system such as visual MIMO where handheld cameras communicate with electronic displays. While intensity-based optical communications are more prevalent in camera-display messaging, we present a novel method that uses modulated light phase for messaging and time-of-flight (ToF) cameras for receivers. With intensity-based methods, light signals can be degraded by reflections and ambient illumination. By comparison, communication using ToF cameras is more robust against challenging lighting conditions. Additionally, the concept of phase messaging can be combined with intensity messaging for a significant data rate advantage. In this work, we design and construct a phase messaging array (PMA), which is the first of its kind, to communicate to a ToF depth camera by manipulating the phase of the depth camera's infrared light signal. The array enables message variation spatially using a plane of infrared light emitting diodes and temporally by varying the induced phase shift. In this manner, the phase messaging array acts as the transmitter by electronically controlling the light signal phase. The ToF camera acts as the receiver by observing and recording a time-varying depth. We show a complete implementation of a 3×3 prototype array with custom hardware and demonstrating average bit accuracy as high as 97.8%. The prototype data rate with this approach is 1 Kbps that can be extended to approximately 10 Mbps. National Science Foundation (U.S.) (grant CNS-106546#) 2015-01-13T21:07:37Z 2015-01-13T21:07:37Z 2014-05 Article http://purl.org/eprint/type/ConferencePaper 978-1-4799-5188-8 INSPEC Accession Number: 14383061 http://hdl.handle.net/1721.1/92841 Yuan, Wenjia, Richard E. Howard, Kristin J. Dana, Ramesh Raskar, Ashwin Ashok, Marco Gruteser, and Narayan Mandayam. “Phase Messaging Method for Time-of-Flight Cameras.” 2014 IEEE International Conference on Computational Photography (ICCP) (May 2014). https://orcid.org/0000-0002-3254-3224 en_US http://dx.doi.org/10.1109/ICCPHOT.2014.6831812 2014 IEEE International Conference on Computational Photography (ICCP) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) Other univ. web domain
spellingShingle Yuan, Wenjia
Howard, Richard E.
Dana, Kristin J.
Raskar, Ramesh
Ashok, Ashwin
Gruteser, Marco
Mandayam, Narayan
Phase messaging method for time-of-flight cameras
title Phase messaging method for time-of-flight cameras
title_full Phase messaging method for time-of-flight cameras
title_fullStr Phase messaging method for time-of-flight cameras
title_full_unstemmed Phase messaging method for time-of-flight cameras
title_short Phase messaging method for time-of-flight cameras
title_sort phase messaging method for time of flight cameras
url http://hdl.handle.net/1721.1/92841
https://orcid.org/0000-0002-3254-3224
work_keys_str_mv AT yuanwenjia phasemessagingmethodfortimeofflightcameras
AT howardricharde phasemessagingmethodfortimeofflightcameras
AT danakristinj phasemessagingmethodfortimeofflightcameras
AT raskarramesh phasemessagingmethodfortimeofflightcameras
AT ashokashwin phasemessagingmethodfortimeofflightcameras
AT grutesermarco phasemessagingmethodfortimeofflightcameras
AT mandayamnarayan phasemessagingmethodfortimeofflightcameras