BiDi screen : depth and lighting aware interaction and display

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2009.

Bibliographic Details
Main Author: Hirsch, Matthew Waggener
Other Authors: Henry Holtzman.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2010
Subjects:
Online Access:http://hdl.handle.net/1721.1/55261
_version_ 1826212762843348992
author Hirsch, Matthew Waggener
author2 Henry Holtzman.
author_facet Henry Holtzman.
Hirsch, Matthew Waggener
author_sort Hirsch, Matthew Waggener
collection MIT
description Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2009.
first_indexed 2024-09-23T15:37:48Z
format Thesis
id mit-1721.1/55261
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T15:37:48Z
publishDate 2010
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/552612019-04-10T08:42:26Z BiDi screen : depth and lighting aware interaction and display Hirsch, Matthew Waggener Henry Holtzman. Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences. Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences. Architecture. Program in Media Arts and Sciences. Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2009. Cataloged from PDF version of thesis. Includes bibliographical references (p. 75-79). In this thesis, I describe a new type of interactive display that supports both on-screen multi-touch interactions and off-screen hover-based gestures. This BiDirectional (BiDi) screen, capable of both image capture and display, is inspired by emerging LCDs that use embedded optical sensors to detect multiple points of direct contact. The key contribution of this thesis is to exploit the spatial light modulation capability of LCDs to allow dynamic mask-based scene capture without interfering with display functionality. A large-format image sensor is placed slightly behind the liquid crystal layer. By alternatly switching the liquid crystal between a display mode showing traditional graphics and a capture mode in which the backlight is disabled and a pinhole array or an equivalent tiled-broadband code is displayed, the BiDi Screen can recover multi-view orthographic imagery while functioning as a 2D display. The recovered imagery is used to passively estimate the depth of scene points from focus. I discuss the design and construction of a prototype to demonstrate these capabilities in two motivating applications: a hybrid touch plus gesture interaction and a light-gun mode for interacting with external light-emitting widgets. The working prototype simulates the large format light sensor with a camera and diffuser, supporting interaction up to 50 cm in front of a modified 20.1 inch LCD. by Matthew W. Hirsch. S.M. 2010-05-25T21:11:43Z 2010-05-25T21:11:43Z 2009 2009 Thesis http://hdl.handle.net/1721.1/55261 613192733 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 79 p. application/pdf Massachusetts Institute of Technology
spellingShingle Architecture. Program in Media Arts and Sciences.
Hirsch, Matthew Waggener
BiDi screen : depth and lighting aware interaction and display
title BiDi screen : depth and lighting aware interaction and display
title_full BiDi screen : depth and lighting aware interaction and display
title_fullStr BiDi screen : depth and lighting aware interaction and display
title_full_unstemmed BiDi screen : depth and lighting aware interaction and display
title_short BiDi screen : depth and lighting aware interaction and display
title_sort bidi screen depth and lighting aware interaction and display
topic Architecture. Program in Media Arts and Sciences.
url http://hdl.handle.net/1721.1/55261
work_keys_str_mv AT hirschmatthewwaggener bidiscreendepthandlightingawareinteractionanddisplay