Revealing and analyzing imperceptible deviations in images and videos
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2016.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2016
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/105088 |
| _version_ | 1811073171932053504 |
|---|---|
| author | Wadhwa, Neal |
| author2 | William T. Freeman. |
| author_facet | William T. Freeman. Wadhwa, Neal |
| author_sort | Wadhwa, Neal |
| collection | MIT |
| description | Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2016. |
| first_indexed | 2024-09-23T09:29:30Z |
| format | Thesis |
| id | mit-1721.1/105088 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T09:29:30Z |
| publishDate | 2016 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1050882019-04-12T16:26:02Z Revealing and analyzing imperceptible deviations in images and videos Wadhwa, Neal William T. Freeman. Massachusetts Institute of Technology. Department of Mathematics. Massachusetts Institute of Technology. Department of Mathematics. Mathematics. Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2016. Cataloged from PDF version of thesis. Includes bibliographical references (pages 191-197). The world is filled with objects that appear to follow some perfect model. A sleeping baby might look still and a house's roof .should be straight. However, both the baby and the roof can deviate subtly from their ideal models of perfect stillness and perfect straightness. These deviations can reveal important information like whether the baby is breathing normally or whether the house's roof is sagging. In this dissertation, we make the observation that these subtle deviations produce a visual signal that while invisible to the naked eye can be extracted from ordinary and ubiquitous images and videos. We propose new computational techniques to reveal these subtle deviations by producing new images and videos, in which the tiny deviations have been magnified. We focus on magnifying deviations from two ideal models: perfect stillness and perfect geometries in space. In the first case, we leverage the complex steerable pyramid, a localized version of the Fourier transform, whose notion of local phase can be used to process and manipulate small motions or changes from stillness in videos. In the second case, we find hidden geometric deformations in images by localizing edges to sub-pixel precision. In both cases, we experimentally validate that the tiny deviations we magnify are indeed real, comparing them to alternative ways of measuring tiny motions and subtle geometric deformations in the world. We also give a careful analysis of how noise in videos impacts our ability to see tiny motions. Additionally, we show the utility of revealing hidden deviations in a wide variety of fields, such as biology, physics and structural analysis. by Neal Wadhwa. Ph. D. 2016-10-25T19:53:22Z 2016-10-25T19:53:22Z 2016 2016 Thesis http://hdl.handle.net/1721.1/105088 960853014 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 197 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Mathematics. Wadhwa, Neal Revealing and analyzing imperceptible deviations in images and videos |
| title | Revealing and analyzing imperceptible deviations in images and videos |
| title_full | Revealing and analyzing imperceptible deviations in images and videos |
| title_fullStr | Revealing and analyzing imperceptible deviations in images and videos |
| title_full_unstemmed | Revealing and analyzing imperceptible deviations in images and videos |
| title_short | Revealing and analyzing imperceptible deviations in images and videos |
| title_sort | revealing and analyzing imperceptible deviations in images and videos |
| topic | Mathematics. |
| url | http://hdl.handle.net/1721.1/105088 |
| work_keys_str_mv | AT wadhwaneal revealingandanalyzingimperceptibledeviationsinimagesandvideos |