Beyond pixels : exploring new representations and applications for motion analysis
Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2010
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/53293 |
| _version_ | 1826201934067924992 |
|---|---|
| author | Liu, Ce, Ph. D. Massachusetts Institute of Technology |
| author2 | William T. Freeman and Edward H. Adelson. |
| author_facet | William T. Freeman and Edward H. Adelson. Liu, Ce, Ph. D. Massachusetts Institute of Technology |
| author_sort | Liu, Ce, Ph. D. Massachusetts Institute of Technology |
| collection | MIT |
| description | Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009. |
| first_indexed | 2024-09-23T11:59:36Z |
| format | Thesis |
| id | mit-1721.1/53293 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T11:59:36Z |
| publishDate | 2010 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/532932019-04-10T23:01:25Z Beyond pixels : exploring new representations and applications for motion analysis Exploring new representations and applications for motion analysis Liu, Ce, Ph. D. Massachusetts Institute of Technology William T. Freeman and Edward H. Adelson. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009. Cataloged from PDF version of thesis. Includes bibliographical references (p. 153-164). The focus of motion analysis has been on estimating a flow vector for every pixel by matching intensities. In my thesis, I will explore motion representations beyond the pixel level and new applications to which these representations lead. I first focus on analyzing motion from video sequences. Traditional motion analysis suffers from the inappropriate modeling of the grouping relationship of pixels and from a lack of ground-truth data. Using layers as the interface for humans to interact with videos, we build a human-assisted motion annotation system to obtain ground-truth motion, missing in the literature, for natural video sequences. Furthermore, we show that with the layer representation, we can detect and magnify small motions to make them visible to human eyes. Then we move to a contour presentation to analyze the motion for textureless objects under occlusion. We demonstrate that simultaneous boundary grouping and motion analysis can solve challenging data, where the traditional pixel-wise motion analysis fails. In the second part of my thesis, I will show the benefits of matching local image structures instead of intensity values. We propose SIFT flow that establishes dense, semantically meaningful correspondence between two images across scenes by matching pixel-wise SIFT features. Using SIFT flow, we develop a new framework for image parsing by transferring the metadata information, such as annotation, motion and depth, from the images in a large database to an unknown query image. We demonstrate this framework using new applications such as predicting motion from a single image and motion synthesis via object transfer. (cont.) Based on SIFT flow, we introduce a nonparametric scene parsing system using label transfer, with very promising experimental results suggesting that our system outperforms state-of-the-art techniques based on training classifiers. by Ce Liu. Ph.D. 2010-03-25T15:27:22Z 2010-03-25T15:27:22Z 2009 2009 Thesis http://hdl.handle.net/1721.1/53293 549097790 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 164 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Liu, Ce, Ph. D. Massachusetts Institute of Technology Beyond pixels : exploring new representations and applications for motion analysis |
| title | Beyond pixels : exploring new representations and applications for motion analysis |
| title_full | Beyond pixels : exploring new representations and applications for motion analysis |
| title_fullStr | Beyond pixels : exploring new representations and applications for motion analysis |
| title_full_unstemmed | Beyond pixels : exploring new representations and applications for motion analysis |
| title_short | Beyond pixels : exploring new representations and applications for motion analysis |
| title_sort | beyond pixels exploring new representations and applications for motion analysis |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/53293 |
| work_keys_str_mv | AT liucephdmassachusettsinstituteoftechnology beyondpixelsexploringnewrepresentationsandapplicationsformotionanalysis AT liucephdmassachusettsinstituteoftechnology exploringnewrepresentationsandapplicationsformotionanalysis |