Visual attention models for far-field scene analysis
Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2007.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2008
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/40314 |
| _version_ | 1811096222451105792 |
|---|---|
| author | Ižo, Tomáš, 1979- |
| author2 | W. Eric L. Grimson. |
| author_facet | W. Eric L. Grimson. Ižo, Tomáš, 1979- |
| author_sort | Ižo, Tomáš, 1979- |
| collection | MIT |
| description | Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2007. |
| first_indexed | 2024-09-23T16:40:31Z |
| format | Thesis |
| id | mit-1721.1/40314 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T16:40:31Z |
| publishDate | 2008 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/403142019-04-11T09:23:25Z Visual attention models for far-field scene analysis Ižo, Tomáš, 1979- W. Eric L. Grimson. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2007. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Includes bibliographical references (p. 141-146). The amount of information available to an intelligent monitoring system is simply too vast to process in its entirety. One way to address this issue is by developing attentive mechanisms that recognize parts of the input as more interesting than others. We apply this concept to the domain of far-field activity analysis by addressing the problem of determining where to look in a scene in order to capture interesting activity in progress. We pose the problem of attention as an unsupervised learning problem, in which the task is to learn from long-term observation a model of the usual pattern of activity. Such a statistical scene model then makes it possible to detect and attend to examples of unusual activity. We present two data-driven scene modeling approaches. In the first, we model the pattern of individual observations (instances) of moving objects at each scene location as a mixture of Gaussians. In the second approach, we model the pattern of sequences of observations -- tracks -- by grouping them into clusters.We employ a similarity measure that combines comparisons of multiple attributes -- such as size, position, and velocity -- in a principled manner so that only tracks that are spatially similar and have similar attributes at spatially corresponding points are grouped together. We group the tracks using spectral clustering and represent the scene model as a mixture of Gaussians in the spectral embedding space. New examples of activity can be efficiently classified by projection into the embedding space. We demonstrate clustering and unusual activity detection results on a week of activity in the scene (about 40,000 moving object tracks) and show that human perceptual judgments of unusual activity are well-correlated with the statistical model. The human validation suggests that the track-based anomaly detection framework would perform well as a classifier for unusual events. To our knowledge, our work is the first to evaluate a statistical scene modeling and anomaly detection framework against human judgments. by Tomáš Ižo. Ph.D. 2008-02-27T20:37:46Z 2008-02-27T20:37:46Z 2007 2007 Thesis http://hdl.handle.net/1721.1/40314 191823224 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 146 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Ižo, Tomáš, 1979- Visual attention models for far-field scene analysis |
| title | Visual attention models for far-field scene analysis |
| title_full | Visual attention models for far-field scene analysis |
| title_fullStr | Visual attention models for far-field scene analysis |
| title_full_unstemmed | Visual attention models for far-field scene analysis |
| title_short | Visual attention models for far-field scene analysis |
| title_sort | visual attention models for far field scene analysis |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/40314 |
| work_keys_str_mv | AT izotomas1979 visualattentionmodelsforfarfieldsceneanalysis |