The SUN Action database : collecting and analyzing typical actions for visual scene types
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013.
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis |
Language: | eng |
Published: |
Massachusetts Institute of Technology
2014
|
Subjects: | |
Online Access: | http://hdl.handle.net/1721.1/85460 |
_version_ | 1826214840235982848 |
---|---|
author | Olsson, Catherine Anne White |
author2 | Aude Oliva and Antonio Torralba. |
author_facet | Aude Oliva and Antonio Torralba. Olsson, Catherine Anne White |
author_sort | Olsson, Catherine Anne White |
collection | MIT |
description | Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013. |
first_indexed | 2024-09-23T16:11:59Z |
format | Thesis |
id | mit-1721.1/85460 |
institution | Massachusetts Institute of Technology |
language | eng |
last_indexed | 2024-09-23T16:11:59Z |
publishDate | 2014 |
publisher | Massachusetts Institute of Technology |
record_format | dspace |
spelling | mit-1721.1/854602019-04-10T09:03:38Z The SUN Action database : collecting and analyzing typical actions for visual scene types Scene Understanding - Action database Collecting and analyzing typical actions for visual scene types Olsson, Catherine Anne White Aude Oliva and Antonio Torralba. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013. Cataloged from PDF version of thesis. Includes bibliographical references (pages 115-119). Recent work in human and machine vision has increasingly focused on the problem of scene recognition. Scene types are largely defined by the actions one might typically do there: an office is a place someone would typically "work". I introduce the SUN Action database (short for "Scene UNderstanding - Action"): the first effort to collect and analyze free-response data from human subjects about the typical actions associated with different scene types. Responses were gathered on Mechanical Turk for twenty images per catgory, each depicting a characteristic view of one of 397 different scene types. The distribution of phrases is shown to be heavy-tailed and Zipf-like, whereas the distribution of semantic roots is not Zipf-like. Categories strongly associated with particular tasks or actions are shown to have lower overall diversity of responses. A hierarchical clustering analysis reveals a heterogeneous clustering structure, with some categories readily grouping together, and other categories remaining apart even at coarse clustering levels. Finally, two simple classifiers are introduced for predicting scene types from associated actions: a nearest centroid classifier, and an empirical maximum likelihood classifier. Both classifiers demonstrate greater than 50% classification performance in a 397-way classification task. by Catherine Anne White Olsson. M. Eng. 2014-03-06T15:43:36Z 2014-03-06T15:43:36Z 2013 2013 Thesis http://hdl.handle.net/1721.1/85460 870968994 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 119 pages application/pdf Massachusetts Institute of Technology |
spellingShingle | Electrical Engineering and Computer Science. Olsson, Catherine Anne White The SUN Action database : collecting and analyzing typical actions for visual scene types |
title | The SUN Action database : collecting and analyzing typical actions for visual scene types |
title_full | The SUN Action database : collecting and analyzing typical actions for visual scene types |
title_fullStr | The SUN Action database : collecting and analyzing typical actions for visual scene types |
title_full_unstemmed | The SUN Action database : collecting and analyzing typical actions for visual scene types |
title_short | The SUN Action database : collecting and analyzing typical actions for visual scene types |
title_sort | sun action database collecting and analyzing typical actions for visual scene types |
topic | Electrical Engineering and Computer Science. |
url | http://hdl.handle.net/1721.1/85460 |
work_keys_str_mv | AT olssoncatherineannewhite thesunactiondatabasecollectingandanalyzingtypicalactionsforvisualscenetypes AT olssoncatherineannewhite sceneunderstandingactiondatabase AT olssoncatherineannewhite collectingandanalyzingtypicalactionsforvisualscenetypes AT olssoncatherineannewhite sunactiondatabasecollectingandanalyzingtypicalactionsforvisualscenetypes |