The SUN Action database : collecting and analyzing typical actions for visual scene types

Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013.

Bibliographic Details
Main Author: Olsson, Catherine Anne White
Other Authors: Aude Oliva and Antonio Torralba.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2014
Subjects:
Online Access:http://hdl.handle.net/1721.1/85460
_version_ 1811095183124594688
author Olsson, Catherine Anne White
author2 Aude Oliva and Antonio Torralba.
author_facet Aude Oliva and Antonio Torralba.
Olsson, Catherine Anne White
author_sort Olsson, Catherine Anne White
collection MIT
description Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013.
first_indexed 2024-09-23T16:11:59Z
format Thesis
id mit-1721.1/85460
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T16:11:59Z
publishDate 2014
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/854602019-04-10T09:03:38Z The SUN Action database : collecting and analyzing typical actions for visual scene types Scene Understanding - Action database Collecting and analyzing typical actions for visual scene types Olsson, Catherine Anne White Aude Oliva and Antonio Torralba. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013. Cataloged from PDF version of thesis. Includes bibliographical references (pages 115-119). Recent work in human and machine vision has increasingly focused on the problem of scene recognition. Scene types are largely defined by the actions one might typically do there: an office is a place someone would typically "work". I introduce the SUN Action database (short for "Scene UNderstanding - Action"): the first effort to collect and analyze free-response data from human subjects about the typical actions associated with different scene types. Responses were gathered on Mechanical Turk for twenty images per catgory, each depicting a characteristic view of one of 397 different scene types. The distribution of phrases is shown to be heavy-tailed and Zipf-like, whereas the distribution of semantic roots is not Zipf-like. Categories strongly associated with particular tasks or actions are shown to have lower overall diversity of responses. A hierarchical clustering analysis reveals a heterogeneous clustering structure, with some categories readily grouping together, and other categories remaining apart even at coarse clustering levels. Finally, two simple classifiers are introduced for predicting scene types from associated actions: a nearest centroid classifier, and an empirical maximum likelihood classifier. Both classifiers demonstrate greater than 50% classification performance in a 397-way classification task. by Catherine Anne White Olsson. M. Eng. 2014-03-06T15:43:36Z 2014-03-06T15:43:36Z 2013 2013 Thesis http://hdl.handle.net/1721.1/85460 870968994 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 119 pages application/pdf Massachusetts Institute of Technology
spellingShingle Electrical Engineering and Computer Science.
Olsson, Catherine Anne White
The SUN Action database : collecting and analyzing typical actions for visual scene types
title The SUN Action database : collecting and analyzing typical actions for visual scene types
title_full The SUN Action database : collecting and analyzing typical actions for visual scene types
title_fullStr The SUN Action database : collecting and analyzing typical actions for visual scene types
title_full_unstemmed The SUN Action database : collecting and analyzing typical actions for visual scene types
title_short The SUN Action database : collecting and analyzing typical actions for visual scene types
title_sort sun action database collecting and analyzing typical actions for visual scene types
topic Electrical Engineering and Computer Science.
url http://hdl.handle.net/1721.1/85460
work_keys_str_mv AT olssoncatherineannewhite thesunactiondatabasecollectingandanalyzingtypicalactionsforvisualscenetypes
AT olssoncatherineannewhite sceneunderstandingactiondatabase
AT olssoncatherineannewhite collectingandanalyzingtypicalactionsforvisualscenetypes
AT olssoncatherineannewhite sunactiondatabasecollectingandanalyzingtypicalactionsforvisualscenetypes