Basic Level Scene Understanding: Categories, Attributes and Structures
A longstanding goal of computer vision is to build a system that can automatically understand a 3D scene from a single image. This requires extracting semantic concepts and 3D information from 2D images which can depict an enormous variety of environments that comprise our visual world. This paper s...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2013-08-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2013.00506/full |
| _version_ | 1828328466384158720 |
|---|---|
| author | Jianxiong eXiao James eHays Bryan C. Russell Genevieve ePatterson Krista eEhinger Antonio eTorralba Aude eOliva |
| author_facet | Jianxiong eXiao James eHays Bryan C. Russell Genevieve ePatterson Krista eEhinger Antonio eTorralba Aude eOliva |
| author_sort | Jianxiong eXiao |
| collection | DOAJ |
| description | A longstanding goal of computer vision is to build a system that can automatically understand a 3D scene from a single image. This requires extracting semantic concepts and 3D information from 2D images which can depict an enormous variety of environments that comprise our visual world. This paper summarizes our recent efforts toward these goals. First, we describe the richly annotated SUN database which is a collection of annotated images spanning 908 different scene categories with object, attribute, and geometric labels for many scenes. This database allows us to systematically study the space of scenes and to establish a benchmark for scene and object recognition. We augment the categorical SUN database with 102 scene attributes for every image and explore attribute recognition. Finally, we present an integrated system to extract the 3D structure of the scene and objects depicted in an image. |
| first_indexed | 2024-04-13T20:10:11Z |
| format | Article |
| id | doaj.art-a836e0b06a134b39928144d81d5ea4f9 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-13T20:10:11Z |
| publishDate | 2013-08-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-a836e0b06a134b39928144d81d5ea4f92022-12-22T02:31:52ZengFrontiers Media S.A.Frontiers in Psychology1664-10782013-08-01410.3389/fpsyg.2013.0050654172Basic Level Scene Understanding: Categories, Attributes and StructuresJianxiong eXiao0James eHays1Bryan C. Russell2Genevieve ePatterson3Krista eEhinger4Antonio eTorralba5Aude eOliva6Princeton UniversityBrown UniversityUniversity of WashingtonBrown UniversityMassachusetts Institute of TechnologyMassachusetts Institute of TechnologyMassachusetts Institute of TechnologyA longstanding goal of computer vision is to build a system that can automatically understand a 3D scene from a single image. This requires extracting semantic concepts and 3D information from 2D images which can depict an enormous variety of environments that comprise our visual world. This paper summarizes our recent efforts toward these goals. First, we describe the richly annotated SUN database which is a collection of annotated images spanning 908 different scene categories with object, attribute, and geometric labels for many scenes. This database allows us to systematically study the space of scenes and to establish a benchmark for scene and object recognition. We augment the categorical SUN database with 102 scene attributes for every image and explore attribute recognition. Finally, we present an integrated system to extract the 3D structure of the scene and objects depicted in an image.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2013.00506/fullScene RecognitionSUN databasebasic level scene understandingscene attributesgeometry recognition3D context |
| spellingShingle | Jianxiong eXiao James eHays Bryan C. Russell Genevieve ePatterson Krista eEhinger Antonio eTorralba Aude eOliva Basic Level Scene Understanding: Categories, Attributes and Structures Frontiers in Psychology Scene Recognition SUN database basic level scene understanding scene attributes geometry recognition 3D context |
| title | Basic Level Scene Understanding: Categories, Attributes and Structures |
| title_full | Basic Level Scene Understanding: Categories, Attributes and Structures |
| title_fullStr | Basic Level Scene Understanding: Categories, Attributes and Structures |
| title_full_unstemmed | Basic Level Scene Understanding: Categories, Attributes and Structures |
| title_short | Basic Level Scene Understanding: Categories, Attributes and Structures |
| title_sort | basic level scene understanding categories attributes and structures |
| topic | Scene Recognition SUN database basic level scene understanding scene attributes geometry recognition 3D context |
| url | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2013.00506/full |
| work_keys_str_mv | AT jianxiongexiao basiclevelsceneunderstandingcategoriesattributesandstructures AT jamesehays basiclevelsceneunderstandingcategoriesattributesandstructures AT bryancrussell basiclevelsceneunderstandingcategoriesattributesandstructures AT genevieveepatterson basiclevelsceneunderstandingcategoriesattributesandstructures AT kristaeehinger basiclevelsceneunderstandingcategoriesattributesandstructures AT antonioetorralba basiclevelsceneunderstandingcategoriesattributesandstructures AT audeeoliva basiclevelsceneunderstandingcategoriesattributesandstructures |