Indoor Scene Recognition Through Object Detection

Scene recognition is a highly valuable perceptual ability for an indoor mobile robot, however, current approaches for scene recognition present a significant drop in performance for the case of indoor scenes. We believe that this can be explained by the high appearance variability of indoor environm...

Full description

Bibliographic Details
Main Authors: Espinace, P., Soto, A., Kollar, Thomas Fleming, Roy, Nicholas
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers 2010
Online Access:http://hdl.handle.net/1721.1/58874
https://orcid.org/0000-0002-8293-0492
_version_ 1826197830451068928
author Espinace, P.
Soto, A.
Kollar, Thomas Fleming
Roy, Nicholas
author2 Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
author_facet Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Espinace, P.
Soto, A.
Kollar, Thomas Fleming
Roy, Nicholas
author_sort Espinace, P.
collection MIT
description Scene recognition is a highly valuable perceptual ability for an indoor mobile robot, however, current approaches for scene recognition present a significant drop in performance for the case of indoor scenes. We believe that this can be explained by the high appearance variability of indoor environments. This stresses the need to include high-level semantic information in the recognition process. In this work we propose a new approach for indoor scene recognition based on a generative probabilistic hierarchical model that uses common objects as an intermediate semantic representation. Under this model, we use object classifiers to associate low-level visual features to objects, and at the same time, we use contextual relations to associate objects to scenes. As a further contribution, we improve the performance of current state-of-the-art category-level object classifiers by including geometrical information obtained from a 3D range sensor that facilitates the implementation of a focus of attention mechanism within a Monte Carlo sampling scheme. We test our approach using real data, showing significant advantages with respect to previous state-of-the-art methods.
first_indexed 2024-09-23T10:54:29Z
format Article
id mit-1721.1/58874
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T10:54:29Z
publishDate 2010
publisher Institute of Electrical and Electronics Engineers
record_format dspace
spelling mit-1721.1/588742022-09-27T15:50:20Z Indoor Scene Recognition Through Object Detection Espinace, P. Soto, A. Kollar, Thomas Fleming Roy, Nicholas Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Aeronautics and Astronautics Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Roy, Nicholas Kollar, Thomas Fleming Roy, Nicholas Scene recognition is a highly valuable perceptual ability for an indoor mobile robot, however, current approaches for scene recognition present a significant drop in performance for the case of indoor scenes. We believe that this can be explained by the high appearance variability of indoor environments. This stresses the need to include high-level semantic information in the recognition process. In this work we propose a new approach for indoor scene recognition based on a generative probabilistic hierarchical model that uses common objects as an intermediate semantic representation. Under this model, we use object classifiers to associate low-level visual features to objects, and at the same time, we use contextual relations to associate objects to scenes. As a further contribution, we improve the performance of current state-of-the-art category-level object classifiers by including geometrical information obtained from a 3D range sensor that facilitates the implementation of a focus of attention mechanism within a Monte Carlo sampling scheme. We test our approach using real data, showing significant advantages with respect to previous state-of-the-art methods. Fondo Nacional de Desarrollo Científico y Tecnológico (Chile) (FONDECYT) (grant 1095140) 2010-10-05T19:19:47Z 2010-10-05T19:19:47Z 2010-05 Article http://purl.org/eprint/type/ConferencePaper 978-1-4244-5038-1 1050-4729 INSPEC Accession Number: 11431390 http://hdl.handle.net/1721.1/58874 Espinace, P. et al. “Indoor scene recognition through object detection.” Robotics and Automation (ICRA), 2010 IEEE International Conference on. 2010. 1406-1413. © Copyright 2010 IEEE https://orcid.org/0000-0002-8293-0492 en_US http://dx.doi.org/10.1109/ROBOT.2010.5509682 Proceedings of the IEEE International Conference on Intelligent Robotics and Automation, 2010 Attribution-Noncommercial-Share Alike 3.0 Unported http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Institute of Electrical and Electronics Engineers MIT web domain
spellingShingle Espinace, P.
Soto, A.
Kollar, Thomas Fleming
Roy, Nicholas
Indoor Scene Recognition Through Object Detection
title Indoor Scene Recognition Through Object Detection
title_full Indoor Scene Recognition Through Object Detection
title_fullStr Indoor Scene Recognition Through Object Detection
title_full_unstemmed Indoor Scene Recognition Through Object Detection
title_short Indoor Scene Recognition Through Object Detection
title_sort indoor scene recognition through object detection
url http://hdl.handle.net/1721.1/58874
https://orcid.org/0000-0002-8293-0492
work_keys_str_mv AT espinacep indoorscenerecognitionthroughobjectdetection
AT sotoa indoorscenerecognitionthroughobjectdetection
AT kollarthomasfleming indoorscenerecognitionthroughobjectdetection
AT roynicholas indoorscenerecognitionthroughobjectdetection