2D articulated human pose estimation and retrieval in (almost) unconstrained still images

We present a technique for estimating the spatial layout of humans in still images—the position of the head, torso and arms. The theme we explore is that once a person is localized using an upper body detector, the search for their body parts can be considerably simplified using weak constraints on...

Full description

Bibliographic Details
Main Authors: Eichner, M, Marin-Jimenez, M, Zisserman, A, Ferrari, V
Format: Journal article
Language:English
Published: Springer Nature 2012
_version_ 1824458747535163392
author Eichner, M
Marin-Jimenez, M
Zisserman, A
Ferrari, V
author_facet Eichner, M
Marin-Jimenez, M
Zisserman, A
Ferrari, V
author_sort Eichner, M
collection OXFORD
description We present a technique for estimating the spatial layout of humans in still images—the position of the head, torso and arms. The theme we explore is that once a person is localized using an upper body detector, the search for their body parts can be considerably simplified using weak constraints on position and appearance arising from that detection. Our approach is capable of estimating upper body pose in highly challenging uncontrolled images, without prior knowledge of background, clothing, lighting, or the location and scale of the person in the image. People are only required to be upright and seen from the front or the back (not side). <br> We evaluate the stages of our approach experimentally using ground truth layout annotation on a variety of challenging material, such as images from the PASCAL VOC 2008 challenge and video frames from TV shows and feature films. <br> We also propose and evaluate techniques for searching a video dataset for people in a specific pose. To this end, we develop three new pose descriptors and compare their classification and retrieval performance to two baselines built on state-of-the-art object detection models.
first_indexed 2024-03-07T06:01:56Z
format Journal article
id oxford-uuid:ec7db1be-e7f3-4ff6-a52e-3245c1295174
institution University of Oxford
language English
last_indexed 2025-02-19T04:30:48Z
publishDate 2012
publisher Springer Nature
record_format dspace
spelling oxford-uuid:ec7db1be-e7f3-4ff6-a52e-3245c12951742024-12-17T17:22:00Z2D articulated human pose estimation and retrieval in (almost) unconstrained still imagesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:ec7db1be-e7f3-4ff6-a52e-3245c1295174EnglishSymplectic Elements at OxfordSpringer Nature2012Eichner, MMarin-Jimenez, MZisserman, AFerrari, VWe present a technique for estimating the spatial layout of humans in still images—the position of the head, torso and arms. The theme we explore is that once a person is localized using an upper body detector, the search for their body parts can be considerably simplified using weak constraints on position and appearance arising from that detection. Our approach is capable of estimating upper body pose in highly challenging uncontrolled images, without prior knowledge of background, clothing, lighting, or the location and scale of the person in the image. People are only required to be upright and seen from the front or the back (not side). <br> We evaluate the stages of our approach experimentally using ground truth layout annotation on a variety of challenging material, such as images from the PASCAL VOC 2008 challenge and video frames from TV shows and feature films. <br> We also propose and evaluate techniques for searching a video dataset for people in a specific pose. To this end, we develop three new pose descriptors and compare their classification and retrieval performance to two baselines built on state-of-the-art object detection models.
spellingShingle Eichner, M
Marin-Jimenez, M
Zisserman, A
Ferrari, V
2D articulated human pose estimation and retrieval in (almost) unconstrained still images
title 2D articulated human pose estimation and retrieval in (almost) unconstrained still images
title_full 2D articulated human pose estimation and retrieval in (almost) unconstrained still images
title_fullStr 2D articulated human pose estimation and retrieval in (almost) unconstrained still images
title_full_unstemmed 2D articulated human pose estimation and retrieval in (almost) unconstrained still images
title_short 2D articulated human pose estimation and retrieval in (almost) unconstrained still images
title_sort 2d articulated human pose estimation and retrieval in almost unconstrained still images
work_keys_str_mv AT eichnerm 2darticulatedhumanposeestimationandretrievalinalmostunconstrainedstillimages
AT marinjimenezm 2darticulatedhumanposeestimationandretrievalinalmostunconstrainedstillimages
AT zissermana 2darticulatedhumanposeestimationandretrievalinalmostunconstrainedstillimages
AT ferrariv 2darticulatedhumanposeestimationandretrievalinalmostunconstrainedstillimages