Automatic face image annotation based on a single template with constrained warping deformation

In this study, an automatic face image annotation method is proposed by aligning faces with different expressions to an annotated neutral face. This work is useful in reducing tedious manual work for labelling image data in large databases. However, it is challenging because of the appearance variat...

Full description

Bibliographic Details
Main Authors: Yang Yang, Yuehu Liu, Jianyi Liu
Format: Article
Language:English
Published: Wiley 2013-02-01
Series:IET Computer Vision
Subjects:
Online Access:https://doi.org/10.1049/iet-cvi.2012.0094
_version_ 1827818752615383040
author Yang Yang
Yuehu Liu
Jianyi Liu
author_facet Yang Yang
Yuehu Liu
Jianyi Liu
author_sort Yang Yang
collection DOAJ
description In this study, an automatic face image annotation method is proposed by aligning faces with different expressions to an annotated neutral face. This work is useful in reducing tedious manual work for labelling image data in large databases. However, it is challenging because of the appearance variations caused by non‐rigid face deformations under various expressions. Unlike some conventional approaches acquiring sufficient image templates to model the query appearance, only a single given template is necessary for the proposed method. The authors address the problem through dense image alignment. Specifically, image warping in the alignment process is constrained by prior knowledge about facial shape deformation. The proposed method is independent of the appearance model, and is available for unseen faces. In addition, to initialise warping parameters, the authors present a robust patch‐based estimation method. Context information for feature points is carefully modelled to propagate the searching path for local patch matching. The face annotation experiments are performed on some large expressions, with noisy image qualities and in low image resolutions. Comparison results with conventional methods demonstrate the proposed method's superiority on both accuracy and robustness.
first_indexed 2024-03-12T00:57:55Z
format Article
id doaj.art-2f530d6137864d5a87c4101cfefa3dab
institution Directory Open Access Journal
issn 1751-9632
1751-9640
language English
last_indexed 2024-03-12T00:57:55Z
publishDate 2013-02-01
publisher Wiley
record_format Article
series IET Computer Vision
spelling doaj.art-2f530d6137864d5a87c4101cfefa3dab2023-09-14T10:25:48ZengWileyIET Computer Vision1751-96321751-96402013-02-0171202810.1049/iet-cvi.2012.0094Automatic face image annotation based on a single template with constrained warping deformationYang Yang0Yuehu Liu1Jianyi Liu2The School of Electronic and Information EngineeringXi'an Jiaotong UniversityXi'an710049People's Republic of ChinaThe School of Electronic and Information EngineeringXi'an Jiaotong UniversityXi'an710049People's Republic of ChinaThe School of Electronic and Information EngineeringXi'an Jiaotong UniversityXi'an710049People's Republic of ChinaIn this study, an automatic face image annotation method is proposed by aligning faces with different expressions to an annotated neutral face. This work is useful in reducing tedious manual work for labelling image data in large databases. However, it is challenging because of the appearance variations caused by non‐rigid face deformations under various expressions. Unlike some conventional approaches acquiring sufficient image templates to model the query appearance, only a single given template is necessary for the proposed method. The authors address the problem through dense image alignment. Specifically, image warping in the alignment process is constrained by prior knowledge about facial shape deformation. The proposed method is independent of the appearance model, and is available for unseen faces. In addition, to initialise warping parameters, the authors present a robust patch‐based estimation method. Context information for feature points is carefully modelled to propagate the searching path for local patch matching. The face annotation experiments are performed on some large expressions, with noisy image qualities and in low image resolutions. Comparison results with conventional methods demonstrate the proposed method's superiority on both accuracy and robustness.https://doi.org/10.1049/iet-cvi.2012.0094single templateconstrained warping deformationautomatic face image annotation methodlarge databasesimage data labellingnonrigid face deformations
spellingShingle Yang Yang
Yuehu Liu
Jianyi Liu
Automatic face image annotation based on a single template with constrained warping deformation
IET Computer Vision
single template
constrained warping deformation
automatic face image annotation method
large databases
image data labelling
nonrigid face deformations
title Automatic face image annotation based on a single template with constrained warping deformation
title_full Automatic face image annotation based on a single template with constrained warping deformation
title_fullStr Automatic face image annotation based on a single template with constrained warping deformation
title_full_unstemmed Automatic face image annotation based on a single template with constrained warping deformation
title_short Automatic face image annotation based on a single template with constrained warping deformation
title_sort automatic face image annotation based on a single template with constrained warping deformation
topic single template
constrained warping deformation
automatic face image annotation method
large databases
image data labelling
nonrigid face deformations
url https://doi.org/10.1049/iet-cvi.2012.0094
work_keys_str_mv AT yangyang automaticfaceimageannotationbasedonasingletemplatewithconstrainedwarpingdeformation
AT yuehuliu automaticfaceimageannotationbasedonasingletemplatewithconstrainedwarpingdeformation
AT jianyiliu automaticfaceimageannotationbasedonasingletemplatewithconstrainedwarpingdeformation