Automatic face recognition for film character retrieval in feature-length films
The objective of this work is to recognize all the frontal faces of a character in the closed world of a movie or situation comedy, given a small number of query faces. This is challenging because faces in a feature-length film are relatively uncontrolled with a wide variability of scale, pose, illu...
| Main Authors: | , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
IEEE
2005
|
| _version_ | 1824458897562271744 |
|---|---|
| author | Arandjelović, O Zisserman, A |
| author_facet | Arandjelović, O Zisserman, A |
| author_sort | Arandjelović, O |
| collection | OXFORD |
| description | The objective of this work is to recognize all the frontal faces of a character in the closed world of a movie or situation comedy, given a small number of query faces. This is challenging because faces in a feature-length film are relatively uncontrolled with a wide variability of scale, pose, illumination, and expressions, and also may be partially occluded. We develop a recognition method based on a cascade of processing steps that normalize for the effects of the changing imaging environment. In particular there are three areas of novelty: (i) we suppress the background surrounding the face, enabling the maximum area of the face to be retained for recognition rather than a subset; (ii) we include a pose refinement step to optimize the registration between the test image and face exemplar; and (iii) we use robust distance to a sub-space to allow for partial occlusion and expression change. The method is applied and evaluated on several feature length films. It is demonstrated that high recall rates (over 92%) can be achieved whilst maintaining good precision (over 93%). |
| first_indexed | 2025-02-19T04:33:11Z |
| format | Conference item |
| id | oxford-uuid:74dfefde-0f48-4fb1-a606-4c835521c57a |
| institution | University of Oxford |
| language | English |
| last_indexed | 2025-02-19T04:33:11Z |
| publishDate | 2005 |
| publisher | IEEE |
| record_format | dspace |
| spelling | oxford-uuid:74dfefde-0f48-4fb1-a606-4c835521c57a2025-01-17T12:07:32ZAutomatic face recognition for film character retrieval in feature-length filmsConference itemhttp://purl.org/coar/resource_type/c_5794uuid:74dfefde-0f48-4fb1-a606-4c835521c57aEnglishSymplectic ElementsIEEE2005Arandjelović, OZisserman, AThe objective of this work is to recognize all the frontal faces of a character in the closed world of a movie or situation comedy, given a small number of query faces. This is challenging because faces in a feature-length film are relatively uncontrolled with a wide variability of scale, pose, illumination, and expressions, and also may be partially occluded. We develop a recognition method based on a cascade of processing steps that normalize for the effects of the changing imaging environment. In particular there are three areas of novelty: (i) we suppress the background surrounding the face, enabling the maximum area of the face to be retained for recognition rather than a subset; (ii) we include a pose refinement step to optimize the registration between the test image and face exemplar; and (iii) we use robust distance to a sub-space to allow for partial occlusion and expression change. The method is applied and evaluated on several feature length films. It is demonstrated that high recall rates (over 92%) can be achieved whilst maintaining good precision (over 93%). |
| spellingShingle | Arandjelović, O Zisserman, A Automatic face recognition for film character retrieval in feature-length films |
| title | Automatic face recognition for film character retrieval in feature-length films |
| title_full | Automatic face recognition for film character retrieval in feature-length films |
| title_fullStr | Automatic face recognition for film character retrieval in feature-length films |
| title_full_unstemmed | Automatic face recognition for film character retrieval in feature-length films |
| title_short | Automatic face recognition for film character retrieval in feature-length films |
| title_sort | automatic face recognition for film character retrieval in feature length films |
| work_keys_str_mv | AT arandjelovico automaticfacerecognitionforfilmcharacterretrievalinfeaturelengthfilms AT zissermana automaticfacerecognitionforfilmcharacterretrievalinfeaturelengthfilms |