“Who are you?” - Learning person specific classifiers from video
We investigate the problem of automatically labelling faces of characters in TV or movie material with their names, using only weak supervision from automatically-aligned subtitle and script text. Our previous work (Everingham et al. [8]) demonstrated promising results on the task, but the coverage...
| প্রধান লেখক: | , , |
|---|---|
| বিন্যাস: | Conference item |
| ভাষা: | English |
| প্রকাশিত: |
IEEE
2009
|
| _version_ | 1826317012417118208 |
|---|---|
| author | Sivic, J Everingham, M Zisserman, A |
| author_facet | Sivic, J Everingham, M Zisserman, A |
| author_sort | Sivic, J |
| collection | OXFORD |
| description | We investigate the problem of automatically labelling faces of characters in TV or movie material with their names, using only weak supervision from automatically-aligned subtitle and script text. Our previous work (Everingham et al. [8]) demonstrated promising results on the task, but the coverage of the method (proportion of video labelled) and generalization was limited by a restriction to frontal faces and nearest neighbour classification. In this paper we build on that method, extending the coverage greatly by the detection and recognition of characters in profile views. In addition, we make the following contributions: (i) seamless tracking, integration and recognition of profile and frontal detections, and (ii) a character specific multiple kernel classifier which is able to learn the features best able to discriminate between the characters. We report results on seven episodes of the TV series "Buffy the Vampire Slayer", demonstrating significantly increased coverage and performance with respect to previous methods on this material. |
| first_indexed | 2025-02-19T04:31:48Z |
| format | Conference item |
| id | oxford-uuid:92a4559a-d0e5-4f7f-84a9-0f761749f683 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2025-02-19T04:31:48Z |
| publishDate | 2009 |
| publisher | IEEE |
| record_format | dspace |
| spelling | oxford-uuid:92a4559a-d0e5-4f7f-84a9-0f761749f6832025-01-10T11:41:07Z“Who are you?” - Learning person specific classifiers from videoConference itemhttp://purl.org/coar/resource_type/c_5794uuid:92a4559a-d0e5-4f7f-84a9-0f761749f683EnglishSymplectic ElementsIEEE2009Sivic, JEveringham, MZisserman, AWe investigate the problem of automatically labelling faces of characters in TV or movie material with their names, using only weak supervision from automatically-aligned subtitle and script text. Our previous work (Everingham et al. [8]) demonstrated promising results on the task, but the coverage of the method (proportion of video labelled) and generalization was limited by a restriction to frontal faces and nearest neighbour classification. In this paper we build on that method, extending the coverage greatly by the detection and recognition of characters in profile views. In addition, we make the following contributions: (i) seamless tracking, integration and recognition of profile and frontal detections, and (ii) a character specific multiple kernel classifier which is able to learn the features best able to discriminate between the characters. We report results on seven episodes of the TV series "Buffy the Vampire Slayer", demonstrating significantly increased coverage and performance with respect to previous methods on this material. |
| spellingShingle | Sivic, J Everingham, M Zisserman, A “Who are you?” - Learning person specific classifiers from video |
| title | “Who are you?” - Learning person specific classifiers from video |
| title_full | “Who are you?” - Learning person specific classifiers from video |
| title_fullStr | “Who are you?” - Learning person specific classifiers from video |
| title_full_unstemmed | “Who are you?” - Learning person specific classifiers from video |
| title_short | “Who are you?” - Learning person specific classifiers from video |
| title_sort | who are you learning person specific classifiers from video |
| work_keys_str_mv | AT sivicj whoareyoulearningpersonspecificclassifiersfromvideo AT everinghamm whoareyoulearningpersonspecificclassifiersfromvideo AT zissermana whoareyoulearningpersonspecificclassifiersfromvideo |