Detection of asymmetric eye action units in spontaneous videos
With recent advances in machine vision, automatic detection of human expressions in video is becoming important especially because human labeling of videos is both tedious and error prone. In this paper, we present an approach for detecting facial expressions based on the Facial Action Coding System...
| Main Authors: | , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Institute of Electrical and Electronics Engineers
2010
|
| Online Access: | http://hdl.handle.net/1721.1/60000 |
| _version_ | 1826209679917711360 |
|---|---|
| author | el Kaliouby, Rana Mikhail, Mina |
| author2 | Massachusetts Institute of Technology. Media Laboratory |
| author_facet | Massachusetts Institute of Technology. Media Laboratory el Kaliouby, Rana Mikhail, Mina |
| author_sort | el Kaliouby, Rana |
| collection | MIT |
| description | With recent advances in machine vision, automatic detection of human expressions in video is becoming important especially because human labeling of videos is both tedious and error prone. In this paper, we present an approach for detecting facial expressions based on the Facial Action Coding System (FACS) in spontaneous videos. We present an automated system for detecting asymmetric eye open (AU41) and eye closed (AU43) actions. We use Gabor Jets to select distinctive features from the image and compare between three different classifiers-Bayesian networks, Dynamic Bayesian networks and Support Vector Machines-for classification. Experimental evaluation on a large corpus of spontaneous videos yielded an average accuracy of 98% for eye closed (AU43), and 92.75% for eye open (AU41). |
| first_indexed | 2024-09-23T14:26:56Z |
| format | Article |
| id | mit-1721.1/60000 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T14:26:56Z |
| publishDate | 2010 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | mit-1721.1/600002022-10-01T21:23:18Z Detection of asymmetric eye action units in spontaneous videos el Kaliouby, Rana Mikhail, Mina Massachusetts Institute of Technology. Media Laboratory el Kaliouby, Rana el Kaliouby, Rana With recent advances in machine vision, automatic detection of human expressions in video is becoming important especially because human labeling of videos is both tedious and error prone. In this paper, we present an approach for detecting facial expressions based on the Facial Action Coding System (FACS) in spontaneous videos. We present an automated system for detecting asymmetric eye open (AU41) and eye closed (AU43) actions. We use Gabor Jets to select distinctive features from the image and compare between three different classifiers-Bayesian networks, Dynamic Bayesian networks and Support Vector Machines-for classification. Experimental evaluation on a large corpus of spontaneous videos yielded an average accuracy of 98% for eye closed (AU43), and 92.75% for eye open (AU41). 2010-11-17T18:39:12Z 2010-11-17T18:39:12Z 2010-01 2009-11 Article http://purl.org/eprint/type/JournalArticle 978-1-4244-5655-0 978-1-4244-5653-6 1522-4880 INSPEC Accession Number: 11151115 http://hdl.handle.net/1721.1/60000 Mikhail, M., and R. el Kaliouby. “Detection of asymmetric eye action units in spontaneous videos.” Image Processing (ICIP), 2009 16th IEEE International Conference on. 2009. 3557-3560. © 2010 IEEE en_US http://dx.doi.org/10.1109/ICIP.2009.5414341 16th IEEE International Conference on Image Processing (ICIP), 2009 Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf Institute of Electrical and Electronics Engineers IEEE |
| spellingShingle | el Kaliouby, Rana Mikhail, Mina Detection of asymmetric eye action units in spontaneous videos |
| title | Detection of asymmetric eye action units in spontaneous videos |
| title_full | Detection of asymmetric eye action units in spontaneous videos |
| title_fullStr | Detection of asymmetric eye action units in spontaneous videos |
| title_full_unstemmed | Detection of asymmetric eye action units in spontaneous videos |
| title_short | Detection of asymmetric eye action units in spontaneous videos |
| title_sort | detection of asymmetric eye action units in spontaneous videos |
| url | http://hdl.handle.net/1721.1/60000 |
| work_keys_str_mv | AT elkalioubyrana detectionofasymmetriceyeactionunitsinspontaneousvideos AT mikhailmina detectionofasymmetriceyeactionunitsinspontaneousvideos |