Lightweight Micro-Expression Recognition on Composite Database
The potential of leveraging micro-expression in various areas such as security, health care and education has intensified interests in this area. Unlike facial expression, micro-expression is subtle and occurs rapidly, making it imperceptible. Micro-expression recognition (MER) on composite dataset...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/3/1846 |
| _version_ | 1797625119454003200 |
|---|---|
| author | Nur Aishah Ab Razak Shahnorbanun Sahran |
| author_facet | Nur Aishah Ab Razak Shahnorbanun Sahran |
| author_sort | Nur Aishah Ab Razak |
| collection | DOAJ |
| description | The potential of leveraging micro-expression in various areas such as security, health care and education has intensified interests in this area. Unlike facial expression, micro-expression is subtle and occurs rapidly, making it imperceptible. Micro-expression recognition (MER) on composite dataset following Micro-Expression Grand Challenge 2019 protocol is an ongoing research area with challenges stemming from demographic variety of the samples as well as small and imbalanced dataset. However, most micro-expression recognition (MER) approaches today are complex and require computationally expensive pre-processing but result in average performance. This work will demonstrate how transfer learning from a larger and varied macro-expression database (FER 2013) in a lightweight deep learning network before fine-tuning on the composite dataset can achieve high MER performance using only static images as input. The imbalanced dataset problem is redefined as an algorithm tuning problem instead of data engineering and generation problem to lighten the pre-processing steps. The proposed MER model is developed from truncated EfficientNet-B0 model consisting of 15 layers with only 867k parameters. A simple algorithm tuning that manipulates the loss function to place more importance on minority classes is suggested to deal with the imbalanced dataset. Experimental results using Leave-One-Subject-Out cross-validation on the composite dataset show substantial performance increase compared to the state-of-the-art models. |
| first_indexed | 2024-03-11T09:52:19Z |
| format | Article |
| id | doaj.art-a87f87d2e47d4266a0e67db8ff4c2af2 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T09:52:19Z |
| publishDate | 2023-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-a87f87d2e47d4266a0e67db8ff4c2af22023-11-16T16:11:15ZengMDPI AGApplied Sciences2076-34172023-01-01133184610.3390/app13031846Lightweight Micro-Expression Recognition on Composite DatabaseNur Aishah Ab Razak0Shahnorbanun Sahran1Faculty of Technology, Science and Information, Universiti Kebangsaan Malaysia, Bangi 43600, MalaysiaCenter for Artificial Intelligence Technology (CAIT), Universiti Kebangsaan Malaysia, Bangi 43600, MalaysiaThe potential of leveraging micro-expression in various areas such as security, health care and education has intensified interests in this area. Unlike facial expression, micro-expression is subtle and occurs rapidly, making it imperceptible. Micro-expression recognition (MER) on composite dataset following Micro-Expression Grand Challenge 2019 protocol is an ongoing research area with challenges stemming from demographic variety of the samples as well as small and imbalanced dataset. However, most micro-expression recognition (MER) approaches today are complex and require computationally expensive pre-processing but result in average performance. This work will demonstrate how transfer learning from a larger and varied macro-expression database (FER 2013) in a lightweight deep learning network before fine-tuning on the composite dataset can achieve high MER performance using only static images as input. The imbalanced dataset problem is redefined as an algorithm tuning problem instead of data engineering and generation problem to lighten the pre-processing steps. The proposed MER model is developed from truncated EfficientNet-B0 model consisting of 15 layers with only 867k parameters. A simple algorithm tuning that manipulates the loss function to place more importance on minority classes is suggested to deal with the imbalanced dataset. Experimental results using Leave-One-Subject-Out cross-validation on the composite dataset show substantial performance increase compared to the state-of-the-art models.https://www.mdpi.com/2076-3417/13/3/1846micro-expression recognitioncomposite datasetEfficientNettransfer learninglightweight deep learning network |
| spellingShingle | Nur Aishah Ab Razak Shahnorbanun Sahran Lightweight Micro-Expression Recognition on Composite Database Applied Sciences micro-expression recognition composite dataset EfficientNet transfer learning lightweight deep learning network |
| title | Lightweight Micro-Expression Recognition on Composite Database |
| title_full | Lightweight Micro-Expression Recognition on Composite Database |
| title_fullStr | Lightweight Micro-Expression Recognition on Composite Database |
| title_full_unstemmed | Lightweight Micro-Expression Recognition on Composite Database |
| title_short | Lightweight Micro-Expression Recognition on Composite Database |
| title_sort | lightweight micro expression recognition on composite database |
| topic | micro-expression recognition composite dataset EfficientNet transfer learning lightweight deep learning network |
| url | https://www.mdpi.com/2076-3417/13/3/1846 |
| work_keys_str_mv | AT nuraishahabrazak lightweightmicroexpressionrecognitiononcompositedatabase AT shahnorbanunsahran lightweightmicroexpressionrecognitiononcompositedatabase |