Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition
Although real-image emotion recognition has been developed in several studies, an acceptable accuracy level has not been achieved in portrait drawings. This paper proposes a portrait emotion recognition framework based on independent component analysis (ICA) and latent codes to overcome the performa...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-11-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/10/22/4260 |
| _version_ | 1797464722363121664 |
|---|---|
| author | Isack Lee Seok Bong Yoo |
| author_facet | Isack Lee Seok Bong Yoo |
| author_sort | Isack Lee |
| collection | DOAJ |
| description | Although real-image emotion recognition has been developed in several studies, an acceptable accuracy level has not been achieved in portrait drawings. This paper proposes a portrait emotion recognition framework based on independent component analysis (ICA) and latent codes to overcome the performance degradation problem in drawings. This framework employs latent code extracted through a generative adversarial network (GAN)-based encoder. It learns independently from factors that interfere with expression recognition, such as color, small occlusion, and various face angles. It is robust against environmental factors since it filters latent code by adding an emotion-relevant code extractor to extract only information related to facial expressions from the latent code. In addition, an image is generated by changing the latent code to the direction of the eigenvector for each emotion obtained through the ICA method. Since only the position of the latent code related to the facial expression is changed, there is little external change and the expression changes in the desired direction. This technique is helpful for qualitative and quantitative emotional recognition learning. The experimental results reveal that the proposed model performs better than the existing models, and the latent editing used in this process suggests a novel manipulation method through ICA. Moreover, the proposed framework can be applied for various portrait emotion applications from recognition to manipulation, such as automation of emotional subtitle production for the visually impaired, understanding the emotions of objects in famous classic artwork, and animation production assistance. |
| first_indexed | 2024-03-09T18:11:14Z |
| format | Article |
| id | doaj.art-d03c92ddf384471cac4826bbe59be1f1 |
| institution | Directory Open Access Journal |
| issn | 2227-7390 |
| language | English |
| last_indexed | 2024-03-09T18:11:14Z |
| publishDate | 2022-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj.art-d03c92ddf384471cac4826bbe59be1f12023-11-24T09:08:33ZengMDPI AGMathematics2227-73902022-11-011022426010.3390/math10224260Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion RecognitionIsack Lee0Seok Bong Yoo1Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju 61186, Republic of KoreaDepartment of Artificial Intelligence Convergence, Chonnam National University, Gwangju 61186, Republic of KoreaAlthough real-image emotion recognition has been developed in several studies, an acceptable accuracy level has not been achieved in portrait drawings. This paper proposes a portrait emotion recognition framework based on independent component analysis (ICA) and latent codes to overcome the performance degradation problem in drawings. This framework employs latent code extracted through a generative adversarial network (GAN)-based encoder. It learns independently from factors that interfere with expression recognition, such as color, small occlusion, and various face angles. It is robust against environmental factors since it filters latent code by adding an emotion-relevant code extractor to extract only information related to facial expressions from the latent code. In addition, an image is generated by changing the latent code to the direction of the eigenvector for each emotion obtained through the ICA method. Since only the position of the latent code related to the facial expression is changed, there is little external change and the expression changes in the desired direction. This technique is helpful for qualitative and quantitative emotional recognition learning. The experimental results reveal that the proposed model performs better than the existing models, and the latent editing used in this process suggests a novel manipulation method through ICA. Moreover, the proposed framework can be applied for various portrait emotion applications from recognition to manipulation, such as automation of emotional subtitle production for the visually impaired, understanding the emotions of objects in famous classic artwork, and animation production assistance.https://www.mdpi.com/2227-7390/10/22/4260generative adversarial networklatent codeportrait emotion recognitionindependent component analysis |
| spellingShingle | Isack Lee Seok Bong Yoo Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition Mathematics generative adversarial network latent code portrait emotion recognition independent component analysis |
| title | Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition |
| title_full | Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition |
| title_fullStr | Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition |
| title_full_unstemmed | Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition |
| title_short | Latent-PER: ICA-Latent Code Editing Framework for Portrait Emotion Recognition |
| title_sort | latent per ica latent code editing framework for portrait emotion recognition |
| topic | generative adversarial network latent code portrait emotion recognition independent component analysis |
| url | https://www.mdpi.com/2227-7390/10/22/4260 |
| work_keys_str_mv | AT isacklee latentpericalatentcodeeditingframeworkforportraitemotionrecognition AT seokbongyoo latentpericalatentcodeeditingframeworkforportraitemotionrecognition |