A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG)
Electrocardiogram (ECG) and Photoplethysmogram (PPG) are derived from electrical signals of the heart activities and frequently used to diagnose and monitor cardiovascular disease. In the field of affective computing, these two signals can be used to recognize human emotions, this is supported by th...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-06-01
|
| Series: | Journal of King Saud University: Computer and Information Sciences |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1319157822001409 |
| _version_ | 1831518284965478400 |
|---|---|
| author | Sharifah Noor Masidayu Sayed Ismail Nor Azlina Ab. Aziz Siti Zainab Ibrahim |
| author_facet | Sharifah Noor Masidayu Sayed Ismail Nor Azlina Ab. Aziz Siti Zainab Ibrahim |
| author_sort | Sharifah Noor Masidayu Sayed Ismail |
| collection | DOAJ |
| description | Electrocardiogram (ECG) and Photoplethysmogram (PPG) are derived from electrical signals of the heart activities and frequently used to diagnose and monitor cardiovascular disease. In the field of affective computing, these two signals can be used to recognize human emotions, this is supported by the wide availability of wearable devices that able to collect ECG or PPG in the market. ECG is frequently used as a unimodal signal for ERS, but the usage of PPG signals as unimodal ERS is still limited. There is no consensus about whether ECG is more suitable than PPG in ERS or vice versa. Only a few research have compared ECG and PPG. Therefore, this work intends to close this gap by developing an ERS employing ECG and PPG and evaluating the efficacy of both signals in ERS. This is done through data collected from 47 participants and two public datasets. The result from the data collected indicates that ECG is superior at recognizing arousal emotion with accuracy up to 68.75%, whereas PPG superior at recognizing valence up to 64.94% and dimension classes with 37.01% accuracy. The findings suggest that despite the current trend where researchers favour ECG over PPG, the PPG signals can be used as the only modality in developing ERS with results comparable to those obtained using ECG signals. |
| first_indexed | 2024-12-12T16:09:16Z |
| format | Article |
| id | doaj.art-c58a3fc8f964499fa5821057a442d72e |
| institution | Directory Open Access Journal |
| issn | 1319-1578 |
| language | English |
| last_indexed | 2024-12-12T16:09:16Z |
| publishDate | 2022-06-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Journal of King Saud University: Computer and Information Sciences |
| spelling | doaj.art-c58a3fc8f964499fa5821057a442d72e2022-12-22T00:19:13ZengElsevierJournal of King Saud University: Computer and Information Sciences1319-15782022-06-0134635393558A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG)Sharifah Noor Masidayu Sayed Ismail0Nor Azlina Ab. Aziz1Siti Zainab Ibrahim2Faculty of Information Science & Technology, Multimedia University, 75450 Melaka, Malaysia; Corresponding authors.Faculty of Engineering & Technology, Multimedia University, 75450 Melaka, Malaysia; Corresponding authors.Faculty of Information Science & Technology, Multimedia University, 75450 Melaka, MalaysiaElectrocardiogram (ECG) and Photoplethysmogram (PPG) are derived from electrical signals of the heart activities and frequently used to diagnose and monitor cardiovascular disease. In the field of affective computing, these two signals can be used to recognize human emotions, this is supported by the wide availability of wearable devices that able to collect ECG or PPG in the market. ECG is frequently used as a unimodal signal for ERS, but the usage of PPG signals as unimodal ERS is still limited. There is no consensus about whether ECG is more suitable than PPG in ERS or vice versa. Only a few research have compared ECG and PPG. Therefore, this work intends to close this gap by developing an ERS employing ECG and PPG and evaluating the efficacy of both signals in ERS. This is done through data collected from 47 participants and two public datasets. The result from the data collected indicates that ECG is superior at recognizing arousal emotion with accuracy up to 68.75%, whereas PPG superior at recognizing valence up to 64.94% and dimension classes with 37.01% accuracy. The findings suggest that despite the current trend where researchers favour ECG over PPG, the PPG signals can be used as the only modality in developing ERS with results comparable to those obtained using ECG signals.http://www.sciencedirect.com/science/article/pii/S1319157822001409Affective computingEmotion recognition systemElectrocardiogramPhotoplethysmogram |
| spellingShingle | Sharifah Noor Masidayu Sayed Ismail Nor Azlina Ab. Aziz Siti Zainab Ibrahim A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG) Journal of King Saud University: Computer and Information Sciences Affective computing Emotion recognition system Electrocardiogram Photoplethysmogram |
| title | A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG) |
| title_full | A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG) |
| title_fullStr | A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG) |
| title_full_unstemmed | A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG) |
| title_short | A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG) |
| title_sort | comparison of emotion recognition system using electrocardiogram ecg and photoplethysmogram ppg |
| topic | Affective computing Emotion recognition system Electrocardiogram Photoplethysmogram |
| url | http://www.sciencedirect.com/science/article/pii/S1319157822001409 |
| work_keys_str_mv | AT sharifahnoormasidayusayedismail acomparisonofemotionrecognitionsystemusingelectrocardiogramecgandphotoplethysmogramppg AT norazlinaabaziz acomparisonofemotionrecognitionsystemusingelectrocardiogramecgandphotoplethysmogramppg AT sitizainabibrahim acomparisonofemotionrecognitionsystemusingelectrocardiogramecgandphotoplethysmogramppg AT sharifahnoormasidayusayedismail comparisonofemotionrecognitionsystemusingelectrocardiogramecgandphotoplethysmogramppg AT norazlinaabaziz comparisonofemotionrecognitionsystemusingelectrocardiogramecgandphotoplethysmogramppg AT sitizainabibrahim comparisonofemotionrecognitionsystemusingelectrocardiogramecgandphotoplethysmogramppg |