Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods
Abstract Background Recognizing learners’ engagement during learning processes is important for providing personalized pedagogical support and preventing dropouts. As learning processes shift from traditional offline classrooms to distance learning, methods for automatically identifying engagement l...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-11-01
|
| Series: | Smart Learning Environments |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40561-022-00212-y |
| _version_ | 1798018423387586560 |
|---|---|
| author | Shofiyati Nur Karimah Shinobu Hasegawa |
| author_facet | Shofiyati Nur Karimah Shinobu Hasegawa |
| author_sort | Shofiyati Nur Karimah |
| collection | DOAJ |
| description | Abstract Background Recognizing learners’ engagement during learning processes is important for providing personalized pedagogical support and preventing dropouts. As learning processes shift from traditional offline classrooms to distance learning, methods for automatically identifying engagement levels should be developed. Objective This article aims to present a literature review of recent developments in automatic engagement estimation, including engagement definitions, datasets, and machine learning-based methods for automation estimation. The information, figures, and tables presented in this review aim at providing new researchers with insight on automatic engagement estimation to enhance smart learning with automatic engagement recognition methods. Methods A literature search was carried out using Scopus, Mendeley references, the IEEE Xplore digital library, and ScienceDirect following the four phases of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA): identification, screening, eligibility, and inclusion. The selected studies included research articles published between 2010 and 2022 that focused on three research questions (RQs) related to the engagement definitions, datasets, and methods used in the literature. The article selection excluded books, magazines, news articles, and posters. Results Forty-seven articles were selected to address the RQs and discuss engagement definitions, datasets, and methods. First, we introduce a clear taxonomy that defines engagement according to different types and the components used to measure it. Guided by this taxonomy, we reviewed the engagement types defined in the selected articles, with emotional engagement (n = 40; 65.57%) measured by affective cues appearing most often (n = 38; 57.58%). Then, we reviewed engagement and engagement-related datasets in the literature, with most studies assessing engagement with external observations (n = 20; 43.48%) and self-reported measures (n = 9; 19.57%). Finally, we summarized machine learning (ML)-based methods, including deep learning, used in the literature. Conclusions This review examines engagement definitions, datasets and ML-based methods from forty-seven selected articles. A taxonomy and three tables are presented to address three RQs and provide researchers in this field with guidance on enhancing smart learning with automatic engagement recognition. However, several key challenges remain, including cognitive and personalized engagement and ML issues that may affect real-world implementations. |
| first_indexed | 2024-04-11T16:23:56Z |
| format | Article |
| id | doaj.art-e7496738f99f4240ac533acba618d2a9 |
| institution | Directory Open Access Journal |
| issn | 2196-7091 |
| language | English |
| last_indexed | 2024-04-11T16:23:56Z |
| publishDate | 2022-11-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Smart Learning Environments |
| spelling | doaj.art-e7496738f99f4240ac533acba618d2a92022-12-22T04:14:14ZengSpringerOpenSmart Learning Environments2196-70912022-11-019114810.1186/s40561-022-00212-yAutomatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methodsShofiyati Nur Karimah0Shinobu Hasegawa1Graduate School of Advanced Science, Japan Advanced Institute of Science and Technology (JAIST)The Center for Innovative Distance Education and Research, Japan Advanced Institute of Science and Technology (JAIST)Abstract Background Recognizing learners’ engagement during learning processes is important for providing personalized pedagogical support and preventing dropouts. As learning processes shift from traditional offline classrooms to distance learning, methods for automatically identifying engagement levels should be developed. Objective This article aims to present a literature review of recent developments in automatic engagement estimation, including engagement definitions, datasets, and machine learning-based methods for automation estimation. The information, figures, and tables presented in this review aim at providing new researchers with insight on automatic engagement estimation to enhance smart learning with automatic engagement recognition methods. Methods A literature search was carried out using Scopus, Mendeley references, the IEEE Xplore digital library, and ScienceDirect following the four phases of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA): identification, screening, eligibility, and inclusion. The selected studies included research articles published between 2010 and 2022 that focused on three research questions (RQs) related to the engagement definitions, datasets, and methods used in the literature. The article selection excluded books, magazines, news articles, and posters. Results Forty-seven articles were selected to address the RQs and discuss engagement definitions, datasets, and methods. First, we introduce a clear taxonomy that defines engagement according to different types and the components used to measure it. Guided by this taxonomy, we reviewed the engagement types defined in the selected articles, with emotional engagement (n = 40; 65.57%) measured by affective cues appearing most often (n = 38; 57.58%). Then, we reviewed engagement and engagement-related datasets in the literature, with most studies assessing engagement with external observations (n = 20; 43.48%) and self-reported measures (n = 9; 19.57%). Finally, we summarized machine learning (ML)-based methods, including deep learning, used in the literature. Conclusions This review examines engagement definitions, datasets and ML-based methods from forty-seven selected articles. A taxonomy and three tables are presented to address three RQs and provide researchers in this field with guidance on enhancing smart learning with automatic engagement recognition. However, several key challenges remain, including cognitive and personalized engagement and ML issues that may affect real-world implementations.https://doi.org/10.1186/s40561-022-00212-yEngagement estimationEngagement definitionsEngagement datasetsEngagement methods |
| spellingShingle | Shofiyati Nur Karimah Shinobu Hasegawa Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods Smart Learning Environments Engagement estimation Engagement definitions Engagement datasets Engagement methods |
| title | Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods |
| title_full | Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods |
| title_fullStr | Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods |
| title_full_unstemmed | Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods |
| title_short | Automatic engagement estimation in smart education/learning settings: a systematic review of engagement definitions, datasets, and methods |
| title_sort | automatic engagement estimation in smart education learning settings a systematic review of engagement definitions datasets and methods |
| topic | Engagement estimation Engagement definitions Engagement datasets Engagement methods |
| url | https://doi.org/10.1186/s40561-022-00212-y |
| work_keys_str_mv | AT shofiyatinurkarimah automaticengagementestimationinsmarteducationlearningsettingsasystematicreviewofengagementdefinitionsdatasetsandmethods AT shinobuhasegawa automaticengagementestimationinsmarteducationlearningsettingsasystematicreviewofengagementdefinitionsdatasetsandmethods |