i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction
Abstract Apart from good instructional design and delivery, effective intervention is another key to strengthen student academic performance. However, intervention has been recognized as a great challenge. Most instructors struggle to identify at-risk students, determine a proper intervention approa...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2023-07-01
|
| Series: | Smart Learning Environments |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40561-023-00257-7 |
| _version_ | 1797769311443484672 |
|---|---|
| author | Piriya Utamachant Chutiporn Anutariya Suporn Pongnumkul |
| author_facet | Piriya Utamachant Chutiporn Anutariya Suporn Pongnumkul |
| author_sort | Piriya Utamachant |
| collection | DOAJ |
| description | Abstract Apart from good instructional design and delivery, effective intervention is another key to strengthen student academic performance. However, intervention has been recognized as a great challenge. Most instructors struggle to identify at-risk students, determine a proper intervention approach, trace and evaluate whether the intervention works. This process requires extensive effort and commitment, which is impractical especially for large classes with few instructors. This paper proposes a platform, namely i-Ntervene, that integrates Learning Management System (LMS) automatic code grader, and learning analytics features which can empower systematic learning intervention for large programming classes. The platform supports instructor-pace courses on both Virtual Learning Environment (VLE) and traditional classroom setting. The platform iteratively assesses student engagement levels through learning activity gaps. It also analyzes subject understanding from programming question practices to identify at-risk students and suggests aspects of intervention based on their lagging in these areas. Students’ post-intervention data are traced and evaluated quantitatively to determine effective intervention approaches. This evaluation method aligns with the evidence-based research design. The developed i-Ntervene prototype was tested on a Java programming course with 253 first-year university students during the Covid-19 pandemic in VLE. The result was satisfactory, as the instructors were able to perform and evaluate 12 interventions throughout a semester. For this experimental course, the platform revealed that the approach of sending extrinsic motivation emails had more impact in promoting learning behavior compared to other types of messages. It also showed that providing tutorial sessions was not an effective approach to improving students’ subject understanding in complex algorithmic topics. i-Ntervene allows instructors to flexibly trial potential interventions to discover the optimal approach for their course settings which should boost student’s learning outcomes in long term. |
| first_indexed | 2024-03-12T21:06:07Z |
| format | Article |
| id | doaj.art-80fa48fa3b0b42a1bcd4a801a8057c62 |
| institution | Directory Open Access Journal |
| issn | 2196-7091 |
| language | English |
| last_indexed | 2024-03-12T21:06:07Z |
| publishDate | 2023-07-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Smart Learning Environments |
| spelling | doaj.art-80fa48fa3b0b42a1bcd4a801a8057c622023-07-30T11:26:54ZengSpringerOpenSmart Learning Environments2196-70912023-07-0110113010.1186/s40561-023-00257-7i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instructionPiriya Utamachant0Chutiporn Anutariya1Suporn Pongnumkul2ICT Department, School of Engineering and Technology, Asian Institute of TechnologyICT Department, School of Engineering and Technology, Asian Institute of TechnologyNational Electronics and Computer Technology CenterAbstract Apart from good instructional design and delivery, effective intervention is another key to strengthen student academic performance. However, intervention has been recognized as a great challenge. Most instructors struggle to identify at-risk students, determine a proper intervention approach, trace and evaluate whether the intervention works. This process requires extensive effort and commitment, which is impractical especially for large classes with few instructors. This paper proposes a platform, namely i-Ntervene, that integrates Learning Management System (LMS) automatic code grader, and learning analytics features which can empower systematic learning intervention for large programming classes. The platform supports instructor-pace courses on both Virtual Learning Environment (VLE) and traditional classroom setting. The platform iteratively assesses student engagement levels through learning activity gaps. It also analyzes subject understanding from programming question practices to identify at-risk students and suggests aspects of intervention based on their lagging in these areas. Students’ post-intervention data are traced and evaluated quantitatively to determine effective intervention approaches. This evaluation method aligns with the evidence-based research design. The developed i-Ntervene prototype was tested on a Java programming course with 253 first-year university students during the Covid-19 pandemic in VLE. The result was satisfactory, as the instructors were able to perform and evaluate 12 interventions throughout a semester. For this experimental course, the platform revealed that the approach of sending extrinsic motivation emails had more impact in promoting learning behavior compared to other types of messages. It also showed that providing tutorial sessions was not an effective approach to improving students’ subject understanding in complex algorithmic topics. i-Ntervene allows instructors to flexibly trial potential interventions to discover the optimal approach for their course settings which should boost student’s learning outcomes in long term.https://doi.org/10.1186/s40561-023-00257-7Learning intervention platformLearning analytics interventionLearning interventionInstructional interventionEvidence based interventionsIntervention in programming education |
| spellingShingle | Piriya Utamachant Chutiporn Anutariya Suporn Pongnumkul i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction Smart Learning Environments Learning intervention platform Learning analytics intervention Learning intervention Instructional intervention Evidence based interventions Intervention in programming education |
| title | i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction |
| title_full | i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction |
| title_fullStr | i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction |
| title_full_unstemmed | i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction |
| title_short | i-Ntervene: applying an evidence-based learning analytics intervention to support computer programming instruction |
| title_sort | i ntervene applying an evidence based learning analytics intervention to support computer programming instruction |
| topic | Learning intervention platform Learning analytics intervention Learning intervention Instructional intervention Evidence based interventions Intervention in programming education |
| url | https://doi.org/10.1186/s40561-023-00257-7 |
| work_keys_str_mv | AT piriyautamachant interveneapplyinganevidencebasedlearninganalyticsinterventiontosupportcomputerprogramminginstruction AT chutipornanutariya interveneapplyinganevidencebasedlearninganalyticsinterventiontosupportcomputerprogramminginstruction AT supornpongnumkul interveneapplyinganevidencebasedlearninganalyticsinterventiontosupportcomputerprogramminginstruction |