Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models
Analyzing the effective factors influencing online learning performance is a research topic that has garnered significant attention. Traditional approaches, such as multiple regression and structural equation models, tend to assume linearity, while non-linear machine learning models lack interpretab...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10323316/ |
| _version_ | 1797319537534697472 |
|---|---|
| author | Wen Xiao Juan Hu |
| author_facet | Wen Xiao Juan Hu |
| author_sort | Wen Xiao |
| collection | DOAJ |
| description | Analyzing the effective factors influencing online learning performance is a research topic that has garnered significant attention. Traditional approaches, such as multiple regression and structural equation models, tend to assume linearity, while non-linear machine learning models lack interpretability. To address this gap, we propose a framework that interprets machine learning models to analyze the effective factors of online learning performance. By applying this framework to four benchmark datasets of online learning, we examine the differential impact of various factors on performance, explore the interactions among these factors, and identify the key factors for representative learners. Our findings indicate that: 1) non-linear machine learning models, particularly Decision Regression, offer better representation of the non-linear relationship between effective factors and online learning performance compared to classical multivariate regression; 2) the factor of online learning behavior exerts a greater influence on performance than demographic features, academic background, or online curriculum design; 3) online learning behavior features exhibit additional interaction effects on performance; and 4) learners with medium performance are influenced by diverse effective factors, with active participation in online learning activities emerging as the most crucial means to improve performance. Interpreting machine learning models presents an innovative approach for analyzing the effective factors of online learning performance, which can be extended to other factor analysis studies. The results of this research provide valuable insights for optimizing machine learning models in predicting online learning performance and enhancing learner outcomes. |
| first_indexed | 2024-03-08T04:09:23Z |
| format | Article |
| id | doaj.art-321ac6799c9646b1bfb72b4c9afc56ba |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T04:09:23Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-321ac6799c9646b1bfb72b4c9afc56ba2024-02-09T00:00:56ZengIEEEIEEE Access2169-35362023-01-011113243513244710.1109/ACCESS.2023.333491510323316Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning ModelsWen Xiao0https://orcid.org/0000-0003-1444-908XJuan Hu1School of Educational Science, Anhui Normal University, Wuhu, ChinaSchool of Computer and Software, Anhui Institute of Information Technology, Wuhu, ChinaAnalyzing the effective factors influencing online learning performance is a research topic that has garnered significant attention. Traditional approaches, such as multiple regression and structural equation models, tend to assume linearity, while non-linear machine learning models lack interpretability. To address this gap, we propose a framework that interprets machine learning models to analyze the effective factors of online learning performance. By applying this framework to four benchmark datasets of online learning, we examine the differential impact of various factors on performance, explore the interactions among these factors, and identify the key factors for representative learners. Our findings indicate that: 1) non-linear machine learning models, particularly Decision Regression, offer better representation of the non-linear relationship between effective factors and online learning performance compared to classical multivariate regression; 2) the factor of online learning behavior exerts a greater influence on performance than demographic features, academic background, or online curriculum design; 3) online learning behavior features exhibit additional interaction effects on performance; and 4) learners with medium performance are influenced by diverse effective factors, with active participation in online learning activities emerging as the most crucial means to improve performance. Interpreting machine learning models presents an innovative approach for analyzing the effective factors of online learning performance, which can be extended to other factor analysis studies. The results of this research provide valuable insights for optimizing machine learning models in predicting online learning performance and enhancing learner outcomes.https://ieeexplore.ieee.org/document/10323316/Explainable AIeffective factorslearning performancemachine learningonline learning |
| spellingShingle | Wen Xiao Juan Hu Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models IEEE Access Explainable AI effective factors learning performance machine learning online learning |
| title | Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models |
| title_full | Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models |
| title_fullStr | Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models |
| title_full_unstemmed | Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models |
| title_short | Analyzing Effective Factors of Online Learning Performance by Interpreting Machine Learning Models |
| title_sort | analyzing effective factors of online learning performance by interpreting machine learning models |
| topic | Explainable AI effective factors learning performance machine learning online learning |
| url | https://ieeexplore.ieee.org/document/10323316/ |
| work_keys_str_mv | AT wenxiao analyzingeffectivefactorsofonlinelearningperformancebyinterpretingmachinelearningmodels AT juanhu analyzingeffectivefactorsofonlinelearningperformancebyinterpretingmachinelearningmodels |