The use of machine learning “black boxes” explanation systems to improve the quality of school education
The paper describes development of a multi-criteria decision support system (MCDSS) to improve the quality of school education. It is proposed to apply interpretable machine learning models for making decisions on improving the quality of education in secondary schools. Existing DSS are based on the...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2020-01-01
|
| Series: | Cogent Engineering |
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1080/23311916.2020.1769349 |
| _version_ | 1797706925908951040 |
|---|---|
| author | R. Muhamedyev K. Yakunin YA. Kuchin A. Symagulov T. Buldybayev S. Murzakhmetov A. Abdurazakov |
| author_facet | R. Muhamedyev K. Yakunin YA. Kuchin A. Symagulov T. Buldybayev S. Murzakhmetov A. Abdurazakov |
| author_sort | R. Muhamedyev |
| collection | DOAJ |
| description | The paper describes development of a multi-criteria decision support system (MCDSS) to improve the quality of school education. It is proposed to apply interpretable machine learning models for making decisions on improving the quality of education in secondary schools. Existing DSS are based on the expert judgement, which can be subjective. In addition, the large amount of data and features makes manual analysis difficult. Our approach is referred to as MCDSS with “black boxes” explainer, it consists of three stages. First, we develop the target indicators that measure the quality of education. A set of four features of quality of education (Q-Edu) has been developed. Secondly, we build regression models that link the data of the national educational database (NEDB) with target indicators. Thirdly, we use machine learning model interpreters to develop recommendations. The disadvantage associated with the difficulties of interpreting the results of models is overcome by SHAP (SHapley Additive exPlanations), which is used as a basis for developing recommendations for what features of educational institution could be altered in order to improve quality indicators. Using the described process, we, in particular, revealed the positive impact of the location of the school, ratio of experienced teachers, sports, technical and art studios on Q-Edu indicators. The ratio of experienced teachers and, at the same time, young teachers younger than 25 year positively affects the number of significant student achievements. The proposed universal approach reduces the subjectivity and laboriousness of parameter significance determination in MCDSS. |
| first_indexed | 2024-03-12T05:58:35Z |
| format | Article |
| id | doaj.art-709ddaa32e82483688f2a5336dc8d2e3 |
| institution | Directory Open Access Journal |
| issn | 2331-1916 |
| language | English |
| last_indexed | 2024-03-12T05:58:35Z |
| publishDate | 2020-01-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Cogent Engineering |
| spelling | doaj.art-709ddaa32e82483688f2a5336dc8d2e32023-09-03T04:21:10ZengTaylor & Francis GroupCogent Engineering2331-19162020-01-017110.1080/23311916.2020.17693491769349The use of machine learning “black boxes” explanation systems to improve the quality of school educationR. Muhamedyev0K. Yakunin1YA. Kuchin2A. Symagulov3T. Buldybayev4S. Murzakhmetov5A. Abdurazakov6Satbayev University (Kazakh National Research Technical University named after K.I. Satbayev)Satbayev University (Kazakh National Research Technical University named after K.I. Satbayev)Satbayev University (Kazakh National Research Technical University named after K.I. Satbayev)Satbayev University (Kazakh National Research Technical University named after K.I. Satbayev)Information and Analytical Center of the Ministry of Education and Science of the Republic of KazakhstanSatbayev University (Kazakh National Research Technical University named after K.I. Satbayev)Satbayev University (Kazakh National Research Technical University named after K.I. Satbayev)The paper describes development of a multi-criteria decision support system (MCDSS) to improve the quality of school education. It is proposed to apply interpretable machine learning models for making decisions on improving the quality of education in secondary schools. Existing DSS are based on the expert judgement, which can be subjective. In addition, the large amount of data and features makes manual analysis difficult. Our approach is referred to as MCDSS with “black boxes” explainer, it consists of three stages. First, we develop the target indicators that measure the quality of education. A set of four features of quality of education (Q-Edu) has been developed. Secondly, we build regression models that link the data of the national educational database (NEDB) with target indicators. Thirdly, we use machine learning model interpreters to develop recommendations. The disadvantage associated with the difficulties of interpreting the results of models is overcome by SHAP (SHapley Additive exPlanations), which is used as a basis for developing recommendations for what features of educational institution could be altered in order to improve quality indicators. Using the described process, we, in particular, revealed the positive impact of the location of the school, ratio of experienced teachers, sports, technical and art studios on Q-Edu indicators. The ratio of experienced teachers and, at the same time, young teachers younger than 25 year positively affects the number of significant student achievements. The proposed universal approach reduces the subjectivity and laboriousness of parameter significance determination in MCDSS.http://dx.doi.org/10.1080/23311916.2020.1769349education qualitymachine learningmulti-criteria decision support systemsinterpretable machine learning“black boxes” explanationshap (shapley additive explanations) |
| spellingShingle | R. Muhamedyev K. Yakunin YA. Kuchin A. Symagulov T. Buldybayev S. Murzakhmetov A. Abdurazakov The use of machine learning “black boxes” explanation systems to improve the quality of school education Cogent Engineering education quality machine learning multi-criteria decision support systems interpretable machine learning “black boxes” explanation shap (shapley additive explanations) |
| title | The use of machine learning “black boxes” explanation systems to improve the quality of school education |
| title_full | The use of machine learning “black boxes” explanation systems to improve the quality of school education |
| title_fullStr | The use of machine learning “black boxes” explanation systems to improve the quality of school education |
| title_full_unstemmed | The use of machine learning “black boxes” explanation systems to improve the quality of school education |
| title_short | The use of machine learning “black boxes” explanation systems to improve the quality of school education |
| title_sort | use of machine learning black boxes explanation systems to improve the quality of school education |
| topic | education quality machine learning multi-criteria decision support systems interpretable machine learning “black boxes” explanation shap (shapley additive explanations) |
| url | http://dx.doi.org/10.1080/23311916.2020.1769349 |
| work_keys_str_mv | AT rmuhamedyev theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT kyakunin theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT yakuchin theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT asymagulov theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT tbuldybayev theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT smurzakhmetov theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT aabdurazakov theuseofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT rmuhamedyev useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT kyakunin useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT yakuchin useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT asymagulov useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT tbuldybayev useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT smurzakhmetov useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation AT aabdurazakov useofmachinelearningblackboxesexplanationsystemstoimprovethequalityofschooleducation |