Automatic Arabic Grading System for Short Answer Questions
The era of technology and digitalization has been advantageous to the educational sector. The examination system is one of the most important educational pillars that have been affected. As automatic exam grading is a revolution in the history of exam development, and therefore the automatic grading...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10102440/ |
| _version_ | 1797839219508379648 |
|---|---|
| author | Rasha M. Badry Mostafa Ali Esraa Rslan Mostafa R. Kaseb |
| author_facet | Rasha M. Badry Mostafa Ali Esraa Rslan Mostafa R. Kaseb |
| author_sort | Rasha M. Badry |
| collection | DOAJ |
| description | The era of technology and digitalization has been advantageous to the educational sector. The examination system is one of the most important educational pillars that have been affected. As automatic exam grading is a revolution in the history of exam development, and therefore the automatic grading system has started to replace the traditional assessment system. The automatic grading system allows the examiners to automatically assign grades for students’ answers compared to the model answers. And, generate results based on the examiners’ answers. In this paper, we especially address the short answer questions. Most research has been done on the English language. On the other side, few research works have been conducted on Arabic. Moreover, Arabic is considered one of the rare resource languages. This paper is aimed to build an Automatic Arabic Short Answer Grading (AASAG) model using semantic similarity approaches. It is used to measure the semantic similarity between the student and model answer. The proposed model is applied to one of the Arabic scarce publicly available datasets which is called (AR-ASAG). It contains 2133 pairs of models and student answers in several versions such as txt, xml, and db. The efficiency of the proposed model was evaluated through two conducted experiments using two weighting schemas local, and hybrid local and global weighting schema. The developed approach with hybrid local and global weight-based LSA achieved better results than using local weight-based LSA with (82.82%) as F1-score value, and 0.798 as an RMSE (Root-Mean-Square Error) value using hybrid local and global weight-based LSA. |
| first_indexed | 2024-04-09T15:54:34Z |
| format | Article |
| id | doaj.art-d79bad26a4ae45bbacc1ebab9385a4e7 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T15:54:34Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-d79bad26a4ae45bbacc1ebab9385a4e72023-04-25T23:00:26ZengIEEEIEEE Access2169-35362023-01-0111394573946510.1109/ACCESS.2023.326740710102440Automatic Arabic Grading System for Short Answer QuestionsRasha M. Badry0https://orcid.org/0000-0002-8094-5930Mostafa Ali1https://orcid.org/0000-0002-1691-8129Esraa Rslan2Mostafa R. Kaseb3https://orcid.org/0000-0001-9135-3271Faculty of Computers and Artificial Intelligence, Fayoum University, Fayoum, EgyptFaculty of Computers and Artificial Intelligence, Fayoum University, Fayoum, EgyptFaculty of Computers and Artificial Intelligence, Fayoum University, Fayoum, EgyptFaculty of Computers and Artificial Intelligence, Fayoum University, Fayoum, EgyptThe era of technology and digitalization has been advantageous to the educational sector. The examination system is one of the most important educational pillars that have been affected. As automatic exam grading is a revolution in the history of exam development, and therefore the automatic grading system has started to replace the traditional assessment system. The automatic grading system allows the examiners to automatically assign grades for students’ answers compared to the model answers. And, generate results based on the examiners’ answers. In this paper, we especially address the short answer questions. Most research has been done on the English language. On the other side, few research works have been conducted on Arabic. Moreover, Arabic is considered one of the rare resource languages. This paper is aimed to build an Automatic Arabic Short Answer Grading (AASAG) model using semantic similarity approaches. It is used to measure the semantic similarity between the student and model answer. The proposed model is applied to one of the Arabic scarce publicly available datasets which is called (AR-ASAG). It contains 2133 pairs of models and student answers in several versions such as txt, xml, and db. The efficiency of the proposed model was evaluated through two conducted experiments using two weighting schemas local, and hybrid local and global weighting schema. The developed approach with hybrid local and global weight-based LSA achieved better results than using local weight-based LSA with (82.82%) as F1-score value, and 0.798 as an RMSE (Root-Mean-Square Error) value using hybrid local and global weight-based LSA.https://ieeexplore.ieee.org/document/10102440/Short answer grading systemArabic languageglobal weight-based LSA |
| spellingShingle | Rasha M. Badry Mostafa Ali Esraa Rslan Mostafa R. Kaseb Automatic Arabic Grading System for Short Answer Questions IEEE Access Short answer grading system Arabic language global weight-based LSA |
| title | Automatic Arabic Grading System for Short Answer Questions |
| title_full | Automatic Arabic Grading System for Short Answer Questions |
| title_fullStr | Automatic Arabic Grading System for Short Answer Questions |
| title_full_unstemmed | Automatic Arabic Grading System for Short Answer Questions |
| title_short | Automatic Arabic Grading System for Short Answer Questions |
| title_sort | automatic arabic grading system for short answer questions |
| topic | Short answer grading system Arabic language global weight-based LSA |
| url | https://ieeexplore.ieee.org/document/10102440/ |
| work_keys_str_mv | AT rashambadry automaticarabicgradingsystemforshortanswerquestions AT mostafaali automaticarabicgradingsystemforshortanswerquestions AT esraarslan automaticarabicgradingsystemforshortanswerquestions AT mostafarkaseb automaticarabicgradingsystemforshortanswerquestions |