Towards development of a system for automatic assessment of the quality of a question paper
Abstract In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are...
Main Author: | |
---|---|
Format: | Article |
Language: | English |
Published: |
SpringerOpen
2021-03-01
|
Series: | Smart Learning Environments |
Subjects: | |
Online Access: | https://doi.org/10.1186/s40561-021-00148-9 |
_version_ | 1818352578651488256 |
---|---|
author | Sujan Kumar Saha |
author_facet | Sujan Kumar Saha |
author_sort | Sujan Kumar Saha |
collection | DOAJ |
description | Abstract In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are prepared manually. A prior analysis of a question paper might help in finding the errors in the question paper, and better achieving the goals of the assessment. In this experiment, we focus on higher education in the technical domain. First, we conducted a student survey to identify the key factors that affect the quality of a question paper. The top factors we identified are question relevance, question difficulty, and time requirement. We explored the strategies to handle these factors and implemented them. We employ various concepts and techniques for the implementation. The system finally assigns a numerical quality score against these factors. The system is evaluated using a set of question papers collected from various sources. The experimental results show that the proposed system is quite promising. |
first_indexed | 2024-12-13T18:55:52Z |
format | Article |
id | doaj.art-f1c399655379412d94b8ae887e182e9e |
institution | Directory Open Access Journal |
issn | 2196-7091 |
language | English |
last_indexed | 2024-12-13T18:55:52Z |
publishDate | 2021-03-01 |
publisher | SpringerOpen |
record_format | Article |
series | Smart Learning Environments |
spelling | doaj.art-f1c399655379412d94b8ae887e182e9e2022-12-21T23:34:48ZengSpringerOpenSmart Learning Environments2196-70912021-03-018111410.1186/s40561-021-00148-9Towards development of a system for automatic assessment of the quality of a question paperSujan Kumar Saha0Department of Computer Science and Engineering, Birla Institute of Technology MesraAbstract In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are prepared manually. A prior analysis of a question paper might help in finding the errors in the question paper, and better achieving the goals of the assessment. In this experiment, we focus on higher education in the technical domain. First, we conducted a student survey to identify the key factors that affect the quality of a question paper. The top factors we identified are question relevance, question difficulty, and time requirement. We explored the strategies to handle these factors and implemented them. We employ various concepts and techniques for the implementation. The system finally assigns a numerical quality score against these factors. The system is evaluated using a set of question papers collected from various sources. The experimental results show that the proposed system is quite promising.https://doi.org/10.1186/s40561-021-00148-9Educational assessmentQuestion assessmentQuestion paper qualityQuestion difficultyQuestion relevance |
spellingShingle | Sujan Kumar Saha Towards development of a system for automatic assessment of the quality of a question paper Smart Learning Environments Educational assessment Question assessment Question paper quality Question difficulty Question relevance |
title | Towards development of a system for automatic assessment of the quality of a question paper |
title_full | Towards development of a system for automatic assessment of the quality of a question paper |
title_fullStr | Towards development of a system for automatic assessment of the quality of a question paper |
title_full_unstemmed | Towards development of a system for automatic assessment of the quality of a question paper |
title_short | Towards development of a system for automatic assessment of the quality of a question paper |
title_sort | towards development of a system for automatic assessment of the quality of a question paper |
topic | Educational assessment Question assessment Question paper quality Question difficulty Question relevance |
url | https://doi.org/10.1186/s40561-021-00148-9 |
work_keys_str_mv | AT sujankumarsaha towardsdevelopmentofasystemforautomaticassessmentofthequalityofaquestionpaper |