Towards development of a system for automatic assessment of the quality of a question paper

Abstract In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are...

Full description

Bibliographic Details
Main Author: Sujan Kumar Saha
Format: Article
Language:English
Published: SpringerOpen 2021-03-01
Series:Smart Learning Environments
Subjects:
Online Access:https://doi.org/10.1186/s40561-021-00148-9
_version_ 1818352578651488256
author Sujan Kumar Saha
author_facet Sujan Kumar Saha
author_sort Sujan Kumar Saha
collection DOAJ
description Abstract In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are prepared manually. A prior analysis of a question paper might help in finding the errors in the question paper, and better achieving the goals of the assessment. In this experiment, we focus on higher education in the technical domain. First, we conducted a student survey to identify the key factors that affect the quality of a question paper. The top factors we identified are question relevance, question difficulty, and time requirement. We explored the strategies to handle these factors and implemented them. We employ various concepts and techniques for the implementation. The system finally assigns a numerical quality score against these factors. The system is evaluated using a set of question papers collected from various sources. The experimental results show that the proposed system is quite promising.
first_indexed 2024-12-13T18:55:52Z
format Article
id doaj.art-f1c399655379412d94b8ae887e182e9e
institution Directory Open Access Journal
issn 2196-7091
language English
last_indexed 2024-12-13T18:55:52Z
publishDate 2021-03-01
publisher SpringerOpen
record_format Article
series Smart Learning Environments
spelling doaj.art-f1c399655379412d94b8ae887e182e9e2022-12-21T23:34:48ZengSpringerOpenSmart Learning Environments2196-70912021-03-018111410.1186/s40561-021-00148-9Towards development of a system for automatic assessment of the quality of a question paperSujan Kumar Saha0Department of Computer Science and Engineering, Birla Institute of Technology MesraAbstract In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are prepared manually. A prior analysis of a question paper might help in finding the errors in the question paper, and better achieving the goals of the assessment. In this experiment, we focus on higher education in the technical domain. First, we conducted a student survey to identify the key factors that affect the quality of a question paper. The top factors we identified are question relevance, question difficulty, and time requirement. We explored the strategies to handle these factors and implemented them. We employ various concepts and techniques for the implementation. The system finally assigns a numerical quality score against these factors. The system is evaluated using a set of question papers collected from various sources. The experimental results show that the proposed system is quite promising.https://doi.org/10.1186/s40561-021-00148-9Educational assessmentQuestion assessmentQuestion paper qualityQuestion difficultyQuestion relevance
spellingShingle Sujan Kumar Saha
Towards development of a system for automatic assessment of the quality of a question paper
Smart Learning Environments
Educational assessment
Question assessment
Question paper quality
Question difficulty
Question relevance
title Towards development of a system for automatic assessment of the quality of a question paper
title_full Towards development of a system for automatic assessment of the quality of a question paper
title_fullStr Towards development of a system for automatic assessment of the quality of a question paper
title_full_unstemmed Towards development of a system for automatic assessment of the quality of a question paper
title_short Towards development of a system for automatic assessment of the quality of a question paper
title_sort towards development of a system for automatic assessment of the quality of a question paper
topic Educational assessment
Question assessment
Question paper quality
Question difficulty
Question relevance
url https://doi.org/10.1186/s40561-021-00148-9
work_keys_str_mv AT sujankumarsaha towardsdevelopmentofasystemforautomaticassessmentofthequalityofaquestionpaper