Assessing the quality of a student-generated question repository

We present results from a study that categorizes and assesses the quality of questions and explanations authored by students in question repositories produced as part of the summative assessment in introductory physics courses over two academic sessions. Mapping question quality onto the levels in t...

Full description

Bibliographic Details
Main Authors: Simon P. Bates, Ross K. Galloway, Jonathan Riise, Danny Homer
Format: Article
Language:English
Published: American Physical Society 2014-07-01
Series:Physical Review Special Topics. Physics Education Research
Online Access:http://doi.org/10.1103/PhysRevSTPER.10.020105
_version_ 1818896983522279424
author Simon P. Bates
Ross K. Galloway
Jonathan Riise
Danny Homer
author_facet Simon P. Bates
Ross K. Galloway
Jonathan Riise
Danny Homer
author_sort Simon P. Bates
collection DOAJ
description We present results from a study that categorizes and assesses the quality of questions and explanations authored by students in question repositories produced as part of the summative assessment in introductory physics courses over two academic sessions. Mapping question quality onto the levels in the cognitive domain of Bloom’s taxonomy, we find that students produce questions of high quality. More than three-quarters of questions fall into categories beyond simple recall, in contrast to similar studies of student-authored content in different subject domains. Similarly, the quality of student-authored explanations for questions was also high, with approximately 60% of all explanations classified as being of high or outstanding quality. Overall, 75% of questions met combined quality criteria, which we hypothesize is due in part to the in-class scaffolding activities that we provided for students ahead of requiring them to author questions. This work presents the first systematic investigation into the quality of student produced assessment material in an introductory physics context, and thus complements and extends related studies in other disciplines.
first_indexed 2024-12-19T19:08:57Z
format Article
id doaj.art-bd8bf6f6838e4f89a4f057f254b304ea
institution Directory Open Access Journal
issn 1554-9178
language English
last_indexed 2024-12-19T19:08:57Z
publishDate 2014-07-01
publisher American Physical Society
record_format Article
series Physical Review Special Topics. Physics Education Research
spelling doaj.art-bd8bf6f6838e4f89a4f057f254b304ea2022-12-21T20:09:22ZengAmerican Physical SocietyPhysical Review Special Topics. Physics Education Research1554-91782014-07-0110202010510.1103/PhysRevSTPER.10.020105Assessing the quality of a student-generated question repositorySimon P. BatesRoss K. GallowayJonathan RiiseDanny HomerWe present results from a study that categorizes and assesses the quality of questions and explanations authored by students in question repositories produced as part of the summative assessment in introductory physics courses over two academic sessions. Mapping question quality onto the levels in the cognitive domain of Bloom’s taxonomy, we find that students produce questions of high quality. More than three-quarters of questions fall into categories beyond simple recall, in contrast to similar studies of student-authored content in different subject domains. Similarly, the quality of student-authored explanations for questions was also high, with approximately 60% of all explanations classified as being of high or outstanding quality. Overall, 75% of questions met combined quality criteria, which we hypothesize is due in part to the in-class scaffolding activities that we provided for students ahead of requiring them to author questions. This work presents the first systematic investigation into the quality of student produced assessment material in an introductory physics context, and thus complements and extends related studies in other disciplines.http://doi.org/10.1103/PhysRevSTPER.10.020105
spellingShingle Simon P. Bates
Ross K. Galloway
Jonathan Riise
Danny Homer
Assessing the quality of a student-generated question repository
Physical Review Special Topics. Physics Education Research
title Assessing the quality of a student-generated question repository
title_full Assessing the quality of a student-generated question repository
title_fullStr Assessing the quality of a student-generated question repository
title_full_unstemmed Assessing the quality of a student-generated question repository
title_short Assessing the quality of a student-generated question repository
title_sort assessing the quality of a student generated question repository
url http://doi.org/10.1103/PhysRevSTPER.10.020105
work_keys_str_mv AT simonpbates assessingthequalityofastudentgeneratedquestionrepository
AT rosskgalloway assessingthequalityofastudentgeneratedquestionrepository
AT jonathanriise assessingthequalityofastudentgeneratedquestionrepository
AT dannyhomer assessingthequalityofastudentgeneratedquestionrepository