Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics

When capacity constraints hinder university instructors’ ability to give feedback, software tools might provide a remedy. We analyzed students’ acceptance of automatic assessments and the development of learning-related characteristics such as motivation, achievement aspirations, and subjec...

Full description

Bibliographic Details
Main Authors: Seifried Eva, Lenhard Wolfgang, Spinath Birgit
Format: Article
Language:English
Published: Drustvo Psihologa Srbije 2016-01-01
Series:Psihologija
Subjects:
Online Access:http://www.doiserbia.nb.rs/img/doi/0048-5705/2016/0048-57051604469S.pdf
_version_ 1818435155195330560
author Seifried Eva
Lenhard Wolfgang
Spinath Birgit
author_facet Seifried Eva
Lenhard Wolfgang
Spinath Birgit
author_sort Seifried Eva
collection DOAJ
description When capacity constraints hinder university instructors’ ability to give feedback, software tools might provide a remedy. We analyzed students’ acceptance of automatic assessments and the development of learning-related characteristics such as motivation, achievement aspirations, and subjective learning. We randomly assigned university students to four groups that differed with regard to the real and assumed source of assessment of students’ texts (i.e., teaching assistant or software tool). Data from N = 300 students were analyzed. Assessments were less accepted when presumably coming from the software tool. Students mostly preferred human graders over computers in teaching in general, but this preference was weakened for some situations when students assumed they were being assessed by the software tool. Nevertheless, students saw some general merits to assessment by computers, and the development of learning-related characteristics was not affected by the real or assumed source of assessment. Thus, combining feedback from software tools and human graders seems to be a feasible way to expand feedback capacities in higher education.
first_indexed 2024-12-14T16:48:23Z
format Article
id doaj.art-b16a6ccc7ad743558d326e5013f54c72
institution Directory Open Access Journal
issn 0048-5705
1451-9283
language English
last_indexed 2024-12-14T16:48:23Z
publishDate 2016-01-01
publisher Drustvo Psihologa Srbije
record_format Article
series Psihologija
spelling doaj.art-b16a6ccc7ad743558d326e5013f54c722022-12-21T22:54:08ZengDrustvo Psihologa SrbijePsihologija0048-57051451-92832016-01-0149446948210.2298/PSI1604469S0048-57051604469SAutomatic essay assessment: Effects on students’ acceptance and on learning-related characteristicsSeifried Eva0Lenhard Wolfgang1Spinath Birgit2Heidelberg University, Heidelberg, GermanyUniversity of Würzburg, Würzburg, GermanyHeidelberg University, Heidelberg, GermanyWhen capacity constraints hinder university instructors’ ability to give feedback, software tools might provide a remedy. We analyzed students’ acceptance of automatic assessments and the development of learning-related characteristics such as motivation, achievement aspirations, and subjective learning. We randomly assigned university students to four groups that differed with regard to the real and assumed source of assessment of students’ texts (i.e., teaching assistant or software tool). Data from N = 300 students were analyzed. Assessments were less accepted when presumably coming from the software tool. Students mostly preferred human graders over computers in teaching in general, but this preference was weakened for some situations when students assumed they were being assessed by the software tool. Nevertheless, students saw some general merits to assessment by computers, and the development of learning-related characteristics was not affected by the real or assumed source of assessment. Thus, combining feedback from software tools and human graders seems to be a feasible way to expand feedback capacities in higher education.http://www.doiserbia.nb.rs/img/doi/0048-5705/2016/0048-57051604469S.pdfautomatic essay scoringacceptancemotivationachievement aspirationssubjective learninghigher education
spellingShingle Seifried Eva
Lenhard Wolfgang
Spinath Birgit
Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics
Psihologija
automatic essay scoring
acceptance
motivation
achievement aspirations
subjective learning
higher education
title Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics
title_full Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics
title_fullStr Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics
title_full_unstemmed Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics
title_short Automatic essay assessment: Effects on students’ acceptance and on learning-related characteristics
title_sort automatic essay assessment effects on students acceptance and on learning related characteristics
topic automatic essay scoring
acceptance
motivation
achievement aspirations
subjective learning
higher education
url http://www.doiserbia.nb.rs/img/doi/0048-5705/2016/0048-57051604469S.pdf
work_keys_str_mv AT seifriedeva automaticessayassessmenteffectsonstudentsacceptanceandonlearningrelatedcharacteristics
AT lenhardwolfgang automaticessayassessmenteffectsonstudentsacceptanceandonlearningrelatedcharacteristics
AT spinathbirgit automaticessayassessmenteffectsonstudentsacceptanceandonlearningrelatedcharacteristics