Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour

The aim of this study was to identify process-related indicators for grading group essays. The research participants were students registered in a teacher-training course using an instructional design with face-to-face and digital blended learning. The course required the students in small collabora...

Full description

Bibliographic Details
Main Authors: Mei-Shiu Chiu, Ya Ping (Amy) Hsiao
Format: Article
Language:English
Published: Athens Institute for Education and Research 2023-11-01
Series:Athens Journal of Education
Subjects:
Online Access:http://www.athensjournals.gr/education/2023-10-4-2-Chiu.pdf
_version_ 1827337835565285376
author Mei-Shiu Chiu
Ya Ping (Amy) Hsiao
author_facet Mei-Shiu Chiu
Ya Ping (Amy) Hsiao
author_sort Mei-Shiu Chiu
collection DOAJ
description The aim of this study was to identify process-related indicators for grading group essays. The research participants were students registered in a teacher-training course using an instructional design with face-to-face and digital blended learning. The course required the students in small collaborative groups to design, implement, and evaluate a teaching program using creative pedagogical designs, which were documented using group essays. Four indicators relating to group essays along the course process were collected: (A) group essay grades assessed by different agents, (B) students’ other course grades or behaviours (i.e., multiple assessments) as well as (C) comment behaviours and (D) version history behaviours through an online co-editing system (i.e., Google Docs). Statistical analysis results indicated that the instructor’s group essay grades were related to the group essay grades assessed by out-group peers (i.e. peers from other groups), online group comment frequencies, and online group comment interaction density.
first_indexed 2024-03-07T19:02:53Z
format Article
id doaj.art-eb5c57827c234d28becf0760bae7d200
institution Directory Open Access Journal
issn 2241-7958
language English
last_indexed 2024-03-07T19:02:53Z
publishDate 2023-11-01
publisher Athens Institute for Education and Research
record_format Article
series Athens Journal of Education
spelling doaj.art-eb5c57827c234d28becf0760bae7d2002024-03-01T12:21:13ZengAthens Institute for Education and ResearchAthens Journal of Education2241-79582023-11-0110457559210.30958/aje.10-4-2Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour Mei-Shiu Chiu0Ya Ping (Amy) Hsiao1Professor, Department of Education, National Chengchi University, TaiwanAssessment Specialist, Tilburg University, The NetherlandsThe aim of this study was to identify process-related indicators for grading group essays. The research participants were students registered in a teacher-training course using an instructional design with face-to-face and digital blended learning. The course required the students in small collaborative groups to design, implement, and evaluate a teaching program using creative pedagogical designs, which were documented using group essays. Four indicators relating to group essays along the course process were collected: (A) group essay grades assessed by different agents, (B) students’ other course grades or behaviours (i.e., multiple assessments) as well as (C) comment behaviours and (D) version history behaviours through an online co-editing system (i.e., Google Docs). Statistical analysis results indicated that the instructor’s group essay grades were related to the group essay grades assessed by out-group peers (i.e. peers from other groups), online group comment frequencies, and online group comment interaction density.http://www.athensjournals.gr/education/2023-10-4-2-Chiu.pdfassessment methods and toolscollaborative learningessay gradinglearning analyticshigher education
spellingShingle Mei-Shiu Chiu
Ya Ping (Amy) Hsiao
Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
Athens Journal of Education
assessment methods and tools
collaborative learning
essay grading
learning analytics
higher education
title Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
title_full Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
title_fullStr Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
title_full_unstemmed Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
title_short Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
title_sort process indicators for grading group essays learning analytics of assessment data and online behaviour
topic assessment methods and tools
collaborative learning
essay grading
learning analytics
higher education
url http://www.athensjournals.gr/education/2023-10-4-2-Chiu.pdf
work_keys_str_mv AT meishiuchiu processindicatorsforgradinggroupessayslearninganalyticsofassessmentdataandonlinebehaviour
AT yapingamyhsiao processindicatorsforgradinggroupessayslearninganalyticsofassessmentdataandonlinebehaviour