The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day

Observational assessment has become an integral component of the quality improvement agenda in Early Care and Education (ECE) and has been significant in directing attention to quality of interactions within the ECE setting. Understanding the functioning of observational assessment is increasingly i...

Full description

Bibliographic Details
Main Authors: Thorpe, K, Rankin, P, Beatton, T, Houen, S, Sandi, M, Siraj, I, Staton, S
Format: Journal article
Language:English
Published: Elsevier 2020
_version_ 1797065016690606080
author Thorpe, K
Rankin, P
Beatton, T
Houen, S
Sandi, M
Siraj, I
Staton, S
author_facet Thorpe, K
Rankin, P
Beatton, T
Houen, S
Sandi, M
Siraj, I
Staton, S
author_sort Thorpe, K
collection OXFORD
description Observational assessment has become an integral component of the quality improvement agenda in Early Care and Education (ECE) and has been significant in directing attention to quality of interactions within the ECE setting. Understanding the functioning of observational assessment is increasingly important as the stakes are high. Assessment outcomes influence programme funding. Assessment criteria direct educators to preference particular types of experiences for children, grounded in the assumptions that these criteria are those that best predict children's’ school readiness, ongoing achievements and wellbeing. We examine two contextual factors that might affect assessment functioning: (1) When – the timing of assessment in the ECE day and (2) What – the content and format of the activities observed. We provide the example of the Classroom Assessment Scoring System (CLASS), analysing 11,341 observations cycles undertaken in a representative sample of 2306 Australian pre-K (age 3–4 years) through Year 2 (age 7–8 years) classrooms. Our data show a generalised decline in instructional, organisational and emotional support across the ECE day (8am to 4pm) with recovery in emotional support at the end of the day. Within-classroom analyses demonstrate that whole group and small group formats and science, math, and social science content inflate, while meal times, physical activity, and transitions constrain CLASS scores. Separate analyses for pre-K classrooms showed similar patterns. We discuss the findings in terms of the purpose of assessment and suggest that particular times and events in the ECE day might serve as barometers of quality.
first_indexed 2024-03-06T21:22:36Z
format Journal article
id oxford-uuid:41fb00d4-1476-46bb-98fa-30c610f2e8f4
institution University of Oxford
language English
last_indexed 2024-03-06T21:22:36Z
publishDate 2020
publisher Elsevier
record_format dspace
spelling oxford-uuid:41fb00d4-1476-46bb-98fa-30c610f2e8f42022-03-26T14:46:53ZThe when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE dayJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:41fb00d4-1476-46bb-98fa-30c610f2e8f4EnglishSymplectic ElementsElsevier2020Thorpe, KRankin, PBeatton, THouen, SSandi, MSiraj, IStaton, SObservational assessment has become an integral component of the quality improvement agenda in Early Care and Education (ECE) and has been significant in directing attention to quality of interactions within the ECE setting. Understanding the functioning of observational assessment is increasingly important as the stakes are high. Assessment outcomes influence programme funding. Assessment criteria direct educators to preference particular types of experiences for children, grounded in the assumptions that these criteria are those that best predict children's’ school readiness, ongoing achievements and wellbeing. We examine two contextual factors that might affect assessment functioning: (1) When – the timing of assessment in the ECE day and (2) What – the content and format of the activities observed. We provide the example of the Classroom Assessment Scoring System (CLASS), analysing 11,341 observations cycles undertaken in a representative sample of 2306 Australian pre-K (age 3–4 years) through Year 2 (age 7–8 years) classrooms. Our data show a generalised decline in instructional, organisational and emotional support across the ECE day (8am to 4pm) with recovery in emotional support at the end of the day. Within-classroom analyses demonstrate that whole group and small group formats and science, math, and social science content inflate, while meal times, physical activity, and transitions constrain CLASS scores. Separate analyses for pre-K classrooms showed similar patterns. We discuss the findings in terms of the purpose of assessment and suggest that particular times and events in the ECE day might serve as barometers of quality.
spellingShingle Thorpe, K
Rankin, P
Beatton, T
Houen, S
Sandi, M
Siraj, I
Staton, S
The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
title The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
title_full The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
title_fullStr The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
title_full_unstemmed The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
title_short The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
title_sort when and what of measuring ece quality analysis of variation in the classroom assessment scoring system class across the ece day
work_keys_str_mv AT thorpek thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT rankinp thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT beattont thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT houens thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT sandim thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT siraji thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT statons thewhenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT thorpek whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT rankinp whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT beattont whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT houens whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT sandim whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT siraji whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday
AT statons whenandwhatofmeasuringecequalityanalysisofvariationintheclassroomassessmentscoringsystemclassacrosstheeceday