Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems

Teacher rating scales are broadly used for psycho-educational assessment in schools. In particular, they play an important role in screening students for social, emotional, and behavioral problems. In order to optimize the efficiency of these measures, it is important to minimize the number of items...

Full description

Bibliographic Details
Main Authors: Gino Casale, Moritz Herzog, Robert J. Volpe
Format: Article
Language:English
Published: MDPI AG 2023-03-01
Series:Journal of Intelligence
Subjects:
Online Access:https://www.mdpi.com/2079-3200/11/3/57
_version_ 1827749313197899776
author Gino Casale
Moritz Herzog
Robert J. Volpe
author_facet Gino Casale
Moritz Herzog
Robert J. Volpe
author_sort Gino Casale
collection DOAJ
description Teacher rating scales are broadly used for psycho-educational assessment in schools. In particular, they play an important role in screening students for social, emotional, and behavioral problems. In order to optimize the efficiency of these measures, it is important to minimize the number of items comprising them while maintaining sound psychometric characteristics. This study examines the measurement efficiency of a teacher rating scale for student social, emotional, and behavioral risk. The goal was to shorten an existing behavior screening tool. A total of 139 classroom teachers and 2566 students from Grades 1–6 (M<sub>age</sub> = 8.96 years, SD = 1.61) participated in the study. In sum, 35 items assessing internalizing and externalizing behavior problems were analyzed applying the item response theory (generalized partial credit model). The results show that social, emotional, and behavioral risks can be captured with a total of 12 items. This reduction of almost 66% of the initial item pool would take teachers about 90 s to fill out for one student. Thus, the rating scale can be used by teachers in an efficient yet psychometrically sound manner.
first_indexed 2024-03-11T06:20:50Z
format Article
id doaj.art-2308f105ea0140c09ef14243bfc1dc88
institution Directory Open Access Journal
issn 2079-3200
language English
last_indexed 2024-03-11T06:20:50Z
publishDate 2023-03-01
publisher MDPI AG
record_format Article
series Journal of Intelligence
spelling doaj.art-2308f105ea0140c09ef14243bfc1dc882023-11-17T11:55:35ZengMDPI AGJournal of Intelligence2079-32002023-03-011135710.3390/jintelligence11030057Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral ProblemsGino Casale0Moritz Herzog1Robert J. Volpe2School of Education, Institute for Educational Research, University of Wuppertal, Gaußstraße 20, 42119 Wuppertal, GermanySchool of Education, Institute for Educational Research, University of Wuppertal, Gaußstraße 20, 42119 Wuppertal, GermanyDepartment of Applied Psychology, Northeastern University, Boston, MA 02115, USATeacher rating scales are broadly used for psycho-educational assessment in schools. In particular, they play an important role in screening students for social, emotional, and behavioral problems. In order to optimize the efficiency of these measures, it is important to minimize the number of items comprising them while maintaining sound psychometric characteristics. This study examines the measurement efficiency of a teacher rating scale for student social, emotional, and behavioral risk. The goal was to shorten an existing behavior screening tool. A total of 139 classroom teachers and 2566 students from Grades 1–6 (M<sub>age</sub> = 8.96 years, SD = 1.61) participated in the study. In sum, 35 items assessing internalizing and externalizing behavior problems were analyzed applying the item response theory (generalized partial credit model). The results show that social, emotional, and behavioral risks can be captured with a total of 12 items. This reduction of almost 66% of the initial item pool would take teachers about 90 s to fill out for one student. Thus, the rating scale can be used by teachers in an efficient yet psychometrically sound manner.https://www.mdpi.com/2079-3200/11/3/57universal screeningitem response theorybehavior problemsschool-based assessment
spellingShingle Gino Casale
Moritz Herzog
Robert J. Volpe
Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems
Journal of Intelligence
universal screening
item response theory
behavior problems
school-based assessment
title Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems
title_full Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems
title_fullStr Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems
title_full_unstemmed Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems
title_short Measurement Efficiency of a Teacher Rating Scale to Screen for Students at Risk for Social, Emotional, and Behavioral Problems
title_sort measurement efficiency of a teacher rating scale to screen for students at risk for social emotional and behavioral problems
topic universal screening
item response theory
behavior problems
school-based assessment
url https://www.mdpi.com/2079-3200/11/3/57
work_keys_str_mv AT ginocasale measurementefficiencyofateacherratingscaletoscreenforstudentsatriskforsocialemotionalandbehavioralproblems
AT moritzherzog measurementefficiencyofateacherratingscaletoscreenforstudentsatriskforsocialemotionalandbehavioralproblems
AT robertjvolpe measurementefficiencyofateacherratingscaletoscreenforstudentsatriskforsocialemotionalandbehavioralproblems