Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools

This paper aims to describe the development process of the Observation Protocol for Teaching Activities in Mathematics (POAEM) and to report the findings from the qualitative and statistical analyses used to provide evidence of validity and reliability of the information collected with the first ver...

Full description

Bibliographic Details
Main Authors: Lesly Yahaira Rodriguez-Martinez, Paul Hernandez-Martinez, Maria Guadalupe Perez-Martinez
Format: Article
Language:English
Published: Sriwijaya University 2023-10-01
Series:Journal on Mathematics Education
Subjects:
Online Access:http://jme.ejournal.unsri.ac.id/index.php/jme/article/view/464
_version_ 1797653888855179264
author Lesly Yahaira Rodriguez-Martinez
Paul Hernandez-Martinez
Maria Guadalupe Perez-Martinez
author_facet Lesly Yahaira Rodriguez-Martinez
Paul Hernandez-Martinez
Maria Guadalupe Perez-Martinez
author_sort Lesly Yahaira Rodriguez-Martinez
collection DOAJ
description This paper aims to describe the development process of the Observation Protocol for Teaching Activities in Mathematics (POAEM) and to report the findings from the qualitative and statistical analyses used to provide evidence of validity and reliability of the information collected with the first version of the POAEM. As part of this development process, 20 teachers from Mexican primary schools were videotaped twice while teaching mathematics. The study assessed the reliability of the POAEM rubrics. Results showed that the dimensional structure of the instrument can be grouped in one factor. A generalizability study provided information on the different sources of error in the measurement, showing that the dimensions accounted for 78% of the variance. This study provides an exemplar of the design and validation of an instrument that can help other researchers develop their own instruments and data collection to generate evidence of validity and reliability in different sociocultural contexts.
first_indexed 2024-03-11T16:51:20Z
format Article
id doaj.art-5f8eba223bd047c4ad337aa267db086f
institution Directory Open Access Journal
issn 2087-8885
language English
last_indexed 2024-03-11T16:51:20Z
publishDate 2023-10-01
publisher Sriwijaya University
record_format Article
series Journal on Mathematics Education
spelling doaj.art-5f8eba223bd047c4ad337aa267db086f2023-10-21T06:29:22ZengSriwijaya UniversityJournal on Mathematics Education2087-88852023-10-0114478179610.22342/jme.v14i4.pp781-796464Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schoolsLesly Yahaira Rodriguez-Martinez0https://orcid.org/0000-0001-7069-1474Paul Hernandez-Martinez1https://orcid.org/0000-0002-1084-3189Maria Guadalupe Perez-Martinez2https://orcid.org/0000-0003-3655-0090Centro de Investigación y Docencia Económicas, Aguascalientes, MexicoDepartment of Mathematics, Swinburne University of Technology, Melbourne, AustraliaDepartment of Education, Universidad Autónoma de Aguascalientes, Aguascalientes, MexicoThis paper aims to describe the development process of the Observation Protocol for Teaching Activities in Mathematics (POAEM) and to report the findings from the qualitative and statistical analyses used to provide evidence of validity and reliability of the information collected with the first version of the POAEM. As part of this development process, 20 teachers from Mexican primary schools were videotaped twice while teaching mathematics. The study assessed the reliability of the POAEM rubrics. Results showed that the dimensional structure of the instrument can be grouped in one factor. A generalizability study provided information on the different sources of error in the measurement, showing that the dimensions accounted for 78% of the variance. This study provides an exemplar of the design and validation of an instrument that can help other researchers develop their own instruments and data collection to generate evidence of validity and reliability in different sociocultural contexts.http://jme.ejournal.unsri.ac.id/index.php/jme/article/view/464educational assessmenthigher order thinking skillsobservation protocolprimary school mathematics educationteaching mathematics
spellingShingle Lesly Yahaira Rodriguez-Martinez
Paul Hernandez-Martinez
Maria Guadalupe Perez-Martinez
Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools
Journal on Mathematics Education
educational assessment
higher order thinking skills
observation protocol
primary school mathematics education
teaching mathematics
title Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools
title_full Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools
title_fullStr Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools
title_full_unstemmed Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools
title_short Development of a protocol to measure mathematics higher-order thinking skills in Mexican primary schools
title_sort development of a protocol to measure mathematics higher order thinking skills in mexican primary schools
topic educational assessment
higher order thinking skills
observation protocol
primary school mathematics education
teaching mathematics
url http://jme.ejournal.unsri.ac.id/index.php/jme/article/view/464
work_keys_str_mv AT leslyyahairarodriguezmartinez developmentofaprotocoltomeasuremathematicshigherorderthinkingskillsinmexicanprimaryschools
AT paulhernandezmartinez developmentofaprotocoltomeasuremathematicshigherorderthinkingskillsinmexicanprimaryschools
AT mariaguadalupeperezmartinez developmentofaprotocoltomeasuremathematicshigherorderthinkingskillsinmexicanprimaryschools