Development of an assessment toolkit to measure higher order thinking skills among secondary school learners
Higher order thinking skills (HOT) emerged as the focus of student development across the primary to post-secondary levels since the publication of the Malaysian Education Blueprint (2013-2025). This blueprint outlines the need for thinking skills encompassing creativity, innovation, critical thinki...
| Main Authors: | , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
2017
|
| Subjects: | |
| Online Access: | http://eprints.um.edu.my/18971/1/Development_of_an_assessment_toolkit_to_measure_higher_order_thinking_skills.pdf |
| _version_ | 1825721208299061248 |
|---|---|
| author | Loh, S.C. Loo, C.K. Mamauag, M.F.M. Arosh, S.G. |
| author_facet | Loh, S.C. Loo, C.K. Mamauag, M.F.M. Arosh, S.G. |
| author_sort | Loh, S.C. |
| collection | UM |
| description | Higher order thinking skills (HOT) emerged as the focus of student development across the primary to post-secondary levels since the publication of the Malaysian Education Blueprint (2013-2025). This blueprint outlines the need for thinking skills encompassing creativity, innovation, critical thinking, and logical reasoning for students to adapt within the ever-changing technological landscape of the new millennia (Ministry of Education, 2013). Despite MOE's effort to implement PT3 (Form 3 Assessment) and HOTS questions in national school-leaving examinations, it apparently failed to accurately measure the levels of HOTS independent of content knowledge among Malaysian students. This study, therefore, was conceived to address the need for a more valid and reliable measurement of HOTS contextualized in a Malaysian setting. This theoretical paper is an attempt to set a framework by which HOTS' underlying measurement is anchored on. Based on a review of literature, operational definitions of the constructs on critical thinking, problem-solving, and creativity were derived. Three types of measures were developed, namely: (a) syllogisms, (b) situational judgment test (SJT), and (c) creativity. Thirty (30) syllogisms items to measure critical thinking, while 50 items of situational judgment tests to measure problem-solving were generated. The creativity test is adapted from an existing measure. Translated into Bahasa Malaysia, the first two tests are currently undergoing expert review prior to pilot-testing. These tests will be standardized using modern Item Response Theory (IRT) techniques, like Rasch modeling. The essential steps moving towards the full development of the HOTS assessment toolkit for the millennials in Malaysia are further discussed. |
| first_indexed | 2024-03-06T05:46:53Z |
| format | Conference or Workshop Item |
| id | um.eprints-18971 |
| institution | Universiti Malaya |
| language | English |
| last_indexed | 2024-03-06T05:46:53Z |
| publishDate | 2017 |
| record_format | dspace |
| spelling | um.eprints-189712018-08-08T08:22:39Z http://eprints.um.edu.my/18971/ Development of an assessment toolkit to measure higher order thinking skills among secondary school learners Loh, S.C. Loo, C.K. Mamauag, M.F.M. Arosh, S.G. L Education (General) LB1603 Secondary Education. High schools QA75 Electronic computers. Computer science Higher order thinking skills (HOT) emerged as the focus of student development across the primary to post-secondary levels since the publication of the Malaysian Education Blueprint (2013-2025). This blueprint outlines the need for thinking skills encompassing creativity, innovation, critical thinking, and logical reasoning for students to adapt within the ever-changing technological landscape of the new millennia (Ministry of Education, 2013). Despite MOE's effort to implement PT3 (Form 3 Assessment) and HOTS questions in national school-leaving examinations, it apparently failed to accurately measure the levels of HOTS independent of content knowledge among Malaysian students. This study, therefore, was conceived to address the need for a more valid and reliable measurement of HOTS contextualized in a Malaysian setting. This theoretical paper is an attempt to set a framework by which HOTS' underlying measurement is anchored on. Based on a review of literature, operational definitions of the constructs on critical thinking, problem-solving, and creativity were derived. Three types of measures were developed, namely: (a) syllogisms, (b) situational judgment test (SJT), and (c) creativity. Thirty (30) syllogisms items to measure critical thinking, while 50 items of situational judgment tests to measure problem-solving were generated. The creativity test is adapted from an existing measure. Translated into Bahasa Malaysia, the first two tests are currently undergoing expert review prior to pilot-testing. These tests will be standardized using modern Item Response Theory (IRT) techniques, like Rasch modeling. The essential steps moving towards the full development of the HOTS assessment toolkit for the millennials in Malaysia are further discussed. 2017 Conference or Workshop Item PeerReviewed application/pdf en http://eprints.um.edu.my/18971/1/Development_of_an_assessment_toolkit_to_measure_higher_order_thinking_skills.pdf Loh, S.C. and Loo, C.K. and Mamauag, M.F.M. and Arosh, S.G. (2017) Development of an assessment toolkit to measure higher order thinking skills among secondary school learners. In: Seminar Kebangsaan Majlis Dekan Pendidikan Universiti Awam 2017, 13-15 December 2017, Universiti Malaysia Sabah, Sabah. http://conferences.cseap.edu.my/medc2017/ |
| spellingShingle | L Education (General) LB1603 Secondary Education. High schools QA75 Electronic computers. Computer science Loh, S.C. Loo, C.K. Mamauag, M.F.M. Arosh, S.G. Development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| title | Development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| title_full | Development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| title_fullStr | Development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| title_full_unstemmed | Development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| title_short | Development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| title_sort | development of an assessment toolkit to measure higher order thinking skills among secondary school learners |
| topic | L Education (General) LB1603 Secondary Education. High schools QA75 Electronic computers. Computer science |
| url | http://eprints.um.edu.my/18971/1/Development_of_an_assessment_toolkit_to_measure_higher_order_thinking_skills.pdf |
| work_keys_str_mv | AT lohsc developmentofanassessmenttoolkittomeasurehigherorderthinkingskillsamongsecondaryschoollearners AT loock developmentofanassessmenttoolkittomeasurehigherorderthinkingskillsamongsecondaryschoollearners AT mamauagmfm developmentofanassessmenttoolkittomeasurehigherorderthinkingskillsamongsecondaryschoollearners AT aroshsg developmentofanassessmenttoolkittomeasurehigherorderthinkingskillsamongsecondaryschoollearners |