Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model
Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and...
| Principais autores: | , |
|---|---|
| Formato: | Artigo |
| Idioma: | English English |
| Publicado em: |
Scientia Socialis Ltd
2021
|
| Assuntos: | |
| Acesso em linha: | https://eprints.ums.edu.my/id/eprint/31861/1/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model.pdf https://eprints.ums.edu.my/id/eprint/31861/2/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model1.pdf |
| _version_ | 1825714586838368256 |
|---|---|
| author | Najah Hazirah Mohd Dzin Lay, Yoon Fah |
| author_facet | Najah Hazirah Mohd Dzin Lay, Yoon Fah |
| author_sort | Najah Hazirah Mohd Dzin |
| collection | UMS |
| description | Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach’s Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension. |
| first_indexed | 2024-03-06T03:14:02Z |
| format | Article |
| id | ums.eprints-31861 |
| institution | Universiti Malaysia Sabah |
| language | English English |
| last_indexed | 2024-03-06T03:14:02Z |
| publishDate | 2021 |
| publisher | Scientia Socialis Ltd |
| record_format | dspace |
| spelling | ums.eprints-318612022-03-16T07:34:08Z https://eprints.ums.edu.my/id/eprint/31861/ Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model Najah Hazirah Mohd Dzin Lay, Yoon Fah LB1603-1696.6 Secondary education. High schools Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach’s Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension. Scientia Socialis Ltd 2021 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/31861/1/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model.pdf text en https://eprints.ums.edu.my/id/eprint/31861/2/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model1.pdf Najah Hazirah Mohd Dzin and Lay, Yoon Fah (2021) Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model. Journal of Baltic Science Education, 20. pp. 924-941. ISSN 1648-3898 (P-ISSN) , 2538-7138 (E-ISSN) http://oaji.net/articles/2021/987-1639222215.pdf https://dx.doi.org/10.33225/jbse/21.20.927 https://dx.doi.org/10.33225/jbse/21.20.927 |
| spellingShingle | LB1603-1696.6 Secondary education. High schools Najah Hazirah Mohd Dzin Lay, Yoon Fah Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| title | Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| title_full | Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| title_fullStr | Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| title_full_unstemmed | Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| title_short | Assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| title_sort | assessing the validity and reliability of science multiple choice test using rasch dichotomous measurement model |
| topic | LB1603-1696.6 Secondary education. High schools |
| url | https://eprints.ums.edu.my/id/eprint/31861/1/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model.pdf https://eprints.ums.edu.my/id/eprint/31861/2/Assessing%20the%20validity%20and%20reliability%20of%20science%20multiple%20choice%20test%20using%20rasch%20dichotomous%20measurement%20model1.pdf |
| work_keys_str_mv | AT najahhazirahmohddzin assessingthevalidityandreliabilityofsciencemultiplechoicetestusingraschdichotomousmeasurementmodel AT layyoonfah assessingthevalidityandreliabilityofsciencemultiplechoicetestusingraschdichotomousmeasurementmodel |