Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence
Purpose – The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and in varian...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
Universiti Utara Malaysia Press
2018
|
| Subjects: |
| _version_ | 1803628836437360640 |
|---|---|
| author | Abu Kassim, Noor Lide Badrasawi, Kamal Jamil Inbrahim Nordin, Mohd Sahari Zubairi, Ainol Madziah Mohd Ashraf, Ratnawati |
| author_facet | Abu Kassim, Noor Lide Badrasawi, Kamal Jamil Inbrahim Nordin, Mohd Sahari Zubairi, Ainol Madziah Mohd Ashraf, Ratnawati |
| author_sort | Abu Kassim, Noor Lide |
| collection | UUM |
| description | Purpose – The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and in variance of the rating scale used for the assessment of the essay writing component of the Malaysian University English Test (MUET) in terms of the correspondence to empirical data and the theoretical construct of ESL writing.
Methodology – To determine the factorial validity of the MUET essay writing rating scale, a measurement model was developed based on the criteria description of the scale. Model-data fit was tested using CFA. The data comprised 392 essays, taken from a university English proficiency examination. Factorial in variance was tested through consecutively more restrictive models.Findings – 3-factor structure model was found to produce the best fit to the data. Factorial in variance was tested by examining the comparability of the structure and values of parameters within the model across two groups. A more restrictive model was subsequently tested, where variances and co variances of the latent constructs together with factor loading's were constrained to be equal for the two groups. The resultant goodness-of-fit indices showed a better fit to the data, providing support for the factorial in variance of the 3-factor structure model.Significance – The results support a 3-factor structure model, congruent with the theory of ESL writing. However, further validation needs to be carried out across different ESL populations to ensure accurate representation and assessment of ESL writing performance. |
| first_indexed | 2024-07-04T06:28:17Z |
| format | Article |
| id | uum-24936 |
| institution | Universiti Utara Malaysia |
| last_indexed | 2024-07-04T06:28:17Z |
| publishDate | 2018 |
| publisher | Universiti Utara Malaysia Press |
| record_format | dspace |
| spelling | uum-249362018-10-14T01:59:49Z https://repo.uum.edu.my/id/eprint/24936/ Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence Abu Kassim, Noor Lide Badrasawi, Kamal Jamil Inbrahim Nordin, Mohd Sahari Zubairi, Ainol Madziah Mohd Ashraf, Ratnawati LB2300 Higher Education Purpose – The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and in variance of the rating scale used for the assessment of the essay writing component of the Malaysian University English Test (MUET) in terms of the correspondence to empirical data and the theoretical construct of ESL writing. Methodology – To determine the factorial validity of the MUET essay writing rating scale, a measurement model was developed based on the criteria description of the scale. Model-data fit was tested using CFA. The data comprised 392 essays, taken from a university English proficiency examination. Factorial in variance was tested through consecutively more restrictive models.Findings – 3-factor structure model was found to produce the best fit to the data. Factorial in variance was tested by examining the comparability of the structure and values of parameters within the model across two groups. A more restrictive model was subsequently tested, where variances and co variances of the latent constructs together with factor loading's were constrained to be equal for the two groups. The resultant goodness-of-fit indices showed a better fit to the data, providing support for the factorial in variance of the 3-factor structure model.Significance – The results support a 3-factor structure model, congruent with the theory of ESL writing. However, further validation needs to be carried out across different ESL populations to ensure accurate representation and assessment of ESL writing performance. Universiti Utara Malaysia Press 2018-06 Article PeerReviewed Abu Kassim, Noor Lide and Badrasawi, Kamal Jamil Inbrahim and Nordin, Mohd Sahari and Zubairi, Ainol Madziah and Mohd Ashraf, Ratnawati (2018) Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence. Malaysian Journal of Learning and Instruction (MJLI), 15 (1). pp. 265-285. ISSN 1675-8110 http://www.mjli.uum.edu.my/index.php/current-issues#ii |
| spellingShingle | LB2300 Higher Education Abu Kassim, Noor Lide Badrasawi, Kamal Jamil Inbrahim Nordin, Mohd Sahari Zubairi, Ainol Madziah Mohd Ashraf, Ratnawati Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence |
| title | Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence |
| title_full | Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence |
| title_fullStr | Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence |
| title_full_unstemmed | Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence |
| title_short | Factorial Validity and Invariance of the MUET Writing Rating Scale: Empirical and Theoretical Correspondence |
| title_sort | factorial validity and invariance of the muet writing rating scale empirical and theoretical correspondence |
| topic | LB2300 Higher Education |
| work_keys_str_mv | AT abukassimnoorlide factorialvalidityandinvarianceofthemuetwritingratingscaleempiricalandtheoreticalcorrespondence AT badrasawikamaljamilinbrahim factorialvalidityandinvarianceofthemuetwritingratingscaleempiricalandtheoreticalcorrespondence AT nordinmohdsahari factorialvalidityandinvarianceofthemuetwritingratingscaleempiricalandtheoreticalcorrespondence AT zubairiainolmadziah factorialvalidityandinvarianceofthemuetwritingratingscaleempiricalandtheoreticalcorrespondence AT mohdashrafratnawati factorialvalidityandinvarianceofthemuetwritingratingscaleempiricalandtheoreticalcorrespondence |