Assessment of the analytic scale of argumentative writing (ASAW)
The Analytic Scale of Argumentative Writing (ASAW) was developed because of the need for a genre-specific scale to assess English as a Second Language (ESL) university student writers’ argumentative essays. The present study reports the findings of field-testing ASAW. For this purpose, argumentativ...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universiti Putra Malaysia Press
2021
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/92601/1/01%20JSSH%28S%29-1508-2021.pdf |
| _version_ | 1796982758137921536 |
|---|---|
| author | Nimehchisalem, Vahid Mukundan, Jayakaran Rafik-Galea, Shameem Abd Samad, Arshad |
| author_facet | Nimehchisalem, Vahid Mukundan, Jayakaran Rafik-Galea, Shameem Abd Samad, Arshad |
| author_sort | Nimehchisalem, Vahid |
| collection | UPM |
| description | The Analytic Scale of Argumentative Writing (ASAW) was developed because of the need for a genre-specific scale to assess English as a Second Language (ESL) university student writers’ argumentative essays. The present study reports the findings of field-testing ASAW.
For this purpose, argumentative samples (n = 110) were collected and remote-scored by experienced raters (n = 5) who used ASAW. Overall, moderate to high inter-rater reliability (r = 0.7-0.9), as well as high (r = 0.84-0.92) and moderate to high (r = 0.70-0.77) intrarater reliability coefficients after short (6-week) and long (9-week) rating intervals were obtained, respectively. Some established instruments were used to score the same essays rated using ASAW to test the concurrent validity of the scale. The scores assigned by the raters using the scale demonstrated moderate (r = 0.51) to high (r = 0.77) correlations with the scores awarded using several other standard instruments. The raters who used ASAW were given a questionnaire to evaluate the scale itself, and on average, the results indicated that the raters were highly satisfied with it. It took an average of 5.5 minutes for the raters to evaluate an essay, indicating it was economical. The study has useful implications for refinement of ASAW and development and validation of similar scales and benchmarks in the future. |
| first_indexed | 2024-03-06T10:56:34Z |
| format | Article |
| id | upm.eprints-92601 |
| institution | Universiti Putra Malaysia |
| language | English |
| last_indexed | 2024-03-06T10:56:34Z |
| publishDate | 2021 |
| publisher | Universiti Putra Malaysia Press |
| record_format | dspace |
| spelling | upm.eprints-926012022-05-27T22:44:29Z http://psasir.upm.edu.my/id/eprint/92601/ Assessment of the analytic scale of argumentative writing (ASAW) Nimehchisalem, Vahid Mukundan, Jayakaran Rafik-Galea, Shameem Abd Samad, Arshad The Analytic Scale of Argumentative Writing (ASAW) was developed because of the need for a genre-specific scale to assess English as a Second Language (ESL) university student writers’ argumentative essays. The present study reports the findings of field-testing ASAW. For this purpose, argumentative samples (n = 110) were collected and remote-scored by experienced raters (n = 5) who used ASAW. Overall, moderate to high inter-rater reliability (r = 0.7-0.9), as well as high (r = 0.84-0.92) and moderate to high (r = 0.70-0.77) intrarater reliability coefficients after short (6-week) and long (9-week) rating intervals were obtained, respectively. Some established instruments were used to score the same essays rated using ASAW to test the concurrent validity of the scale. The scores assigned by the raters using the scale demonstrated moderate (r = 0.51) to high (r = 0.77) correlations with the scores awarded using several other standard instruments. The raters who used ASAW were given a questionnaire to evaluate the scale itself, and on average, the results indicated that the raters were highly satisfied with it. It took an average of 5.5 minutes for the raters to evaluate an essay, indicating it was economical. The study has useful implications for refinement of ASAW and development and validation of similar scales and benchmarks in the future. Universiti Putra Malaysia Press 2021 Article PeerReviewed text en http://psasir.upm.edu.my/id/eprint/92601/1/01%20JSSH%28S%29-1508-2021.pdf Nimehchisalem, Vahid and Mukundan, Jayakaran and Rafik-Galea, Shameem and Abd Samad, Arshad (2021) Assessment of the analytic scale of argumentative writing (ASAW). Pertanika Journal of Social Science and Humanities, 29 (spec.3). pp. 1-25. ISSN 0128-7702; ESSN: 2231-8534 http://www.journals-jd.upm.edu.my/pjssh/browse/special-issue?article=JSSH(S)-508-2021 10.47836/pjssh.29.S3.01 |
| spellingShingle | Nimehchisalem, Vahid Mukundan, Jayakaran Rafik-Galea, Shameem Abd Samad, Arshad Assessment of the analytic scale of argumentative writing (ASAW) |
| title | Assessment of the analytic scale of argumentative writing
(ASAW) |
| title_full | Assessment of the analytic scale of argumentative writing
(ASAW) |
| title_fullStr | Assessment of the analytic scale of argumentative writing
(ASAW) |
| title_full_unstemmed | Assessment of the analytic scale of argumentative writing
(ASAW) |
| title_short | Assessment of the analytic scale of argumentative writing
(ASAW) |
| title_sort | assessment of the analytic scale of argumentative writing asaw |
| url | http://psasir.upm.edu.my/id/eprint/92601/1/01%20JSSH%28S%29-1508-2021.pdf |
| work_keys_str_mv | AT nimehchisalemvahid assessmentoftheanalyticscaleofargumentativewritingasaw AT mukundanjayakaran assessmentoftheanalyticscaleofargumentativewritingasaw AT rafikgaleashameem assessmentoftheanalyticscaleofargumentativewritingasaw AT abdsamadarshad assessmentoftheanalyticscaleofargumentativewritingasaw |