Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing
Abstract The role of internet technology in higher education and particularly in teaching English as a Foreign language is increasingly prominent because of the interest in the ways in which technology can be applied to support students. The automated evaluation scoring system is a typical demonstra...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-12-01
|
| Series: | Asian-Pacific Journal of Second and Foreign Language Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40862-022-00171-4 |
| _version_ | 1797980532885159936 |
|---|---|
| author | Huimei Chen Jie Pan |
| author_facet | Huimei Chen Jie Pan |
| author_sort | Huimei Chen |
| collection | DOAJ |
| description | Abstract The role of internet technology in higher education and particularly in teaching English as a Foreign language is increasingly prominent because of the interest in the ways in which technology can be applied to support students. The automated evaluation scoring system is a typical demonstration of the application of network technology in the teaching of English writing. Many writing scoring platforms have been developed and used in China, which can provide online instant and corrective feedback on students’ writing. However, the validity of Aim Writing, a product developed by Microsoft Research Asia, which claims to be the best tool to facilitate Chinese EFL learners, has not been tested in previous studies. In this mixed methods study, the feedback and effect of Aim Writing on college students’ writing will be investigated and compared to the instructor’s feedback. The results indicate that Aim Writing’s performance is insufficient to support all students’ needs for writing and that colleges should encourage a hybrid model that contains both AES and instructor’s feedback in writing. |
| first_indexed | 2024-04-11T05:55:41Z |
| format | Article |
| id | doaj.art-a73fde13e8dc41fc9a8aa595e2a224d5 |
| institution | Directory Open Access Journal |
| issn | 2363-5169 |
| language | English |
| last_indexed | 2024-04-11T05:55:41Z |
| publishDate | 2022-12-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Asian-Pacific Journal of Second and Foreign Language Education |
| spelling | doaj.art-a73fde13e8dc41fc9a8aa595e2a224d52022-12-22T04:41:54ZengSpringerOpenAsian-Pacific Journal of Second and Foreign Language Education2363-51692022-12-017112010.1186/s40862-022-00171-4Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writingHuimei Chen0Jie Pan1College of Education, Northern Arizona UniversityCollege of Education, Northern Arizona UniversityAbstract The role of internet technology in higher education and particularly in teaching English as a Foreign language is increasingly prominent because of the interest in the ways in which technology can be applied to support students. The automated evaluation scoring system is a typical demonstration of the application of network technology in the teaching of English writing. Many writing scoring platforms have been developed and used in China, which can provide online instant and corrective feedback on students’ writing. However, the validity of Aim Writing, a product developed by Microsoft Research Asia, which claims to be the best tool to facilitate Chinese EFL learners, has not been tested in previous studies. In this mixed methods study, the feedback and effect of Aim Writing on college students’ writing will be investigated and compared to the instructor’s feedback. The results indicate that Aim Writing’s performance is insufficient to support all students’ needs for writing and that colleges should encourage a hybrid model that contains both AES and instructor’s feedback in writing.https://doi.org/10.1186/s40862-022-00171-4EFL writingAES systemHuman raterHigher education |
| spellingShingle | Huimei Chen Jie Pan Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing Asian-Pacific Journal of Second and Foreign Language Education EFL writing AES system Human rater Higher education |
| title | Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing |
| title_full | Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing |
| title_fullStr | Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing |
| title_full_unstemmed | Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing |
| title_short | Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing |
| title_sort | computer or human a comparative study of automated evaluation scoring and instructors feedback on chinese college students english writing |
| topic | EFL writing AES system Human rater Higher education |
| url | https://doi.org/10.1186/s40862-022-00171-4 |
| work_keys_str_mv | AT huimeichen computerorhumanacomparativestudyofautomatedevaluationscoringandinstructorsfeedbackonchinesecollegestudentsenglishwriting AT jiepan computerorhumanacomparativestudyofautomatedevaluationscoringandinstructorsfeedbackonchinesecollegestudentsenglishwriting |