Machine translation output assessment and its impact on reading comprehension

Background and Objectives: Machine translation is now widely used everywhere; However, its role as a language learning tool has not been confirmed, as there are concerns about its quality. However, if we compare the machine translation output with the output produced ten years ago, we see a signific...

Full description

Bibliographic Details
Main Author: V.R. Mirzaeian
Format: Article
Language:fas
Published: Shahid Rajaee Teacher Training University (SRTTU) 2020-03-01
Series:Fanāvarī-i āmūzish
Subjects:
Online Access:https://jte.sru.ac.ir/article_1200_a9f6df924237009073d0679e7cdb6fc2.pdf
_version_ 1819069434183024640
author V.R. Mirzaeian
author_facet V.R. Mirzaeian
author_sort V.R. Mirzaeian
collection DOAJ
description Background and Objectives: Machine translation is now widely used everywhere; However, its role as a language learning tool has not been confirmed, as there are concerns about its quality. However, if we compare the machine translation output with the output produced ten years ago, we see a significant improvement in its quality, especially in terms of vocabulary and grammar. Machine translation can be defined as: the process by which, using electronic devices, input can be provided from one language and output delivered in another language. When machine translation became available on smartphones, it gained universal acceptance because of its benefits such as free and easy access. In the field of education, many learners use this technology every day for various personal as well as academic purposes. These goals mainly include understanding a text that is not written in the native language or translating different texts from different languages into other languages and delivering it as homework. Machine translation can help learners gain a quick understanding of a text written in a language other than their mother tongue by producing an incomplete version. The aim of this research was to assess the quality of machine translation and its impact on students’ reading comprehension. Methods: Three types of texts were selected with varying levels of difficulty. These texts were translated once by a human translator and once by machine translation (Google Translator). Finally, six texts were obtained. The output of machine translation was evaluated and analyzed. Postgraduate students who happened to use machine translation more frequently were then randomly divided into six groups, each group reading one of these texts and answering multiple choice comprehension questions at the end of the text. The T-test was performed on the data and it was found that from the three types of texts, the two types of texts, despite having some lexical and grammatical problems, were able to compete with human translation. Findings: The data showed that the quality of machine translation is improving and has now reached a degree of quality that can be used as a tool in educational environments. Some guidelines were also given on how to use this technology in the classroom. Conclusion: This study attracts attention of language educators to MT and its use in language teaching. It suggests that language educators should be trained to use this tool to improve language learning among students. Considering that the type of text has a great impact on the quality of machine translation and very good scientific texts and very bad literary texts are machine translated, this point should also be considered in generalizing the results of this research. All three texts translated by Google were able to match the human translated text in terms of comprehension, but the number of unknown sentences in this text was more than the other two texts, which were expected to have a negative effect on students' comprehension, which was not observed. The issue of gender can also be examined to see if there is a relationship between gender and the type of reaction to machine translation or not.   ===================================================================================== COPYRIGHTS  ©2020 The author(s). This is an open access article distributed under the terms of the Creative Commons Attribution (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, as long as the original authors and source are cited. No permission is required from the authors or the publishers.  =====================================================================================
first_indexed 2024-12-21T16:49:59Z
format Article
id doaj.art-fcc9284c91254ffca139bad140358956
institution Directory Open Access Journal
issn 2008-0441
2345-5462
language fas
last_indexed 2024-12-21T16:49:59Z
publishDate 2020-03-01
publisher Shahid Rajaee Teacher Training University (SRTTU)
record_format Article
series Fanāvarī-i āmūzish
spelling doaj.art-fcc9284c91254ffca139bad1403589562022-12-21T18:56:54ZfasShahid Rajaee Teacher Training University (SRTTU)Fanāvarī-i āmūzish2008-04412345-54622020-03-0114239340410.22061/jte.2019.5473.22271200Machine translation output assessment and its impact on reading comprehensionV.R. Mirzaeian0ELT Department, Alzahra University, Tehran, IranBackground and Objectives: Machine translation is now widely used everywhere; However, its role as a language learning tool has not been confirmed, as there are concerns about its quality. However, if we compare the machine translation output with the output produced ten years ago, we see a significant improvement in its quality, especially in terms of vocabulary and grammar. Machine translation can be defined as: the process by which, using electronic devices, input can be provided from one language and output delivered in another language. When machine translation became available on smartphones, it gained universal acceptance because of its benefits such as free and easy access. In the field of education, many learners use this technology every day for various personal as well as academic purposes. These goals mainly include understanding a text that is not written in the native language or translating different texts from different languages into other languages and delivering it as homework. Machine translation can help learners gain a quick understanding of a text written in a language other than their mother tongue by producing an incomplete version. The aim of this research was to assess the quality of machine translation and its impact on students’ reading comprehension. Methods: Three types of texts were selected with varying levels of difficulty. These texts were translated once by a human translator and once by machine translation (Google Translator). Finally, six texts were obtained. The output of machine translation was evaluated and analyzed. Postgraduate students who happened to use machine translation more frequently were then randomly divided into six groups, each group reading one of these texts and answering multiple choice comprehension questions at the end of the text. The T-test was performed on the data and it was found that from the three types of texts, the two types of texts, despite having some lexical and grammatical problems, were able to compete with human translation. Findings: The data showed that the quality of machine translation is improving and has now reached a degree of quality that can be used as a tool in educational environments. Some guidelines were also given on how to use this technology in the classroom. Conclusion: This study attracts attention of language educators to MT and its use in language teaching. It suggests that language educators should be trained to use this tool to improve language learning among students. Considering that the type of text has a great impact on the quality of machine translation and very good scientific texts and very bad literary texts are machine translated, this point should also be considered in generalizing the results of this research. All three texts translated by Google were able to match the human translated text in terms of comprehension, but the number of unknown sentences in this text was more than the other two texts, which were expected to have a negative effect on students' comprehension, which was not observed. The issue of gender can also be examined to see if there is a relationship between gender and the type of reaction to machine translation or not.   ===================================================================================== COPYRIGHTS  ©2020 The author(s). This is an open access article distributed under the terms of the Creative Commons Attribution (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, as long as the original authors and source are cited. No permission is required from the authors or the publishers.  =====================================================================================https://jte.sru.ac.ir/article_1200_a9f6df924237009073d0679e7cdb6fc2.pdfmachine translationassessmentreading comprehensiont-test
spellingShingle V.R. Mirzaeian
Machine translation output assessment and its impact on reading comprehension
Fanāvarī-i āmūzish
machine translation
assessment
reading comprehension
t-test
title Machine translation output assessment and its impact on reading comprehension
title_full Machine translation output assessment and its impact on reading comprehension
title_fullStr Machine translation output assessment and its impact on reading comprehension
title_full_unstemmed Machine translation output assessment and its impact on reading comprehension
title_short Machine translation output assessment and its impact on reading comprehension
title_sort machine translation output assessment and its impact on reading comprehension
topic machine translation
assessment
reading comprehension
t-test
url https://jte.sru.ac.ir/article_1200_a9f6df924237009073d0679e7cdb6fc2.pdf
work_keys_str_mv AT vrmirzaeian machinetranslationoutputassessmentanditsimpactonreadingcomprehension