Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception

This paper analyzes the quality of machine translated interlingual subtitles, which were post-edited in the language pair EN/PT-BR. Our analyses applied the FAR model, a Translation Quality Assessment Model, to the PT-BR subtitles of The Red Sea Diving Resort movie trailer, correlating it to empiri...

Full description

Bibliographic Details
Main Authors: Arlene Koglin, João Gabriel Pereira da Silveira, Morgana Aparecida de Matos, Vitória Tassara Costa Silva, Willian Henrique Cândido Moura
Format: Article
Language:English
Published: Universidade Federal de Santa Catarina 2022-10-01
Series:Cadernos de Tradução
Subjects:
Online Access:https://periodicos.ufsc.br/index.php/traducao/article/view/82143
_version_ 1817975571029688320
author Arlene Koglin
João Gabriel Pereira da Silveira
Morgana Aparecida de Matos
Vitória Tassara Costa Silva
Willian Henrique Cândido Moura
author_facet Arlene Koglin
João Gabriel Pereira da Silveira
Morgana Aparecida de Matos
Vitória Tassara Costa Silva
Willian Henrique Cândido Moura
author_sort Arlene Koglin
collection DOAJ
description This paper analyzes the quality of machine translated interlingual subtitles, which were post-edited in the language pair EN/PT-BR. Our analyses applied the FAR model, a Translation Quality Assessment Model, to the PT-BR subtitles of The Red Sea Diving Resort movie trailer, correlating it to empirical data collected with translators (quality assessment) and audience (reception). Reception data was collected with undergraduate students, which were divided into two groups: the control group that watched the subtitled trailer available on Netflix; and the experimental group that watched the trailer with post-edited subtitles. Quality data was collected with translators and they watched the trailer with post-edited subtitles. We used a 5-point Likert-type scale, a questionnaire and a guided think-aloud protocol to collect our data. Data collected with both translators and students were correlated with the FAR model error scores (Functional Equivalence, Acceptability and Readability). Our results indicate that the post-edited subtitles had good quality in terms of meaning and target language norms; however, the technical parameters had lower quality, which affected the trailer appreciation as reported by most of the audience. Due to the small sample size, further empirical studies are required to obtain solid standards for assessing the quality of post-edited subtitles.
first_indexed 2024-04-13T21:51:40Z
format Article
id doaj.art-4c69d9aabd49405c9fa9e382376456f5
institution Directory Open Access Journal
issn 1414-526X
2175-7968
language English
last_indexed 2024-04-13T21:51:40Z
publishDate 2022-10-01
publisher Universidade Federal de Santa Catarina
record_format Article
series Cadernos de Tradução
spelling doaj.art-4c69d9aabd49405c9fa9e382376456f52022-12-22T02:28:24ZengUniversidade Federal de Santa CatarinaCadernos de Tradução1414-526X2175-79682022-10-01420110.5007/2175-7968.2022.e82143Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience ReceptionArlene Koglin0João Gabriel Pereira da Silveira1Morgana Aparecida de Matos2Vitória Tassara Costa Silva3Willian Henrique Cândido Moura4Universidade Federal de PernambucoUniversidade Federal de PernambucoUniversidade Federal de Santa Catarina e Universidade de VigoUniversidade Federal de Santa CatarinaUniversidade Federal de Santa Catarina This paper analyzes the quality of machine translated interlingual subtitles, which were post-edited in the language pair EN/PT-BR. Our analyses applied the FAR model, a Translation Quality Assessment Model, to the PT-BR subtitles of The Red Sea Diving Resort movie trailer, correlating it to empirical data collected with translators (quality assessment) and audience (reception). Reception data was collected with undergraduate students, which were divided into two groups: the control group that watched the subtitled trailer available on Netflix; and the experimental group that watched the trailer with post-edited subtitles. Quality data was collected with translators and they watched the trailer with post-edited subtitles. We used a 5-point Likert-type scale, a questionnaire and a guided think-aloud protocol to collect our data. Data collected with both translators and students were correlated with the FAR model error scores (Functional Equivalence, Acceptability and Readability). Our results indicate that the post-edited subtitles had good quality in terms of meaning and target language norms; however, the technical parameters had lower quality, which affected the trailer appreciation as reported by most of the audience. Due to the small sample size, further empirical studies are required to obtain solid standards for assessing the quality of post-edited subtitles. https://periodicos.ufsc.br/index.php/traducao/article/view/82143Subtitling Quality AssessmentReceptionMachine TranslationPost-EditingFAR Model
spellingShingle Arlene Koglin
João Gabriel Pereira da Silveira
Morgana Aparecida de Matos
Vitória Tassara Costa Silva
Willian Henrique Cândido Moura
Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception
Cadernos de Tradução
Subtitling Quality Assessment
Reception
Machine Translation
Post-Editing
FAR Model
title Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception
title_full Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception
title_fullStr Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception
title_full_unstemmed Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception
title_short Quality of Post-Edited Interlingual Subtitling: FAR Model, Translator’s Assessment and Audience Reception
title_sort quality of post edited interlingual subtitling far model translator s assessment and audience reception
topic Subtitling Quality Assessment
Reception
Machine Translation
Post-Editing
FAR Model
url https://periodicos.ufsc.br/index.php/traducao/article/view/82143
work_keys_str_mv AT arlenekoglin qualityofposteditedinterlingualsubtitlingfarmodeltranslatorsassessmentandaudiencereception
AT joaogabrielpereiradasilveira qualityofposteditedinterlingualsubtitlingfarmodeltranslatorsassessmentandaudiencereception
AT morganaaparecidadematos qualityofposteditedinterlingualsubtitlingfarmodeltranslatorsassessmentandaudiencereception
AT vitoriatassaracostasilva qualityofposteditedinterlingualsubtitlingfarmodeltranslatorsassessmentandaudiencereception
AT willianhenriquecandidomoura qualityofposteditedinterlingualsubtitlingfarmodeltranslatorsassessmentandaudiencereception