Ecological validity in corpus-based and experimental translation research

This study provides insights into the ecological validity of experimental results in translation process research (TPR) by comparing translation products under three different conditions: produced in a translation research lab, in the translators' usual working environment, and included as part...

Full description

Bibliographic Details
Main Authors: Jonas Freiwald, Zoë Miljanović, Arndt Heilmann, Stella Neumann
Format: Article
Language:English
Published: Elsevier 2024-06-01
Series:Ampersand
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2215039023000486
_version_ 1797382854347325440
author Jonas Freiwald
Zoë Miljanović
Arndt Heilmann
Stella Neumann
author_facet Jonas Freiwald
Zoë Miljanović
Arndt Heilmann
Stella Neumann
author_sort Jonas Freiwald
collection DOAJ
description This study provides insights into the ecological validity of experimental results in translation process research (TPR) by comparing translation products under three different conditions: produced in a translation research lab, in the translators' usual working environment, and included as part of a corpus. The results will test the ecological validity of experimental results in TPR and shed light on some of the discrepancies between findings based on corpus data and lab experiments. Data collected in rigorous translation process experiments outside the translators’ usual working environment may not represent authentic translation behaviour. For example, in the experimental setting, translators will not have access to the tools and resources they usually work with, they will be immediately aware of their participation in a scientific study (which may affect their choices), and the stimuli under investigation will often be artificially constructed. These caveats call into question the meaningfulness of conclusions about translation and the translation process based on target texts produced in such artificial settings. This is furthermore reinforced by the differences found between experimental and corpus-based results. In order to test the comparability of different translation settings, 20 translators were commissioned to translate texts according to their usual workflow, in their usual working environment and at their own pace with access to resources of their preference. The source texts were previously used in experiments (Heilmann et al., 2021; Heilmann et al., 2022) and they contain stimuli that may represent a contrastive or cognitive challenge to the translators. The translators were also asked to provide information about the resources they used and the time and breaks they took to finish the translations. Their translations were compared to the target texts collected in the lab experiments and to translations obtained from a corpus with regard to the linguistic stimuli as well as linguistic characteristics such as average sentence length and lexical density. The results highlight the effect of the experimental setting on the translation product and illuminate the differences between experimental data and corpus data.
first_indexed 2024-03-08T21:12:23Z
format Article
id doaj.art-6d59d05114b848c2bdd84f597495bde0
institution Directory Open Access Journal
issn 2215-0390
language English
last_indexed 2024-03-08T21:12:23Z
publishDate 2024-06-01
publisher Elsevier
record_format Article
series Ampersand
spelling doaj.art-6d59d05114b848c2bdd84f597495bde02023-12-22T05:33:19ZengElsevierAmpersand2215-03902024-06-0112100155Ecological validity in corpus-based and experimental translation researchJonas Freiwald0Zoë Miljanović1Arndt Heilmann2Stella Neumann3Corresponding author.; RWTH Aachen University, Institut für Anglistik, Amerikanistik und Romanistik, Kármánstr. 17/19, 52062, Aachen, GermanyRWTH Aachen University, Institut für Anglistik, Amerikanistik und Romanistik, Kármánstr. 17/19, 52062, Aachen, GermanyRWTH Aachen University, Institut für Anglistik, Amerikanistik und Romanistik, Kármánstr. 17/19, 52062, Aachen, GermanyRWTH Aachen University, Institut für Anglistik, Amerikanistik und Romanistik, Kármánstr. 17/19, 52062, Aachen, GermanyThis study provides insights into the ecological validity of experimental results in translation process research (TPR) by comparing translation products under three different conditions: produced in a translation research lab, in the translators' usual working environment, and included as part of a corpus. The results will test the ecological validity of experimental results in TPR and shed light on some of the discrepancies between findings based on corpus data and lab experiments. Data collected in rigorous translation process experiments outside the translators’ usual working environment may not represent authentic translation behaviour. For example, in the experimental setting, translators will not have access to the tools and resources they usually work with, they will be immediately aware of their participation in a scientific study (which may affect their choices), and the stimuli under investigation will often be artificially constructed. These caveats call into question the meaningfulness of conclusions about translation and the translation process based on target texts produced in such artificial settings. This is furthermore reinforced by the differences found between experimental and corpus-based results. In order to test the comparability of different translation settings, 20 translators were commissioned to translate texts according to their usual workflow, in their usual working environment and at their own pace with access to resources of their preference. The source texts were previously used in experiments (Heilmann et al., 2021; Heilmann et al., 2022) and they contain stimuli that may represent a contrastive or cognitive challenge to the translators. The translators were also asked to provide information about the resources they used and the time and breaks they took to finish the translations. Their translations were compared to the target texts collected in the lab experiments and to translations obtained from a corpus with regard to the linguistic stimuli as well as linguistic characteristics such as average sentence length and lexical density. The results highlight the effect of the experimental setting on the translation product and illuminate the differences between experimental data and corpus data.http://www.sciencedirect.com/science/article/pii/S2215039023000486Ecological validityTranslation process researchEmpirical translation studiesTranslation experiments
spellingShingle Jonas Freiwald
Zoë Miljanović
Arndt Heilmann
Stella Neumann
Ecological validity in corpus-based and experimental translation research
Ampersand
Ecological validity
Translation process research
Empirical translation studies
Translation experiments
title Ecological validity in corpus-based and experimental translation research
title_full Ecological validity in corpus-based and experimental translation research
title_fullStr Ecological validity in corpus-based and experimental translation research
title_full_unstemmed Ecological validity in corpus-based and experimental translation research
title_short Ecological validity in corpus-based and experimental translation research
title_sort ecological validity in corpus based and experimental translation research
topic Ecological validity
Translation process research
Empirical translation studies
Translation experiments
url http://www.sciencedirect.com/science/article/pii/S2215039023000486
work_keys_str_mv AT jonasfreiwald ecologicalvalidityincorpusbasedandexperimentaltranslationresearch
AT zoemiljanovic ecologicalvalidityincorpusbasedandexperimentaltranslationresearch
AT arndtheilmann ecologicalvalidityincorpusbasedandexperimentaltranslationresearch
AT stellaneumann ecologicalvalidityincorpusbasedandexperimentaltranslationresearch