Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL
Parties are the central actors in representative democracies as they perform important democratic functions. Thus, the identification of party positions is a crucial concern. Party researchers mainly rely on party manifestos to estimate policy positions. However, the analysis of manifestos is accomp...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-11-01
|
| Series: | Frontiers in Political Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpos.2023.1268320/full |
| _version_ | 1797488608800669696 |
|---|---|
| author | Johanna Ida Plenter |
| author_facet | Johanna Ida Plenter |
| author_sort | Johanna Ida Plenter |
| collection | DOAJ |
| description | Parties are the central actors in representative democracies as they perform important democratic functions. Thus, the identification of party positions is a crucial concern. Party researchers mainly rely on party manifestos to estimate policy positions. However, the analysis of manifestos is accompanied by challenges—one of the biggest being cross-national comparisons because of different institutional settings and languages. This article discusses machine translation (MT) as a new option for party research, and reports on the author's experiences with the translation of more than 200 party manifestos using the commercial artificial intelligence (AI) translation tool DeepL. To make this approach widely applicable, the (technical) procedure, including its problems and workarounds for large-scale projects, is presented as a step-by-step guide using R. Additionally, drawing on the most recent German, Estonian, Italian and Polish parliamentary election manifestos this article evaluates the quality of the DeepL translations by applying both back translation and Wordfish analyses. The main findings indicate that DeepL offers high-quality translations as more than 90% of the checked sentences are reproduced word-for-word or at least synonymously and with stable positioning on the left-right scale of both original and English translation. The results have greater implications for political science research as they speak to the reliability of machine translation for political texts. |
| first_indexed | 2024-03-10T00:04:42Z |
| format | Article |
| id | doaj.art-d14d1c357e3849ca8112329a8612091d |
| institution | Directory Open Access Journal |
| issn | 2673-3145 |
| language | English |
| last_indexed | 2024-03-10T00:04:42Z |
| publishDate | 2023-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Political Science |
| spelling | doaj.art-d14d1c357e3849ca8112329a8612091d2023-11-23T16:10:33ZengFrontiers Media S.A.Frontiers in Political Science2673-31452023-11-01510.3389/fpos.2023.12683201268320Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepLJohanna Ida PlenterParties are the central actors in representative democracies as they perform important democratic functions. Thus, the identification of party positions is a crucial concern. Party researchers mainly rely on party manifestos to estimate policy positions. However, the analysis of manifestos is accompanied by challenges—one of the biggest being cross-national comparisons because of different institutional settings and languages. This article discusses machine translation (MT) as a new option for party research, and reports on the author's experiences with the translation of more than 200 party manifestos using the commercial artificial intelligence (AI) translation tool DeepL. To make this approach widely applicable, the (technical) procedure, including its problems and workarounds for large-scale projects, is presented as a step-by-step guide using R. Additionally, drawing on the most recent German, Estonian, Italian and Polish parliamentary election manifestos this article evaluates the quality of the DeepL translations by applying both back translation and Wordfish analyses. The main findings indicate that DeepL offers high-quality translations as more than 90% of the checked sentences are reproduced word-for-word or at least synonymously and with stable positioning on the left-right scale of both original and English translation. The results have greater implications for political science research as they speak to the reliability of machine translation for political texts.https://www.frontiersin.org/articles/10.3389/fpos.2023.1268320/fullparty manifestosmachine translationtext as dataDeepLtranslation quality |
| spellingShingle | Johanna Ida Plenter Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL Frontiers in Political Science party manifestos machine translation text as data DeepL translation quality |
| title | Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL |
| title_full | Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL |
| title_fullStr | Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL |
| title_full_unstemmed | Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL |
| title_short | Advantages and pitfalls of machine translation for party research: the translation of party manifestos of European parties using DeepL |
| title_sort | advantages and pitfalls of machine translation for party research the translation of party manifestos of european parties using deepl |
| topic | party manifestos machine translation text as data DeepL translation quality |
| url | https://www.frontiersin.org/articles/10.3389/fpos.2023.1268320/full |
| work_keys_str_mv | AT johannaidaplenter advantagesandpitfallsofmachinetranslationforpartyresearchthetranslationofpartymanifestosofeuropeanpartiesusingdeepl |