Man vs the machine in the struggle for effective text anonymisation in the age of large language models

Abstract The collection and use of personal data are becoming more common in today’s data-driven culture. While there are many advantages to this, including better decision-making and service delivery, it also poses significant ethical issues around confidentiality and privacy. Text anonymisation tr...

Full description

Bibliographic Details
Main Authors: Constantinos Patsakis, Nikolaos Lykousas
Format: Article
Language:English
Published: Nature Portfolio 2023-09-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-023-42977-3
_version_ 1797576994151464960
author Constantinos Patsakis
Nikolaos Lykousas
author_facet Constantinos Patsakis
Nikolaos Lykousas
author_sort Constantinos Patsakis
collection DOAJ
description Abstract The collection and use of personal data are becoming more common in today’s data-driven culture. While there are many advantages to this, including better decision-making and service delivery, it also poses significant ethical issues around confidentiality and privacy. Text anonymisation tries to prune and/or mask identifiable information from a text while keeping the remaining content intact to alleviate privacy concerns. Text anonymisation is especially important in industries like healthcare, law, as well as research, where sensitive and personal information is collected, processed, and exchanged under high legal and ethical standards. Although text anonymisation is widely adopted in practice, it continues to face considerable challenges. The most significant challenge is striking a balance between removing information to protect individuals’ privacy while maintaining the text’s usability for future purposes. The question is whether these anonymisation methods sufficiently reduce the risk of re-identification, in which an individual can be identified based on the remaining information in the text. In this work, we challenge the effectiveness of these methods and how we perceive identifiers. We assess the efficacy of these methods against the elephant in the room, the use of AI over big data. While most of the research is focused on identifying and removing personal information, there is limited discussion on whether the remaining information is sufficient to deanonymise individuals and, more precisely, who can do it. To this end, we conduct an experiment using GPT over anonymised texts of famous people to determine whether such trained networks can deanonymise them. The latter allows us to revise these methods and introduce a novel methodology that employs Large Language Models to improve the anonymity of texts.
first_indexed 2024-03-10T22:01:38Z
format Article
id doaj.art-a8a029133f054af582c055e19dec46aa
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-03-10T22:01:38Z
publishDate 2023-09-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-a8a029133f054af582c055e19dec46aa2023-11-19T12:56:02ZengNature PortfolioScientific Reports2045-23222023-09-0113111610.1038/s41598-023-42977-3Man vs the machine in the struggle for effective text anonymisation in the age of large language modelsConstantinos Patsakis0Nikolaos Lykousas1Department of Informatics, University of PiraeusManagement Systems Institute of Athena Research CentreAbstract The collection and use of personal data are becoming more common in today’s data-driven culture. While there are many advantages to this, including better decision-making and service delivery, it also poses significant ethical issues around confidentiality and privacy. Text anonymisation tries to prune and/or mask identifiable information from a text while keeping the remaining content intact to alleviate privacy concerns. Text anonymisation is especially important in industries like healthcare, law, as well as research, where sensitive and personal information is collected, processed, and exchanged under high legal and ethical standards. Although text anonymisation is widely adopted in practice, it continues to face considerable challenges. The most significant challenge is striking a balance between removing information to protect individuals’ privacy while maintaining the text’s usability for future purposes. The question is whether these anonymisation methods sufficiently reduce the risk of re-identification, in which an individual can be identified based on the remaining information in the text. In this work, we challenge the effectiveness of these methods and how we perceive identifiers. We assess the efficacy of these methods against the elephant in the room, the use of AI over big data. While most of the research is focused on identifying and removing personal information, there is limited discussion on whether the remaining information is sufficient to deanonymise individuals and, more precisely, who can do it. To this end, we conduct an experiment using GPT over anonymised texts of famous people to determine whether such trained networks can deanonymise them. The latter allows us to revise these methods and introduce a novel methodology that employs Large Language Models to improve the anonymity of texts.https://doi.org/10.1038/s41598-023-42977-3
spellingShingle Constantinos Patsakis
Nikolaos Lykousas
Man vs the machine in the struggle for effective text anonymisation in the age of large language models
Scientific Reports
title Man vs the machine in the struggle for effective text anonymisation in the age of large language models
title_full Man vs the machine in the struggle for effective text anonymisation in the age of large language models
title_fullStr Man vs the machine in the struggle for effective text anonymisation in the age of large language models
title_full_unstemmed Man vs the machine in the struggle for effective text anonymisation in the age of large language models
title_short Man vs the machine in the struggle for effective text anonymisation in the age of large language models
title_sort man vs the machine in the struggle for effective text anonymisation in the age of large language models
url https://doi.org/10.1038/s41598-023-42977-3
work_keys_str_mv AT constantinospatsakis manvsthemachineinthestruggleforeffectivetextanonymisationintheageoflargelanguagemodels
AT nikolaoslykousas manvsthemachineinthestruggleforeffectivetextanonymisationintheageoflargelanguagemodels