Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care

<strong>Background<br></strong> Despite the recognition that developing artificial intelligence (AI) that is trustworthy is necessary for public acceptability and the successful implementation of AI in healthcare contexts, perspectives from key stakeholders are often absent from di...

Deskribapen osoa

Xehetasun bibliografikoak
Egile Nagusiak: Dlugatch, R, Georgieva, A, Kerasidou, A
Formatua: Journal article
Hizkuntza:English
Argitaratua: Springer Nature 2023
_version_ 1826310794475732992
author Dlugatch, R
Georgieva, A
Kerasidou, A
author_facet Dlugatch, R
Georgieva, A
Kerasidou, A
author_sort Dlugatch, R
collection OXFORD
description <strong>Background<br></strong> Despite the recognition that developing artificial intelligence (AI) that is trustworthy is necessary for public acceptability and the successful implementation of AI in healthcare contexts, perspectives from key stakeholders are often absent from discourse on the ethical design, development, and deployment of AI. This study explores the perspectives of birth parents and mothers on the introduction of AI-based cardiotocography (CTG) in the context of intrapartum care, focusing on issues pertaining to trust and trustworthiness. <br><strong> Methods<br></strong> Seventeen semi-structured interviews were conducted with birth parents and mothers based on a speculative case study. Interviewees were based in England and were pregnant and/or had given birth in the last two years. Thematic analysis was used to analyze transcribed interviews with the use of NVivo. Major recurring themes acted as the basis for identifying the values most important to this population group for evaluating the trustworthiness of AI. <br><strong> Results<br></strong> Three themes pertaining to the perceived trustworthiness of AI emerged from interviews: (1) trustworthy AI-developing institutions, (2) trustworthy data from which AI is built, and (3) trustworthy decisions made with the assistance of AI. We found that birth parents and mothers trusted public institutions over private companies to develop AI, that they evaluated the trustworthiness of data by how representative it is of all population groups, and that they perceived trustworthy decisions as being mediated by humans even when supported by AI. <br><strong> Conclusions<br></strong> The ethical values that underscore birth parents and mothers’ perceptions of trustworthy AI include fairness and reliability, as well as practices like patient-centered care, the promotion of publicly funded healthcare, holistic care, and personalized medicine. Ultimately, these are also the ethical values that people want to protect in the healthcare system. Therefore, trustworthy AI is best understood not as a list of design features but in relation to how it undermines or promotes the ethical values that matter most to its end users. An ethical commitment to these values when creating AI in healthcare contexts opens up new challenges and possibilities for the design and deployment of AI.
first_indexed 2024-03-07T07:57:15Z
format Journal article
id oxford-uuid:3fd663a4-5f20-45b5-addc-8aef8302232d
institution University of Oxford
language English
last_indexed 2024-03-07T07:57:15Z
publishDate 2023
publisher Springer Nature
record_format dspace
spelling oxford-uuid:3fd663a4-5f20-45b5-addc-8aef8302232d2023-09-05T13:44:58ZTrustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum careJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:3fd663a4-5f20-45b5-addc-8aef8302232dEnglishSymplectic ElementsSpringer Nature2023Dlugatch, RGeorgieva, AKerasidou, A<strong>Background<br></strong> Despite the recognition that developing artificial intelligence (AI) that is trustworthy is necessary for public acceptability and the successful implementation of AI in healthcare contexts, perspectives from key stakeholders are often absent from discourse on the ethical design, development, and deployment of AI. This study explores the perspectives of birth parents and mothers on the introduction of AI-based cardiotocography (CTG) in the context of intrapartum care, focusing on issues pertaining to trust and trustworthiness. <br><strong> Methods<br></strong> Seventeen semi-structured interviews were conducted with birth parents and mothers based on a speculative case study. Interviewees were based in England and were pregnant and/or had given birth in the last two years. Thematic analysis was used to analyze transcribed interviews with the use of NVivo. Major recurring themes acted as the basis for identifying the values most important to this population group for evaluating the trustworthiness of AI. <br><strong> Results<br></strong> Three themes pertaining to the perceived trustworthiness of AI emerged from interviews: (1) trustworthy AI-developing institutions, (2) trustworthy data from which AI is built, and (3) trustworthy decisions made with the assistance of AI. We found that birth parents and mothers trusted public institutions over private companies to develop AI, that they evaluated the trustworthiness of data by how representative it is of all population groups, and that they perceived trustworthy decisions as being mediated by humans even when supported by AI. <br><strong> Conclusions<br></strong> The ethical values that underscore birth parents and mothers’ perceptions of trustworthy AI include fairness and reliability, as well as practices like patient-centered care, the promotion of publicly funded healthcare, holistic care, and personalized medicine. Ultimately, these are also the ethical values that people want to protect in the healthcare system. Therefore, trustworthy AI is best understood not as a list of design features but in relation to how it undermines or promotes the ethical values that matter most to its end users. An ethical commitment to these values when creating AI in healthcare contexts opens up new challenges and possibilities for the design and deployment of AI.
spellingShingle Dlugatch, R
Georgieva, A
Kerasidou, A
Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
title Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
title_full Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
title_fullStr Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
title_full_unstemmed Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
title_short Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
title_sort trustworthy artificial intelligence and ethical design public perceptions of trustworthiness of an ai based decision support tool in the context of intrapartum care
work_keys_str_mv AT dlugatchr trustworthyartificialintelligenceandethicaldesignpublicperceptionsoftrustworthinessofanaibaseddecisionsupporttoolinthecontextofintrapartumcare
AT georgievaa trustworthyartificialintelligenceandethicaldesignpublicperceptionsoftrustworthinessofanaibaseddecisionsupporttoolinthecontextofintrapartumcare
AT kerasidoua trustworthyartificialintelligenceandethicaldesignpublicperceptionsoftrustworthinessofanaibaseddecisionsupporttoolinthecontextofintrapartumcare