Situativität, Funktionalität und Vertrauen: Ergebnisse einer szenariobasierten Interviewstudie zur Erklärbarkeit von KI in der Medizin

A central requirement for the use of artificial intelligence (AI) in medicine is its explainability, i. e., the provision of addressee-oriented information about its functioning. This leads to the question of how socially adequate explainability can be designed. To identify evaluation factors, we i...

Full description

Bibliographic Details
Main Authors: Manuela Marquardt, Philipp Graf, Eva Jansen, Stefan Hillmann, Jan-Niklas Voigt-Antons
Format: Article
Language:deu
Published: oekom verlag GmbH 2024-03-01
Series:TATuP – Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis
Subjects:
Online Access:https://www.tatup.de/index.php/tatup/article/view/7101
Description
Summary:A central requirement for the use of artificial intelligence (AI) in medicine is its explainability, i. e., the provision of addressee-oriented information about its functioning. This leads to the question of how socially adequate explainability can be designed. To identify evaluation factors, we interviewed healthcare stakeholders about two scenarios: diagnostics and documentation. The scenarios vary the influence that an AI system has on decision-making through the interaction design and the amount of data processed. We present key evaluation factors for explainability at the interactional and procedural levels. Explainability must not interfere situationally in the doctor-patient conversation and question the professional role. At the same time, explainability functionally legitimizes an AI system as a second opinion and is central to building trust. A virtual embodiment of the AI system is advantageous for language-based explanations
ISSN:2568-020X
2567-8833