Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction
Background Recently, artificial intelligence-powered devices have been put forward as potentially powerful tools for the improvement of mental healthcare. An important question is how these devices impact the physician-patient interaction. Aims Aifred is an artificial intelligence-powered clinical...
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2021-01-01
|
| Series: | BJPsych Open |
| Subjects: | |
| Online Access: | https://www.cambridge.org/core/product/identifier/S2056472420001271/type/journal_article |
| _version_ | 1827995725146882048 |
|---|---|
| author | David Benrimoh Myriam Tanguay-Sela Kelly Perlman Sonia Israel Joseph Mehltretter Caitrin Armstrong Robert Fratila Sagar V. Parikh Jordan F. Karp Katherine Heller Ipsit V. Vahia Daniel M. Blumberger Sherif Karama Simone N. Vigod Gail Myhr Ruben Martins Colleen Rollins Christina Popescu Eryn Lundrigan Emily Snook Marina Wakid Jérôme Williams Ghassen Soufi Tamara Perez Jingla-Fri Tunteng Katherine Rosenfeld Marc Miresco Gustavo Turecki Liliana Gomez Cardona Outi Linnaranta Howard C. Margolese |
| author_facet | David Benrimoh Myriam Tanguay-Sela Kelly Perlman Sonia Israel Joseph Mehltretter Caitrin Armstrong Robert Fratila Sagar V. Parikh Jordan F. Karp Katherine Heller Ipsit V. Vahia Daniel M. Blumberger Sherif Karama Simone N. Vigod Gail Myhr Ruben Martins Colleen Rollins Christina Popescu Eryn Lundrigan Emily Snook Marina Wakid Jérôme Williams Ghassen Soufi Tamara Perez Jingla-Fri Tunteng Katherine Rosenfeld Marc Miresco Gustavo Turecki Liliana Gomez Cardona Outi Linnaranta Howard C. Margolese |
| author_sort | David Benrimoh |
| collection | DOAJ |
| description | Background
Recently, artificial intelligence-powered devices have been put forward as potentially powerful tools for the improvement of mental healthcare. An important question is how these devices impact the physician-patient interaction.
Aims
Aifred is an artificial intelligence-powered clinical decision support system (CDSS) for the treatment of major depression. Here, we explore the use of a simulation centre environment in evaluating the usability of Aifred, particularly its impact on the physician–patient interaction.
Method
Twenty psychiatry and family medicine attending staff and residents were recruited to complete a 2.5-h study at a clinical interaction simulation centre with standardised patients. Each physician had the option of using the CDSS to inform their treatment choice in three 10-min clinical scenarios with standardised patients portraying mild, moderate and severe episodes of major depression. Feasibility and acceptability data were collected through self-report questionnaires, scenario observations, interviews and standardised patient feedback.
Results
All 20 participants completed the study. Initial results indicate that the tool was acceptable to clinicians and feasible for use during clinical encounters. Clinicians indicated a willingness to use the tool in real clinical practice, a significant degree of trust in the system's predictions to assist with treatment selection, and reported that the tool helped increase patient understanding of and trust in treatment. The simulation environment allowed for the evaluation of the tool's impact on the physician–patient interaction.
Conclusions
The simulation centre allowed for direct observations of clinician use and impact of the tool on the clinician–patient interaction before clinical studies. It may therefore offer a useful and important environment in the early testing of new technological tools. The present results will inform further tool development and clinician training materials.
|
| first_indexed | 2024-04-10T04:59:42Z |
| format | Article |
| id | doaj.art-ee6acce305e649c49740f5cd2603a2e4 |
| institution | Directory Open Access Journal |
| issn | 2056-4724 |
| language | English |
| last_indexed | 2024-04-10T04:59:42Z |
| publishDate | 2021-01-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | BJPsych Open |
| spelling | doaj.art-ee6acce305e649c49740f5cd2603a2e42023-03-09T12:29:05ZengCambridge University PressBJPsych Open2056-47242021-01-01710.1192/bjo.2020.127Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interactionDavid Benrimoh0https://orcid.org/0000-0002-1452-4791Myriam Tanguay-Sela1https://orcid.org/0000-0002-8056-1697Kelly Perlman2https://orcid.org/0000-0002-2716-0712Sonia Israel3Joseph Mehltretter4Caitrin Armstrong5Robert Fratila6Sagar V. Parikh7Jordan F. Karp8Katherine Heller9Ipsit V. Vahia10Daniel M. Blumberger11https://orcid.org/0000-0002-8422-5818Sherif Karama12Simone N. Vigod13https://orcid.org/0000-0002-2736-9639Gail Myhr14Ruben Martins15Colleen Rollins16https://orcid.org/0000-0002-0291-0038Christina Popescu17https://orcid.org/0000-0003-1738-4680Eryn Lundrigan18https://orcid.org/0000-0001-5896-9752Emily Snook19Marina Wakid20Jérôme Williams21https://orcid.org/0000-0002-8871-2509Ghassen Soufi22Tamara Perez23https://orcid.org/0000-0002-9892-3043Jingla-Fri Tunteng24Katherine Rosenfeld25Marc Miresco26Gustavo Turecki27Liliana Gomez Cardona28Outi Linnaranta29Howard C. Margolese30Department of Psychiatry, McGill University, Canada; Aifred Heath Inc., Montreal, Canada; and Faculty of Medicine, McGill University, CanadaMontreal Neurological Institute, McGill University, Canada; and Aifred Health Inc., Montreal, CanadaDouglas Mental Health University Institute, Montreal, Canada; and Aifred Health Inc., Montreal, CanadaAifred Health Inc., Montreal, CanadaDepartment of Computer Science, University of Southern California, Los Angeles, USA; and Aifred Health Inc., Montreal, CanadaSchool of Computer Science, McGill University, Canada; and Aifred Health Inc., Montreal, CanadaAifred Health Inc., Montreal, CanadaDepartment of Psychiatry, University of Michigan, USADepartment of Psychiatry, University of Pittsburgh, USADepartment of Statistical Science, Duke University, USADepartment of Psychiatry, McLean Hospital/Harvard University, USASchool of Psychiatry, University of Toronto, CanadaDepartment of Psychiatry, McGill University, CanadaDepartment of Psychiatry, University of Toronto, CanadaDepartment of Psychiatry, McGill University, CanadaDouglas Mental Health University Institute, Montreal, Canada; and Department of Psychiatry, McGill University, CanadaDepartment of Psychiatry, University of Cambridge, UK; and Aifred Health Inc., Montreal, CanadaDouglas Mental Health University Institute, Montreal, Canada; and Aifred Health Inc., Montreal, CanadaDepartment of Anatomy and Cell Biology, McGill University, CanadaFaculty of Medicine, University of Toronto, CanadaDouglas Mental Health University Institute, Montreal, CanadaFaculty of Medicine, McGill University, CanadaFaculty of Medicine, McGill University, CanadaDepartment of Experimental Medicine, McGill University, CanadaSchool of Physical and Occupational Therapy, McGill University, CanadaDepartment of Psychology, McGill University, CanadaDepartment of Psychiatry, McGill University, CanadaDouglas Mental Health University Institute, Montreal, Canada; and Department of Psychiatry, McGill University, CanadaDouglas Mental Health University Institute, Montreal, Canada; and Department of Psychiatry, McGill University, CanadaDouglas Mental Health University Institute, Montreal, Canada; and Department of Psychiatry, McGill University, CanadaDepartment of Psychiatry, McGill University, CanadaBackground Recently, artificial intelligence-powered devices have been put forward as potentially powerful tools for the improvement of mental healthcare. An important question is how these devices impact the physician-patient interaction. Aims Aifred is an artificial intelligence-powered clinical decision support system (CDSS) for the treatment of major depression. Here, we explore the use of a simulation centre environment in evaluating the usability of Aifred, particularly its impact on the physician–patient interaction. Method Twenty psychiatry and family medicine attending staff and residents were recruited to complete a 2.5-h study at a clinical interaction simulation centre with standardised patients. Each physician had the option of using the CDSS to inform their treatment choice in three 10-min clinical scenarios with standardised patients portraying mild, moderate and severe episodes of major depression. Feasibility and acceptability data were collected through self-report questionnaires, scenario observations, interviews and standardised patient feedback. Results All 20 participants completed the study. Initial results indicate that the tool was acceptable to clinicians and feasible for use during clinical encounters. Clinicians indicated a willingness to use the tool in real clinical practice, a significant degree of trust in the system's predictions to assist with treatment selection, and reported that the tool helped increase patient understanding of and trust in treatment. The simulation environment allowed for the evaluation of the tool's impact on the physician–patient interaction. Conclusions The simulation centre allowed for direct observations of clinician use and impact of the tool on the clinician–patient interaction before clinical studies. It may therefore offer a useful and important environment in the early testing of new technological tools. The present results will inform further tool development and clinician training materials. https://www.cambridge.org/core/product/identifier/S2056472420001271/type/journal_articlePrimary careout-patient treatmentdepressive disordersartificial intelligencesimulation centre |
| spellingShingle | David Benrimoh Myriam Tanguay-Sela Kelly Perlman Sonia Israel Joseph Mehltretter Caitrin Armstrong Robert Fratila Sagar V. Parikh Jordan F. Karp Katherine Heller Ipsit V. Vahia Daniel M. Blumberger Sherif Karama Simone N. Vigod Gail Myhr Ruben Martins Colleen Rollins Christina Popescu Eryn Lundrigan Emily Snook Marina Wakid Jérôme Williams Ghassen Soufi Tamara Perez Jingla-Fri Tunteng Katherine Rosenfeld Marc Miresco Gustavo Turecki Liliana Gomez Cardona Outi Linnaranta Howard C. Margolese Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction BJPsych Open Primary care out-patient treatment depressive disorders artificial intelligence simulation centre |
| title | Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction |
| title_full | Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction |
| title_fullStr | Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction |
| title_full_unstemmed | Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction |
| title_short | Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician–patient interaction |
| title_sort | using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence powered clinical decision support system for depression treatment on the physician patient interaction |
| topic | Primary care out-patient treatment depressive disorders artificial intelligence simulation centre |
| url | https://www.cambridge.org/core/product/identifier/S2056472420001271/type/journal_article |
| work_keys_str_mv | AT davidbenrimoh usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT myriamtanguaysela usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT kellyperlman usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT soniaisrael usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT josephmehltretter usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT caitrinarmstrong usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT robertfratila usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT sagarvparikh usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT jordanfkarp usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT katherineheller usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT ipsitvvahia usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT danielmblumberger usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT sherifkarama usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT simonenvigod usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT gailmyhr usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT rubenmartins usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT colleenrollins usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT christinapopescu usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT erynlundrigan usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT emilysnook usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT marinawakid usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT jeromewilliams usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT ghassensoufi usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT tamaraperez usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT jinglafritunteng usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT katherinerosenfeld usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT marcmiresco usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT gustavoturecki usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT lilianagomezcardona usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT outilinnaranta usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction AT howardcmargolese usingasimulationcentretoevaluatepreliminaryacceptabilityandimpactofanartificialintelligencepoweredclinicaldecisionsupportsystemfordepressiontreatmentonthephysicianpatientinteraction |