Ethical considerations for integrating multimodal computer perception and neurotechnology
BackgroundArtificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling prec...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-02-01
|
| Series: | Frontiers in Human Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnhum.2024.1332451/full |
| _version_ | 1797305194025844736 |
|---|---|
| author | Meghan E. Hurley Anika Sonig John Herrington Eric A. Storch Gabriel Lázaro-Muñoz Gabriel Lázaro-Muñoz Jennifer Blumenthal-Barby Kristin Kostick-Quenet |
| author_facet | Meghan E. Hurley Anika Sonig John Herrington Eric A. Storch Gabriel Lázaro-Muñoz Gabriel Lázaro-Muñoz Jennifer Blumenthal-Barby Kristin Kostick-Quenet |
| author_sort | Meghan E. Hurley |
| collection | DOAJ |
| description | BackgroundArtificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling precision treatment, diagnosis, and symptom monitoring. At the same time, passive and continuous nature by which they often collect data from patients in non-clinical settings raises ethical issues related to privacy and self-determination. Little is known about how such concerns may be exacerbated by the integration of neural data, as parallel advances in computer perception, AI, and neurotechnology enable new insights into subjective states. Here, we present findings from a multi-site NCATS-funded study of ethical considerations for translating computer perception into clinical care and contextualize them within the neuroethics and neurorights literatures.MethodsWe conducted qualitative interviews with patients (n = 20), caregivers (n = 20), clinicians (n = 12), developers (n = 12), and clinician developers (n = 2) regarding their perspective toward using PC in clinical care. Transcripts were analyzed in MAXQDA using Thematic Content Analysis.ResultsStakeholder groups voiced concerns related to (1) perceived invasiveness of passive and continuous data collection in private settings; (2) data protection and security and the potential for negative downstream/future impacts on patients of unintended disclosure; and (3) ethical issues related to patients’ limited versus hyper awareness of passive and continuous data collection and monitoring. Clinicians and developers highlighted that these concerns may be exacerbated by the integration of neural data with other computer perception data.DiscussionOur findings suggest that the integration of neurotechnologies with existing computer perception technologies raises novel concerns around dignity-related and other harms (e.g., stigma, discrimination) that stem from data security threats and the growing potential for reidentification of sensitive data. Further, our findings suggest that patients’ awareness and preoccupation with feeling monitored via computer sensors ranges from hypo- to hyper-awareness, with either extreme accompanied by ethical concerns (consent vs. anxiety and preoccupation). These results highlight the need for systematic research into how best to implement these technologies into clinical care in ways that reduce disruption, maximize patient benefits, and mitigate long-term risks associated with the passive collection of sensitive emotional, behavioral and neural data. |
| first_indexed | 2024-03-08T00:21:57Z |
| format | Article |
| id | doaj.art-6647b4592bbd418e97c4067e058eb9fe |
| institution | Directory Open Access Journal |
| issn | 1662-5161 |
| language | English |
| last_indexed | 2024-03-08T00:21:57Z |
| publishDate | 2024-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Human Neuroscience |
| spelling | doaj.art-6647b4592bbd418e97c4067e058eb9fe2024-02-16T04:59:24ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612024-02-011810.3389/fnhum.2024.13324511332451Ethical considerations for integrating multimodal computer perception and neurotechnologyMeghan E. Hurley0Anika Sonig1John Herrington2Eric A. Storch3Gabriel Lázaro-Muñoz4Gabriel Lázaro-Muñoz5Jennifer Blumenthal-Barby6Kristin Kostick-Quenet7Center for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United StatesCenter for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United StatesDepartment of Child and Adolescent Psychiatry and Behavioral Sciences, Children’s Hospital of Philadelphia, Philadelphia, PA, United StatesDepartment of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, United StatesCenter for Bioethics, Harvard Medical School, Boston, MA, United StatesDepartment of Psychiatry and Behavioral Sciences, Massachusetts General Hospital, Boston, MA, United StatesCenter for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United StatesCenter for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United StatesBackgroundArtificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling precision treatment, diagnosis, and symptom monitoring. At the same time, passive and continuous nature by which they often collect data from patients in non-clinical settings raises ethical issues related to privacy and self-determination. Little is known about how such concerns may be exacerbated by the integration of neural data, as parallel advances in computer perception, AI, and neurotechnology enable new insights into subjective states. Here, we present findings from a multi-site NCATS-funded study of ethical considerations for translating computer perception into clinical care and contextualize them within the neuroethics and neurorights literatures.MethodsWe conducted qualitative interviews with patients (n = 20), caregivers (n = 20), clinicians (n = 12), developers (n = 12), and clinician developers (n = 2) regarding their perspective toward using PC in clinical care. Transcripts were analyzed in MAXQDA using Thematic Content Analysis.ResultsStakeholder groups voiced concerns related to (1) perceived invasiveness of passive and continuous data collection in private settings; (2) data protection and security and the potential for negative downstream/future impacts on patients of unintended disclosure; and (3) ethical issues related to patients’ limited versus hyper awareness of passive and continuous data collection and monitoring. Clinicians and developers highlighted that these concerns may be exacerbated by the integration of neural data with other computer perception data.DiscussionOur findings suggest that the integration of neurotechnologies with existing computer perception technologies raises novel concerns around dignity-related and other harms (e.g., stigma, discrimination) that stem from data security threats and the growing potential for reidentification of sensitive data. Further, our findings suggest that patients’ awareness and preoccupation with feeling monitored via computer sensors ranges from hypo- to hyper-awareness, with either extreme accompanied by ethical concerns (consent vs. anxiety and preoccupation). These results highlight the need for systematic research into how best to implement these technologies into clinical care in ways that reduce disruption, maximize patient benefits, and mitigate long-term risks associated with the passive collection of sensitive emotional, behavioral and neural data.https://www.frontiersin.org/articles/10.3389/fnhum.2024.1332451/fullneuroethicsneural datacomputer perceptiondigital phenotypingaffective computingprivacy |
| spellingShingle | Meghan E. Hurley Anika Sonig John Herrington Eric A. Storch Gabriel Lázaro-Muñoz Gabriel Lázaro-Muñoz Jennifer Blumenthal-Barby Kristin Kostick-Quenet Ethical considerations for integrating multimodal computer perception and neurotechnology Frontiers in Human Neuroscience neuroethics neural data computer perception digital phenotyping affective computing privacy |
| title | Ethical considerations for integrating multimodal computer perception and neurotechnology |
| title_full | Ethical considerations for integrating multimodal computer perception and neurotechnology |
| title_fullStr | Ethical considerations for integrating multimodal computer perception and neurotechnology |
| title_full_unstemmed | Ethical considerations for integrating multimodal computer perception and neurotechnology |
| title_short | Ethical considerations for integrating multimodal computer perception and neurotechnology |
| title_sort | ethical considerations for integrating multimodal computer perception and neurotechnology |
| topic | neuroethics neural data computer perception digital phenotyping affective computing privacy |
| url | https://www.frontiersin.org/articles/10.3389/fnhum.2024.1332451/full |
| work_keys_str_mv | AT meghanehurley ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT anikasonig ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT johnherrington ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT ericastorch ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT gabriellazaromunoz ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT gabriellazaromunoz ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT jenniferblumenthalbarby ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology AT kristinkostickquenet ethicalconsiderationsforintegratingmultimodalcomputerperceptionandneurotechnology |