Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records
Objectives To assess the feasibility of using a natural language processing (NLP) application for extraction of free-text online activity mentions in adolescent mental health patient electronic health records (EHRs).Setting The Clinical Records Interactive Search system allows detailed research base...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2023-05-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/13/5/e061640.full |
| _version_ | 1797820035944677376 |
|---|---|
| author | Rosemary Sedgwick Rina Dutta Johnny Downs André Bittar Herkiran Kalsi Tamara Barack |
| author_facet | Rosemary Sedgwick Rina Dutta Johnny Downs André Bittar Herkiran Kalsi Tamara Barack |
| author_sort | Rosemary Sedgwick |
| collection | DOAJ |
| description | Objectives To assess the feasibility of using a natural language processing (NLP) application for extraction of free-text online activity mentions in adolescent mental health patient electronic health records (EHRs).Setting The Clinical Records Interactive Search system allows detailed research based on deidentified EHRs from the South London and Maudsley NHS Foundation Trust, a large south London Mental Health Trust providing secondary and tertiary mental healthcare.Participants and methods We developed a gazetteer of online activity terms and annotation guidelines, from 5480 clinical notes (200 adolescents, aged 11–17 years) receiving specialist mental healthcare. The preprocessing and manual curation steps of this real-world data set allowed development of a rule-based NLP application to automate identification of online activity (internet, social media, online gaming) mentions in EHRs. The context of each mention was also recorded manually as: supportive, detrimental or neutral in a subset of data for additional analysis.Results The NLP application performed with good precision (0.97) and recall (0.94) for identification of online activity mentions. Preliminary analyses found 34% of online activity mentions were considered to have been documented within a supportive context for the young person, 38% detrimental and 28% neutral.Conclusion Our results provide an important example of a rule-based NLP methodology to accurately identify online activity recording in EHRs, enabling researchers to now investigate associations with a range of adolescent mental health outcomes. |
| first_indexed | 2024-03-13T09:32:25Z |
| format | Article |
| id | doaj.art-6fa78d7bc9d04519aab6089680c65a2a |
| institution | Directory Open Access Journal |
| issn | 2044-6055 |
| language | English |
| last_indexed | 2024-03-13T09:32:25Z |
| publishDate | 2023-05-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj.art-6fa78d7bc9d04519aab6089680c65a2a2023-05-25T23:00:07ZengBMJ Publishing GroupBMJ Open2044-60552023-05-0113510.1136/bmjopen-2022-061640Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health recordsRosemary Sedgwick0Rina Dutta1Johnny Downs2André Bittar3Herkiran Kalsi4Tamara Barack53 South London and Maudsley NHS Foundation Trust, London, UKSouth London and Maudsley NHS Foundation Trust, London, UKCAMHS Digital Lab, Dept of Child and Adolescent Psychiatry, Institute of Psychiatry Psychology and Neuroscience, King`s College London and South London and Maudsley NHS Foundation Trust, UK, London, UKInstitute of Psychiatry, Psychology and Neuroscience, Kings College London, London, UKDepartment of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UKDepartment of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UKObjectives To assess the feasibility of using a natural language processing (NLP) application for extraction of free-text online activity mentions in adolescent mental health patient electronic health records (EHRs).Setting The Clinical Records Interactive Search system allows detailed research based on deidentified EHRs from the South London and Maudsley NHS Foundation Trust, a large south London Mental Health Trust providing secondary and tertiary mental healthcare.Participants and methods We developed a gazetteer of online activity terms and annotation guidelines, from 5480 clinical notes (200 adolescents, aged 11–17 years) receiving specialist mental healthcare. The preprocessing and manual curation steps of this real-world data set allowed development of a rule-based NLP application to automate identification of online activity (internet, social media, online gaming) mentions in EHRs. The context of each mention was also recorded manually as: supportive, detrimental or neutral in a subset of data for additional analysis.Results The NLP application performed with good precision (0.97) and recall (0.94) for identification of online activity mentions. Preliminary analyses found 34% of online activity mentions were considered to have been documented within a supportive context for the young person, 38% detrimental and 28% neutral.Conclusion Our results provide an important example of a rule-based NLP methodology to accurately identify online activity recording in EHRs, enabling researchers to now investigate associations with a range of adolescent mental health outcomes.https://bmjopen.bmj.com/content/13/5/e061640.full |
| spellingShingle | Rosemary Sedgwick Rina Dutta Johnny Downs André Bittar Herkiran Kalsi Tamara Barack Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records BMJ Open |
| title | Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records |
| title_full | Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records |
| title_fullStr | Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records |
| title_full_unstemmed | Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records |
| title_short | Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records |
| title_sort | investigating online activity in uk adolescent mental health patients a feasibility study using a natural language processing approach for electronic health records |
| url | https://bmjopen.bmj.com/content/13/5/e061640.full |
| work_keys_str_mv | AT rosemarysedgwick investigatingonlineactivityinukadolescentmentalhealthpatientsafeasibilitystudyusinganaturallanguageprocessingapproachforelectronichealthrecords AT rinadutta investigatingonlineactivityinukadolescentmentalhealthpatientsafeasibilitystudyusinganaturallanguageprocessingapproachforelectronichealthrecords AT johnnydowns investigatingonlineactivityinukadolescentmentalhealthpatientsafeasibilitystudyusinganaturallanguageprocessingapproachforelectronichealthrecords AT andrebittar investigatingonlineactivityinukadolescentmentalhealthpatientsafeasibilitystudyusinganaturallanguageprocessingapproachforelectronichealthrecords AT herkirankalsi investigatingonlineactivityinukadolescentmentalhealthpatientsafeasibilitystudyusinganaturallanguageprocessingapproachforelectronichealthrecords AT tamarabarack investigatingonlineactivityinukadolescentmentalhealthpatientsafeasibilitystudyusinganaturallanguageprocessingapproachforelectronichealthrecords |