Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content

Background Clinicians need easy access to evidence-based information to inform their clinical practice. Point-of-care information summaries are increasingly available in the form of smartphone apps. However, the quality of information from the apps is questionable as there is currently no...

Full description

Bibliographic Details
Main Authors: Lee, Mauricette, Lin, Xiaowen, Chai, Joanne Zhi Qi, Lee, Eng Sing, Smith, Helen, Tudor Car, Lorainne
Other Authors: Lee Kong Chian School of Medicine (LKCMedicine)
Format: Journal Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/165820
_version_ 1826112663465230336
author Lee, Mauricette
Lin, Xiaowen
Chai, Joanne Zhi Qi
Lee, Eng Sing
Smith, Helen
Tudor Car, Lorainne
author2 Lee Kong Chian School of Medicine (LKCMedicine)
author_facet Lee Kong Chian School of Medicine (LKCMedicine)
Lee, Mauricette
Lin, Xiaowen
Chai, Joanne Zhi Qi
Lee, Eng Sing
Smith, Helen
Tudor Car, Lorainne
author_sort Lee, Mauricette
collection NTU
description Background Clinicians need easy access to evidence-based information to inform their clinical practice. Point-of-care information summaries are increasingly available in the form of smartphone apps. However, the quality of information from the apps is questionable as there is currently no regulation on the content of the medical apps. Objectives This study aimed to systematically assess the quality and content of the medical apps providing point-of-care information summaries that were available in two major app stores. We evaluated apps designed specifically for healthcare professionals and assessed their content development, editorial policy, coverage of medical conditions and trustworthiness. Methods We conducted a systematic assessment of medical apps providing point-of-care information summaries available in Google Play and Apple app stores. Apps launched or updated since January 2020 were identified through a systematic search using 42matters. Apps meeting the inclusion criteria were downloaded and assessed. The data extraction and app assessment were done in parallel and independently by at least two reviewers. Apps were evaluated against the adapted criteria: (1) general characteristics, (2) content presentation of the summaries, (3) editorial quality, (4) evidence-based methodology, (5) coverage (volume) of the medical conditions, (6) usability of apps and (7) trustworthiness of the app based on HONcode principles. HONcode principles are guidelines used to inform users about the credibility and reliability of health information online. The results were reported as a narrative review. Results Eight medical apps met the inclusion criteria and were systematically appraised. Based on our evaluation criteria, UpToDate supported 16 languages, and all other apps were English. Bullet points and brief paragraphs were used in all apps, and only DynaMed and Micromedex and Pathway-medical knowledge provided a formal grading system for the strength of recommendations for all the medical conditions in their apps. All the other apps either lacked a formal grading system altogether or offered one for some of the medical conditions. About 30% of the editorial quality assessment and 47.5% of the evidence-based methodology assessment were unclear or missing. UpToDate contained the most point-of-care evidence-based documents with >10500 documents. All apps except 5-Minute Clinical Consult and DynaMed and Micromedex were available for offline access. Only Medscape complied with the HONcode principles. Conclusions Future apps should report a more detailed evidence-based methodology, be accessible for offline use and support search in more than one language. There should be clearer information provided in future apps regarding the declaration of authorship and conflict of interest.
first_indexed 2024-10-01T03:10:47Z
format Journal Article
id ntu-10356/165820
institution Nanyang Technological University
language English
last_indexed 2024-10-01T03:10:47Z
publishDate 2023
record_format dspace
spelling ntu-10356/1658202023-04-16T15:37:44Z Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content Lee, Mauricette Lin, Xiaowen Chai, Joanne Zhi Qi Lee, Eng Sing Smith, Helen Tudor Car, Lorainne Lee Kong Chian School of Medicine (LKCMedicine) Social sciences::Communication Mobile App Point-of-Care Information Background Clinicians need easy access to evidence-based information to inform their clinical practice. Point-of-care information summaries are increasingly available in the form of smartphone apps. However, the quality of information from the apps is questionable as there is currently no regulation on the content of the medical apps. Objectives This study aimed to systematically assess the quality and content of the medical apps providing point-of-care information summaries that were available in two major app stores. We evaluated apps designed specifically for healthcare professionals and assessed their content development, editorial policy, coverage of medical conditions and trustworthiness. Methods We conducted a systematic assessment of medical apps providing point-of-care information summaries available in Google Play and Apple app stores. Apps launched or updated since January 2020 were identified through a systematic search using 42matters. Apps meeting the inclusion criteria were downloaded and assessed. The data extraction and app assessment were done in parallel and independently by at least two reviewers. Apps were evaluated against the adapted criteria: (1) general characteristics, (2) content presentation of the summaries, (3) editorial quality, (4) evidence-based methodology, (5) coverage (volume) of the medical conditions, (6) usability of apps and (7) trustworthiness of the app based on HONcode principles. HONcode principles are guidelines used to inform users about the credibility and reliability of health information online. The results were reported as a narrative review. Results Eight medical apps met the inclusion criteria and were systematically appraised. Based on our evaluation criteria, UpToDate supported 16 languages, and all other apps were English. Bullet points and brief paragraphs were used in all apps, and only DynaMed and Micromedex and Pathway-medical knowledge provided a formal grading system for the strength of recommendations for all the medical conditions in their apps. All the other apps either lacked a formal grading system altogether or offered one for some of the medical conditions. About 30% of the editorial quality assessment and 47.5% of the evidence-based methodology assessment were unclear or missing. UpToDate contained the most point-of-care evidence-based documents with >10500 documents. All apps except 5-Minute Clinical Consult and DynaMed and Micromedex were available for offline access. Only Medscape complied with the HONcode principles. Conclusions Future apps should report a more detailed evidence-based methodology, be accessible for offline use and support search in more than one language. There should be clearer information provided in future apps regarding the declaration of authorship and conflict of interest. Submitted/Accepted version 2023-04-14T02:53:12Z 2023-04-14T02:53:12Z 2023 Journal Article Lee, M., Lin, X., Chai, J. Z. Q., Lee, E. S., Smith, H. & Tudor Car, L. (2023). Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content. BMJ Evidence-Based Medicine. https://dx.doi.org/10.1136/ bmjebm-2022-112146 2515-446X https://hdl.handle.net/10356/165820 10.1136/ bmjebm-2022-112146 en BMJ Evidence-Based Medicine © 2023 Author(s) (or their employer(s). Published by BMJ. All rights reserved. This paper was published in BMJ Evidence-Based Medicine and is made available with permission of Author(s) (or their employer(s)). application/pdf
spellingShingle Social sciences::Communication
Mobile App
Point-of-Care Information
Lee, Mauricette
Lin, Xiaowen
Chai, Joanne Zhi Qi
Lee, Eng Sing
Smith, Helen
Tudor Car, Lorainne
Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content
title Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content
title_full Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content
title_fullStr Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content
title_full_unstemmed Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content
title_short Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content
title_sort smartphone apps for point of care information summaries systematic assessment of the quality and content
topic Social sciences::Communication
Mobile App
Point-of-Care Information
url https://hdl.handle.net/10356/165820
work_keys_str_mv AT leemauricette smartphoneappsforpointofcareinformationsummariessystematicassessmentofthequalityandcontent
AT linxiaowen smartphoneappsforpointofcareinformationsummariessystematicassessmentofthequalityandcontent
AT chaijoannezhiqi smartphoneappsforpointofcareinformationsummariessystematicassessmentofthequalityandcontent
AT leeengsing smartphoneappsforpointofcareinformationsummariessystematicassessmentofthequalityandcontent
AT smithhelen smartphoneappsforpointofcareinformationsummariessystematicassessmentofthequalityandcontent
AT tudorcarlorainne smartphoneappsforpointofcareinformationsummariessystematicassessmentofthequalityandcontent