Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study
BackgroundMedication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders....
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2020-06-01
|
| Series: | JMIR mHealth and uHealth |
| Online Access: | https://mhealth.jmir.org/2020/6/e16648 |
| _version_ | 1818902461335732224 |
|---|---|
| author | Sigle, Stefan Barriga, Pilar Correa Fernández, Francisco Javier Juhra, Christian Härtel, Steffen Fegeler, Christian |
| author_facet | Sigle, Stefan Barriga, Pilar Correa Fernández, Francisco Javier Juhra, Christian Härtel, Steffen Fegeler, Christian |
| author_sort | Sigle, Stefan |
| collection | DOAJ |
| description | BackgroundMedication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders.
ObjectiveThe objective of this study was to quantify and compare the usability of an online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists.
MethodsQuantitative and qualitative data were acquired from patients, physicians, and pharmacists in this online usability study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS.
ResultsA total of 137 patients, 81 physicians, and 68 pharmacists participated in this study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected.
ConclusionsThe vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector. |
| first_indexed | 2024-12-19T20:36:01Z |
| format | Article |
| id | doaj.art-a2cb8f850450492b9f5f6a4c7d5523e9 |
| institution | Directory Open Access Journal |
| issn | 2291-5222 |
| language | English |
| last_indexed | 2024-12-19T20:36:01Z |
| publishDate | 2020-06-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR mHealth and uHealth |
| spelling | doaj.art-a2cb8f850450492b9f5f6a4c7d5523e92022-12-21T20:06:32ZengJMIR PublicationsJMIR mHealth and uHealth2291-52222020-06-0186e1664810.2196/16648Evaluating Online Consumer Medication Information Systems: Comparative Online Usability StudySigle, StefanBarriga, PilarCorrea Fernández, Francisco JavierJuhra, ChristianHärtel, SteffenFegeler, ChristianBackgroundMedication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. ObjectiveThe objective of this study was to quantify and compare the usability of an online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. MethodsQuantitative and qualitative data were acquired from patients, physicians, and pharmacists in this online usability study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. ResultsA total of 137 patients, 81 physicians, and 68 pharmacists participated in this study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. ConclusionsThe vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.https://mhealth.jmir.org/2020/6/e16648 |
| spellingShingle | Sigle, Stefan Barriga, Pilar Correa Fernández, Francisco Javier Juhra, Christian Härtel, Steffen Fegeler, Christian Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study JMIR mHealth and uHealth |
| title | Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study |
| title_full | Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study |
| title_fullStr | Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study |
| title_full_unstemmed | Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study |
| title_short | Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study |
| title_sort | evaluating online consumer medication information systems comparative online usability study |
| url | https://mhealth.jmir.org/2020/6/e16648 |
| work_keys_str_mv | AT siglestefan evaluatingonlineconsumermedicationinformationsystemscomparativeonlineusabilitystudy AT barrigapilar evaluatingonlineconsumermedicationinformationsystemscomparativeonlineusabilitystudy AT correafernandezfranciscojavier evaluatingonlineconsumermedicationinformationsystemscomparativeonlineusabilitystudy AT juhrachristian evaluatingonlineconsumermedicationinformationsystemscomparativeonlineusabilitystudy AT hartelsteffen evaluatingonlineconsumermedicationinformationsystemscomparativeonlineusabilitystudy AT fegelerchristian evaluatingonlineconsumermedicationinformationsystemscomparativeonlineusabilitystudy |