Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool
Objective: The Sydney Health Literacy Lab (SHeLL) Editor is an online text-editing tool that provides real-time assessment and feedback on written health information (assesses grade reading score, complex language, passive voice). This study aimed to explore how the design could be further enhanced...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-12-01
|
| Series: | PEC Innovation |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2772628223000420 |
| _version_ | 1827919952524345344 |
|---|---|
| author | Julie Ayre Danielle M. Muscat Olivia Mac Carissa Bonner Adam G. Dunn Jason Dalmazzo Dana Mouwad Kirsten McCaffery |
| author_facet | Julie Ayre Danielle M. Muscat Olivia Mac Carissa Bonner Adam G. Dunn Jason Dalmazzo Dana Mouwad Kirsten McCaffery |
| author_sort | Julie Ayre |
| collection | DOAJ |
| description | Objective: The Sydney Health Literacy Lab (SHeLL) Editor is an online text-editing tool that provides real-time assessment and feedback on written health information (assesses grade reading score, complex language, passive voice). This study aimed to explore how the design could be further enhanced to help health information providers interpret and act on automated feedback. Methods: The prototype was iteratively refined across four rounds of user-testing with health services staff (N = 20). Participants took part in online interviews and a brief follow-up survey using validated usability scales (System Usability Scale, Technology Acceptance Model). After each round, Yardley's (2021) optimisation criteria guided which changes would be implemented. Results: Participants rated the Editor as having adequate usability (M = 82.8 out of 100, SD = 13.5). Most modifications sought to reduce information overload (e.g. simplifying instructions for new users) or make feedback motivating and actionable (e.g. using frequent incremental feedback to highlight changes to the text altered assessment scores). Conclusion: terative user-testing was critical to balancing academic values and the practical needs of the Editor's target users. The final version emphasises actionable real-time feedback and not just assessment. Innovation: The Editor is a new tool that will help health information providers apply health literacy principles to written text. |
| first_indexed | 2024-03-13T04:05:51Z |
| format | Article |
| id | doaj.art-f9f0783797a44a87b236d4b414011e41 |
| institution | Directory Open Access Journal |
| issn | 2772-6282 |
| language | English |
| last_indexed | 2024-03-13T04:05:51Z |
| publishDate | 2023-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | PEC Innovation |
| spelling | doaj.art-f9f0783797a44a87b236d4b414011e412023-06-21T07:01:48ZengElsevierPEC Innovation2772-62822023-12-012100162Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing toolJulie Ayre0Danielle M. Muscat1Olivia Mac2Carissa Bonner3Adam G. Dunn4Jason Dalmazzo5Dana Mouwad6Kirsten McCaffery7Sydney Health Literacy Lab, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, NSW, Australia; Corresponding author at: Rm 128C Edward Ford Building, The University of Sydney, NSW, Australia.Sydney Health Literacy Lab, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, NSW, AustraliaSydney Health Literacy Lab, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, NSW, AustraliaSydney Health Literacy Lab, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, NSW, Australia; Menzies Centre for Health Policy and Economics, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, AustraliaDiscipline of Biomedical Informatics and Digital Health, School of Medical Sciences, Faculty of Medicine and Health, The University of Sydney, NSW, AustraliaDiscipline of Biomedical Informatics and Digital Health, School of Medical Sciences, Faculty of Medicine and Health, The University of Sydney, NSW, AustraliaWestern Sydney Local Health District, Health Literacy Hub, Westmead, NSW, AustraliaSydney Health Literacy Lab, Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, NSW, AustraliaObjective: The Sydney Health Literacy Lab (SHeLL) Editor is an online text-editing tool that provides real-time assessment and feedback on written health information (assesses grade reading score, complex language, passive voice). This study aimed to explore how the design could be further enhanced to help health information providers interpret and act on automated feedback. Methods: The prototype was iteratively refined across four rounds of user-testing with health services staff (N = 20). Participants took part in online interviews and a brief follow-up survey using validated usability scales (System Usability Scale, Technology Acceptance Model). After each round, Yardley's (2021) optimisation criteria guided which changes would be implemented. Results: Participants rated the Editor as having adequate usability (M = 82.8 out of 100, SD = 13.5). Most modifications sought to reduce information overload (e.g. simplifying instructions for new users) or make feedback motivating and actionable (e.g. using frequent incremental feedback to highlight changes to the text altered assessment scores). Conclusion: terative user-testing was critical to balancing academic values and the practical needs of the Editor's target users. The final version emphasises actionable real-time feedback and not just assessment. Innovation: The Editor is a new tool that will help health information providers apply health literacy principles to written text.http://www.sciencedirect.com/science/article/pii/S2772628223000420Health LiteracyHealth communicationHealth informationTool evaluationUser testingReadability |
| spellingShingle | Julie Ayre Danielle M. Muscat Olivia Mac Carissa Bonner Adam G. Dunn Jason Dalmazzo Dana Mouwad Kirsten McCaffery Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool PEC Innovation Health Literacy Health communication Health information Tool evaluation User testing Readability |
| title | Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool |
| title_full | Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool |
| title_fullStr | Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool |
| title_full_unstemmed | Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool |
| title_short | Helping patient educators meet health literacy needs: End-user testing and iterative development of an innovative health literacy editing tool |
| title_sort | helping patient educators meet health literacy needs end user testing and iterative development of an innovative health literacy editing tool |
| topic | Health Literacy Health communication Health information Tool evaluation User testing Readability |
| url | http://www.sciencedirect.com/science/article/pii/S2772628223000420 |
| work_keys_str_mv | AT julieayre helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT daniellemmuscat helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT oliviamac helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT carissabonner helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT adamgdunn helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT jasondalmazzo helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT danamouwad helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool AT kirstenmccaffery helpingpatienteducatorsmeethealthliteracyneedsendusertestinganditerativedevelopmentofaninnovativehealthliteracyeditingtool |