Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care
Abstract Background To realize the broader benefits of electronic patient-reported outcome measures (ePROMs) in routine care, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to inform the translation of a clinically effective ePROM system (hereafter ref...
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-06-01
|
| Series: | Journal of Patient-Reported Outcomes |
| Online Access: | https://doi.org/10.1186/s41687-022-00475-6 |
| _version_ | 1818545816594284544 |
|---|---|
| author | Afaf Girgis Adeola Bamgboje-Ayodele Orlando Rincones Shalini K. Vinod Sandra Avery Joseph Descallar Allan ‘Ben’ Smith Belinda Arnold Anthony Arnold Victoria Bray Ivana Durcinoska Nicole M. Rankin the PROMPT-Care Implementation Authorship Group Geoff P. Delaney |
| author_facet | Afaf Girgis Adeola Bamgboje-Ayodele Orlando Rincones Shalini K. Vinod Sandra Avery Joseph Descallar Allan ‘Ben’ Smith Belinda Arnold Anthony Arnold Victoria Bray Ivana Durcinoska Nicole M. Rankin the PROMPT-Care Implementation Authorship Group Geoff P. Delaney |
| author_sort | Afaf Girgis |
| collection | DOAJ |
| description | Abstract Background To realize the broader benefits of electronic patient-reported outcome measures (ePROMs) in routine care, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to inform the translation of a clinically effective ePROM system (hereafter referred to as the PRM system) into practice. The study aimed to evaluate the processes and success of implementing the PRM system in the routine care of patients diagnosed with lung cancer. Method A controlled before-and-after mixed-methods study was undertaken. Data sources included a self-report questionnaire and interviews with healthcare providers, electronic health record data for PRMs patients and historical controls, and field notes. Descriptive statistics, logistic regression modelling, negative binomial models, generalized estimating equations and repeated measures ANOVA were used to analyze quantitative data. Qualitative data was thematically analyzed. Results A total of 48/79 eligible people diagnosed with lung cancer completed 90 assessments during the 5-month implementation period (RE-AIM reach). Every assessment breached the pre-defined threshold and care coordinators reviewed and actioned 95.6% of breaches, resulting in 146 referrals to allied health services, most frequently for social work (25.3%), dietetics (18.5%), physiotherapy (18.5%) and occupational therapy (17.1%). PRMs patients had significantly fewer visits to the cancer assessment unit for problematic symptoms (M = 0.23 vs. M = 0.43; p = 0.035), and were significantly more likely to be offered referrals (71% vs. 29%, p < 0.0001) than historical controls (RE-AIM effect). The levels of ‘organizational readiness for implementing change’ (ORIC) did not show much differences between baseline and follow-up, though this was already high at baseline; but significantly more staff reported improved confidence when asking patients to complete assessments (64.7% at baseline vs. 88.2% at follow-up, p = 0.0046), and when describing the assessment tool to patients (64.7% at baseline vs. 76.47% at follow-up, p = 0.0018) (RE-AIM adoption). A total of 78 staff received PRM system training, and 95.6% of the PRM system alerts were actioned (RE-AIM implementation); and all lung cancer care coordinators were engaged with the PRM system beyond the end of the study period (RE-AIM maintenance). Conclusion This study demonstrates the potential of the PRM system in enhancing the routine care of lung cancer patients, through leveraging the capabilities of automated web-based care options. Plain English summary Research has shown the clear benefits of using electronically collected patient-reported outcome measures (ePROMs) for cancer patients and health services. However, we need to better understand how to implement ePROMs as part of routine care. This study evaluated the processes and outcomes of implementing an ePROMs system in the routine care of patients diagnosed with lung cancer. Key findings included: (a) a majority of eligible patients completed the scheduled assessments; (b) patient concerns were identified in every assessment, and care coordinators reviewed and actioned almost all of these, including making significantly more referrals to allied health services; (c) patients completing assessments regularly were less likely to present to the cancer assessment unit with problematic symptoms, suggesting that ePROMs identified patient concerns early and this led to a timely response to concerns; (d) staff training and engagement was high, and staff reporting increased confidence when asking patients to complete assessments and when describing the assessment tool to patients at the end of the implementation period. This study shows that implementing ePROMs in routine care is feasible and can lead to improvements in patient care. |
| first_indexed | 2024-12-12T07:44:58Z |
| format | Article |
| id | doaj.art-4abbe444d55940e5bf880c9e50f89ede |
| institution | Directory Open Access Journal |
| issn | 2509-8020 |
| language | English |
| last_indexed | 2024-12-12T07:44:58Z |
| publishDate | 2022-06-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Journal of Patient-Reported Outcomes |
| spelling | doaj.art-4abbe444d55940e5bf880c9e50f89ede2022-12-22T00:32:37ZengSpringerOpenJournal of Patient-Reported Outcomes2509-80202022-06-016111410.1186/s41687-022-00475-6Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer careAfaf Girgis0Adeola Bamgboje-Ayodele1Orlando Rincones2Shalini K. Vinod3Sandra Avery4Joseph Descallar5Allan ‘Ben’ Smith6Belinda Arnold7Anthony Arnold8Victoria Bray9Ivana Durcinoska10Nicole M. Rankin11the PROMPT-Care Implementation Authorship GroupGeoff P. Delaney12South West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesIngham Institute for Applied Medical ResearchSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesIngham Institute for Applied Medical ResearchSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesWollongong Hospital, Illawarra Shoalhaven Local Health DistrictWollongong Hospital, Illawarra Shoalhaven Local Health DistrictSouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesIngham Institute for Applied Medical ResearchSydney School of Public Health, The University of SydneySouth West Sydney Clinical Campuses, UNSW Medicine and Health, University of New South WalesAbstract Background To realize the broader benefits of electronic patient-reported outcome measures (ePROMs) in routine care, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to inform the translation of a clinically effective ePROM system (hereafter referred to as the PRM system) into practice. The study aimed to evaluate the processes and success of implementing the PRM system in the routine care of patients diagnosed with lung cancer. Method A controlled before-and-after mixed-methods study was undertaken. Data sources included a self-report questionnaire and interviews with healthcare providers, electronic health record data for PRMs patients and historical controls, and field notes. Descriptive statistics, logistic regression modelling, negative binomial models, generalized estimating equations and repeated measures ANOVA were used to analyze quantitative data. Qualitative data was thematically analyzed. Results A total of 48/79 eligible people diagnosed with lung cancer completed 90 assessments during the 5-month implementation period (RE-AIM reach). Every assessment breached the pre-defined threshold and care coordinators reviewed and actioned 95.6% of breaches, resulting in 146 referrals to allied health services, most frequently for social work (25.3%), dietetics (18.5%), physiotherapy (18.5%) and occupational therapy (17.1%). PRMs patients had significantly fewer visits to the cancer assessment unit for problematic symptoms (M = 0.23 vs. M = 0.43; p = 0.035), and were significantly more likely to be offered referrals (71% vs. 29%, p < 0.0001) than historical controls (RE-AIM effect). The levels of ‘organizational readiness for implementing change’ (ORIC) did not show much differences between baseline and follow-up, though this was already high at baseline; but significantly more staff reported improved confidence when asking patients to complete assessments (64.7% at baseline vs. 88.2% at follow-up, p = 0.0046), and when describing the assessment tool to patients (64.7% at baseline vs. 76.47% at follow-up, p = 0.0018) (RE-AIM adoption). A total of 78 staff received PRM system training, and 95.6% of the PRM system alerts were actioned (RE-AIM implementation); and all lung cancer care coordinators were engaged with the PRM system beyond the end of the study period (RE-AIM maintenance). Conclusion This study demonstrates the potential of the PRM system in enhancing the routine care of lung cancer patients, through leveraging the capabilities of automated web-based care options. Plain English summary Research has shown the clear benefits of using electronically collected patient-reported outcome measures (ePROMs) for cancer patients and health services. However, we need to better understand how to implement ePROMs as part of routine care. This study evaluated the processes and outcomes of implementing an ePROMs system in the routine care of patients diagnosed with lung cancer. Key findings included: (a) a majority of eligible patients completed the scheduled assessments; (b) patient concerns were identified in every assessment, and care coordinators reviewed and actioned almost all of these, including making significantly more referrals to allied health services; (c) patients completing assessments regularly were less likely to present to the cancer assessment unit with problematic symptoms, suggesting that ePROMs identified patient concerns early and this led to a timely response to concerns; (d) staff training and engagement was high, and staff reporting increased confidence when asking patients to complete assessments and when describing the assessment tool to patients at the end of the implementation period. This study shows that implementing ePROMs in routine care is feasible and can lead to improvements in patient care.https://doi.org/10.1186/s41687-022-00475-6 |
| spellingShingle | Afaf Girgis Adeola Bamgboje-Ayodele Orlando Rincones Shalini K. Vinod Sandra Avery Joseph Descallar Allan ‘Ben’ Smith Belinda Arnold Anthony Arnold Victoria Bray Ivana Durcinoska Nicole M. Rankin the PROMPT-Care Implementation Authorship Group Geoff P. Delaney Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care Journal of Patient-Reported Outcomes |
| title | Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care |
| title_full | Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care |
| title_fullStr | Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care |
| title_full_unstemmed | Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care |
| title_short | Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care |
| title_sort | stepping into the real world a mixed methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care |
| url | https://doi.org/10.1186/s41687-022-00475-6 |
| work_keys_str_mv | AT afafgirgis steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT adeolabamgbojeayodele steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT orlandorincones steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT shalinikvinod steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT sandraavery steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT josephdescallar steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT allanbensmith steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT belindaarnold steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT anthonyarnold steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT victoriabray steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT ivanadurcinoska steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT nicolemrankin steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT thepromptcareimplementationauthorshipgroup steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare AT geoffpdelaney steppingintotherealworldamixedmethodsevaluationoftheimplementationofelectronicpatientreportedoutcomesinroutinelungcancercare |