How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review
Abstract Objectives Health interventions in a clinical setting may be complex. This is particularly true of clinical interventions which require systems reorganization or behavioural change, and/or when implementation involves additional challenges not captured within a clinical trial setting. Medic...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2021-08-01
|
| Series: | Health Research Policy and Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12961-021-00766-2 |
| _version_ | 1818586952138489856 |
|---|---|
| author | Robert Heggie Kathleen Boyd Olivia Wu |
| author_facet | Robert Heggie Kathleen Boyd Olivia Wu |
| author_sort | Robert Heggie |
| collection | DOAJ |
| description | Abstract Objectives Health interventions in a clinical setting may be complex. This is particularly true of clinical interventions which require systems reorganization or behavioural change, and/or when implementation involves additional challenges not captured within a clinical trial setting. Medical Research Council guidance on complex interventions highlights the need to consider economic evaluation alongside implementation. However, the extent to which this guidance has been adhered to, and how, is unclear. The failure to incorporate implementation within the evaluation of an intervention may hinder the translation of research findings into routine practice. This will have consequences for patient care. This study examined the methods used to address implementation within health research conducted through funding from the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme. Methods We conducted a rapid review using a systematic approach. We included all NIHR HTA monographs which contained the word “implementation” within the title or abstract published between 2014 and 2020. We assessed the studies according to existing recommendations for specifying and reporting implementation approaches in research. Additional themes which were not included in the recommendation, but were of particular relevance to our research question, were also identified and summarized in a narrative synthesis. Results The extent to which implementation was formally incorporated, and defined, varied among studies. Methods for examining implementation ranged from single stakeholder engagement events to the more comprehensive process evaluation. There was no obvious pattern as to whether approaches to implementation had evolved over recent years. Approximately 50% (22/42) of studies included an economic evaluation. Of these, two studies included the use of qualitative data obtained within the study to quantitatively inform aspects relating to implementation and economic evaluation in their study. Discussion A variety of approaches were identified for incorporating implementation within an HTA. However, they did not go far enough in terms of incorporating implementation into the actual design and evaluation. To ensure the implementation of clinically effective and cost-effective interventions, we propose that further guidance on how to incorporate implementation within complex interventions is required. Incorporating implementation into economic evaluation provides a step in this direction. |
| first_indexed | 2024-12-16T09:01:08Z |
| format | Article |
| id | doaj.art-4322b2a4dbb94b068d9724c9b11333ab |
| institution | Directory Open Access Journal |
| issn | 1478-4505 |
| language | English |
| last_indexed | 2024-12-16T09:01:08Z |
| publishDate | 2021-08-01 |
| publisher | BMC |
| record_format | Article |
| series | Health Research Policy and Systems |
| spelling | doaj.art-4322b2a4dbb94b068d9724c9b11333ab2022-12-21T22:37:11ZengBMCHealth Research Policy and Systems1478-45052021-08-0119111510.1186/s12961-021-00766-2How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid reviewRobert Heggie0Kathleen Boyd1Olivia Wu2Health Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of GlasgowHealth Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of GlasgowHealth Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of GlasgowAbstract Objectives Health interventions in a clinical setting may be complex. This is particularly true of clinical interventions which require systems reorganization or behavioural change, and/or when implementation involves additional challenges not captured within a clinical trial setting. Medical Research Council guidance on complex interventions highlights the need to consider economic evaluation alongside implementation. However, the extent to which this guidance has been adhered to, and how, is unclear. The failure to incorporate implementation within the evaluation of an intervention may hinder the translation of research findings into routine practice. This will have consequences for patient care. This study examined the methods used to address implementation within health research conducted through funding from the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme. Methods We conducted a rapid review using a systematic approach. We included all NIHR HTA monographs which contained the word “implementation” within the title or abstract published between 2014 and 2020. We assessed the studies according to existing recommendations for specifying and reporting implementation approaches in research. Additional themes which were not included in the recommendation, but were of particular relevance to our research question, were also identified and summarized in a narrative synthesis. Results The extent to which implementation was formally incorporated, and defined, varied among studies. Methods for examining implementation ranged from single stakeholder engagement events to the more comprehensive process evaluation. There was no obvious pattern as to whether approaches to implementation had evolved over recent years. Approximately 50% (22/42) of studies included an economic evaluation. Of these, two studies included the use of qualitative data obtained within the study to quantitatively inform aspects relating to implementation and economic evaluation in their study. Discussion A variety of approaches were identified for incorporating implementation within an HTA. However, they did not go far enough in terms of incorporating implementation into the actual design and evaluation. To ensure the implementation of clinically effective and cost-effective interventions, we propose that further guidance on how to incorporate implementation within complex interventions is required. Incorporating implementation into economic evaluation provides a step in this direction.https://doi.org/10.1186/s12961-021-00766-2ImplementationEconomic evaluationMixed methodsHealth technology assessment |
| spellingShingle | Robert Heggie Kathleen Boyd Olivia Wu How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review Health Research Policy and Systems Implementation Economic evaluation Mixed methods Health technology assessment |
| title | How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review |
| title_full | How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review |
| title_fullStr | How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review |
| title_full_unstemmed | How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review |
| title_short | How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review |
| title_sort | how has implementation been incorporated in health technology assessments in the united kingdom a systematic rapid review |
| topic | Implementation Economic evaluation Mixed methods Health technology assessment |
| url | https://doi.org/10.1186/s12961-021-00766-2 |
| work_keys_str_mv | AT robertheggie howhasimplementationbeenincorporatedinhealthtechnologyassessmentsintheunitedkingdomasystematicrapidreview AT kathleenboyd howhasimplementationbeenincorporatedinhealthtechnologyassessmentsintheunitedkingdomasystematicrapidreview AT oliviawu howhasimplementationbeenincorporatedinhealthtechnologyassessmentsintheunitedkingdomasystematicrapidreview |