Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework

Background: The 2014 UK Research Excellence Framework (REF2014) generated a unique database of impact case studies, each describing a body of research and impact beyond academia. We sought to explore the nature and mechanism of impact in a sample of these. Methods: The study design was manual conten...

Täydet tiedot

Bibliografiset tiedot
Päätekijät: Greenhalgh, T, Fahy, N
Aineistotyyppi: Journal article
Julkaistu: BioMed Central 2015
_version_ 1826299347306807296
author Greenhalgh, T
Fahy, N
author_facet Greenhalgh, T
Fahy, N
author_sort Greenhalgh, T
collection OXFORD
description Background: The 2014 UK Research Excellence Framework (REF2014) generated a unique database of impact case studies, each describing a body of research and impact beyond academia. We sought to explore the nature and mechanism of impact in a sample of these. Methods: The study design was manual content analysis of a large sample of impact case studies (producing mainly quantitative data), plus in-depth interpretive analysis of a smaller sub-sample (for qualitative detail), thereby generating both breadth and depth. For all 162 impact case studies submitted to sub-panel A2 in REF2014, we extracted data on study design(s), stated impacts and audiences, mechanisms of impact, and efforts to achieve impact. We analysed four case studies (selected as exemplars of the range of approaches to impact) in depth, including contacting the authors for their narratives of impact efforts. Results: Most impact case studies described quantitative research (most commonly, trials) and depicted a direct, linear link between research and impact. Research was said to have influenced a guideline in 122 case studies, changed policy in 88, changed practice in 84, improved morbidity in 44 and reduced mortality in 25. Qualitative and participatory research designs were rare, and only one case study described a co-production model of impact. Eighty-two case studies described strong and ongoing linkages with policymakers, but only 38 described targeted knowledge translation activities. In 40 case studies, no active efforts to achieve impact were described. Models of good implementation practice were characterised by an ethical commitment by researchers, strong institutional support and a proactive, interdisciplinary approach to impact activities. Conclusion: REF2014 both inspired and documented significant efforts by UK researchers to achieve impact. But in contrast with the published evidence on research impact (which depicts much as occurring indirectly through non-linear mechanisms), this sub-panel seems to have captured mainly direct and relatively short-term impacts one step removed from patient outcomes. Limited impacts on morbidity and mortality, and researchers' relatively low emphasis on the processes and interactions through which indirect impacts may occur, are concerns. These findings have implications for multi-stakeholder research collaborations such as UK National Institute for Health Research Collaborations for Leadership in Applied Health Research and Care, which are built on non-linear models of impact.
first_indexed 2024-03-07T05:00:33Z
format Journal article
id oxford-uuid:d821cad4-0a1e-4c83-b50e-2d67b0029b57
institution University of Oxford
last_indexed 2024-03-07T05:00:33Z
publishDate 2015
publisher BioMed Central
record_format dspace
spelling oxford-uuid:d821cad4-0a1e-4c83-b50e-2d67b0029b572022-03-27T08:46:07ZResearch impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence FrameworkJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:d821cad4-0a1e-4c83-b50e-2d67b0029b57Symplectic Elements at OxfordBioMed Central2015Greenhalgh, TFahy, NBackground: The 2014 UK Research Excellence Framework (REF2014) generated a unique database of impact case studies, each describing a body of research and impact beyond academia. We sought to explore the nature and mechanism of impact in a sample of these. Methods: The study design was manual content analysis of a large sample of impact case studies (producing mainly quantitative data), plus in-depth interpretive analysis of a smaller sub-sample (for qualitative detail), thereby generating both breadth and depth. For all 162 impact case studies submitted to sub-panel A2 in REF2014, we extracted data on study design(s), stated impacts and audiences, mechanisms of impact, and efforts to achieve impact. We analysed four case studies (selected as exemplars of the range of approaches to impact) in depth, including contacting the authors for their narratives of impact efforts. Results: Most impact case studies described quantitative research (most commonly, trials) and depicted a direct, linear link between research and impact. Research was said to have influenced a guideline in 122 case studies, changed policy in 88, changed practice in 84, improved morbidity in 44 and reduced mortality in 25. Qualitative and participatory research designs were rare, and only one case study described a co-production model of impact. Eighty-two case studies described strong and ongoing linkages with policymakers, but only 38 described targeted knowledge translation activities. In 40 case studies, no active efforts to achieve impact were described. Models of good implementation practice were characterised by an ethical commitment by researchers, strong institutional support and a proactive, interdisciplinary approach to impact activities. Conclusion: REF2014 both inspired and documented significant efforts by UK researchers to achieve impact. But in contrast with the published evidence on research impact (which depicts much as occurring indirectly through non-linear mechanisms), this sub-panel seems to have captured mainly direct and relatively short-term impacts one step removed from patient outcomes. Limited impacts on morbidity and mortality, and researchers' relatively low emphasis on the processes and interactions through which indirect impacts may occur, are concerns. These findings have implications for multi-stakeholder research collaborations such as UK National Institute for Health Research Collaborations for Leadership in Applied Health Research and Care, which are built on non-linear models of impact.
spellingShingle Greenhalgh, T
Fahy, N
Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework
title Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework
title_full Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework
title_fullStr Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework
title_full_unstemmed Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework
title_short Research impact in the community-based health sciences: An analysis of 162 case studies from the 2014 UK Research Excellence Framework
title_sort research impact in the community based health sciences an analysis of 162 case studies from the 2014 uk research excellence framework
work_keys_str_mv AT greenhalght researchimpactinthecommunitybasedhealthsciencesananalysisof162casestudiesfromthe2014ukresearchexcellenceframework
AT fahyn researchimpactinthecommunitybasedhealthsciencesananalysisof162casestudiesfromthe2014ukresearchexcellenceframework