A mixed-methods evaluation of transformational change in NHS North East
Background: The North East Transformation System (NETS) was conceived as an experiment in adopting large-scale transformational change across a NHS region in England. Although the NHS in the North East performs well, the health of the population ranks among the poorest in the country. The NETS was v...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National Institute for Health Research
2014-11-01
|
| Series: | Health Services and Delivery Research |
| Subjects: | |
| Online Access: | https://doi.org/10.3310/hsdr02470 |
| _version_ | 1818478294017769472 |
|---|---|
| author | David J Hunter Jonathan Erskine Chris Hicks Tom McGovern Adrian Small Ed Lugsden Paula Whitty Ian Nick Steen Martin Eccles |
| author_facet | David J Hunter Jonathan Erskine Chris Hicks Tom McGovern Adrian Small Ed Lugsden Paula Whitty Ian Nick Steen Martin Eccles |
| author_sort | David J Hunter |
| collection | DOAJ |
| description | Background: The North East Transformation System (NETS) was conceived as an experiment in adopting large-scale transformational change across a NHS region in England. Although the NHS in the North East performs well, the health of the population ranks among the poorest in the country. The NETS was viewed as a means of addressing this conundrum. It comprised three components: Vision, Compact and Method. Objectives: The evaluation study comprised six elements: a literature review; an evaluation of the evolution and impact of the NETS; an identification of the factors facilitating, and/or acting as barriers to, successful change; an assessment of the role of the NETS project team; establishing how far the changes introduced through the NETS became embedded and sustained; and an evaluation of the impact of the NETS on end users. Design: The research comprised a longitudinal mixed-methods study conducted over 3.5 years. Research methods included 68 semistructured interviews, observation, two focus groups, documentary analysis and interrupted time series (ITS) analysis. The ITS component comprised analysis of five rapid process improvement workshops in two of the sites. Setting: The research setting was the NHS North East region until its abolition in April 2013 following the UK government’s NHS changes. Fourteen sites were selected for the study, comprising primary care trusts as commissioners, and provider trusts including mental health, community, acute care and ambulance services. Participants: The study respondents were members of staff in the 14 sites drawn from different levels of their organisations. Interventions: The NETS comprised a complex set of interventions aimed at improving the efficiency and effectiveness of care pathways for staff and patients. Main outcome measures: The ‘receptive contexts for change’ framework was used to evaluate the transformational change process and its outcomes. Data sources: Qualitative parts of the study drew on semistructured interviews, focus groups, observation and documents. Quantitative parts of the study used routinely collected NHS data. Results: Transformational change in a complex system takes time and demands consistency, constancy of purpose and organisational stability. The NETS was seriously disrupted by the NHS changes announced in July 2010. Progress was sustained at four of the study sites, but slowed or ceased at the other sites. Leadership style was found to be critical to the success of transformational change. Conclusions: The NETS was a bold and ambitious initiative which succeeded in bringing about real and lasting change in some parts of the North East. However, it was unable to fully realise its vision and purpose partly because of the widespread reorganisation of the NHS by the new coalition government. Future work: There is a need to develop new methods to understand how change occurs, or fails, in complex settings like the NHS. There is a need for more in-depth studies in those sites that were able to implement and sustain change. This would inform future policy and practice. The results of the quantitative analyses were less conclusive than those obtained by qualitative methods. Further development of mixed-methods approaches would provide additional support for evidence-based decision-making. Funding: The National Institute for Health Research Health Services and Delivery Research programme. |
| first_indexed | 2024-12-10T09:46:12Z |
| format | Article |
| id | doaj.art-67b1a6176e804badb947883260b4ef42 |
| institution | Directory Open Access Journal |
| issn | 2050-4349 2050-4357 |
| language | English |
| last_indexed | 2024-12-10T09:46:12Z |
| publishDate | 2014-11-01 |
| publisher | National Institute for Health Research |
| record_format | Article |
| series | Health Services and Delivery Research |
| spelling | doaj.art-67b1a6176e804badb947883260b4ef422022-12-22T01:53:49ZengNational Institute for Health ResearchHealth Services and Delivery Research2050-43492050-43572014-11-0124710.3310/hsdr0247008/1809/255A mixed-methods evaluation of transformational change in NHS North EastDavid J Hunter0Jonathan Erskine1Chris Hicks2Tom McGovern3Adrian Small4Ed Lugsden5Paula Whitty6Ian Nick Steen7Martin Eccles8Centre for Public Policy and Health, Durham University, Durham, UKCentre for Public Policy and Health, Durham University, Durham, UKNewcastle University Business School, Newcastle upon Tyne, UKNewcastle University Business School, Newcastle upon Tyne, UKNewcastle University Business School, Newcastle upon Tyne, UKNewcastle University Business School, Newcastle upon Tyne, UKInstitute of Health & Society, Newcastle University, Newcastle upon Tyne, UKInstitute of Health & Society, Newcastle University, Newcastle upon Tyne, UKInstitute of Health & Society, Newcastle University, Newcastle upon Tyne, UKBackground: The North East Transformation System (NETS) was conceived as an experiment in adopting large-scale transformational change across a NHS region in England. Although the NHS in the North East performs well, the health of the population ranks among the poorest in the country. The NETS was viewed as a means of addressing this conundrum. It comprised three components: Vision, Compact and Method. Objectives: The evaluation study comprised six elements: a literature review; an evaluation of the evolution and impact of the NETS; an identification of the factors facilitating, and/or acting as barriers to, successful change; an assessment of the role of the NETS project team; establishing how far the changes introduced through the NETS became embedded and sustained; and an evaluation of the impact of the NETS on end users. Design: The research comprised a longitudinal mixed-methods study conducted over 3.5 years. Research methods included 68 semistructured interviews, observation, two focus groups, documentary analysis and interrupted time series (ITS) analysis. The ITS component comprised analysis of five rapid process improvement workshops in two of the sites. Setting: The research setting was the NHS North East region until its abolition in April 2013 following the UK government’s NHS changes. Fourteen sites were selected for the study, comprising primary care trusts as commissioners, and provider trusts including mental health, community, acute care and ambulance services. Participants: The study respondents were members of staff in the 14 sites drawn from different levels of their organisations. Interventions: The NETS comprised a complex set of interventions aimed at improving the efficiency and effectiveness of care pathways for staff and patients. Main outcome measures: The ‘receptive contexts for change’ framework was used to evaluate the transformational change process and its outcomes. Data sources: Qualitative parts of the study drew on semistructured interviews, focus groups, observation and documents. Quantitative parts of the study used routinely collected NHS data. Results: Transformational change in a complex system takes time and demands consistency, constancy of purpose and organisational stability. The NETS was seriously disrupted by the NHS changes announced in July 2010. Progress was sustained at four of the study sites, but slowed or ceased at the other sites. Leadership style was found to be critical to the success of transformational change. Conclusions: The NETS was a bold and ambitious initiative which succeeded in bringing about real and lasting change in some parts of the North East. However, it was unable to fully realise its vision and purpose partly because of the widespread reorganisation of the NHS by the new coalition government. Future work: There is a need to develop new methods to understand how change occurs, or fails, in complex settings like the NHS. There is a need for more in-depth studies in those sites that were able to implement and sustain change. This would inform future policy and practice. The results of the quantitative analyses were less conclusive than those obtained by qualitative methods. Further development of mixed-methods approaches would provide additional support for evidence-based decision-making. Funding: The National Institute for Health Research Health Services and Delivery Research programme.https://doi.org/10.3310/hsdr02470netstransformational changenhs north eastleanvirginia mason production systemmixed-methods evaluation |
| spellingShingle | David J Hunter Jonathan Erskine Chris Hicks Tom McGovern Adrian Small Ed Lugsden Paula Whitty Ian Nick Steen Martin Eccles A mixed-methods evaluation of transformational change in NHS North East Health Services and Delivery Research nets transformational change nhs north east lean virginia mason production system mixed-methods evaluation |
| title | A mixed-methods evaluation of transformational change in NHS North East |
| title_full | A mixed-methods evaluation of transformational change in NHS North East |
| title_fullStr | A mixed-methods evaluation of transformational change in NHS North East |
| title_full_unstemmed | A mixed-methods evaluation of transformational change in NHS North East |
| title_short | A mixed-methods evaluation of transformational change in NHS North East |
| title_sort | mixed methods evaluation of transformational change in nhs north east |
| topic | nets transformational change nhs north east lean virginia mason production system mixed-methods evaluation |
| url | https://doi.org/10.3310/hsdr02470 |
| work_keys_str_mv | AT davidjhunter amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT jonathanerskine amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT chrishicks amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT tommcgovern amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT adriansmall amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT edlugsden amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT paulawhitty amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT iannicksteen amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT martineccles amixedmethodsevaluationoftransformationalchangeinnhsnortheast AT davidjhunter mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT jonathanerskine mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT chrishicks mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT tommcgovern mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT adriansmall mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT edlugsden mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT paulawhitty mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT iannicksteen mixedmethodsevaluationoftransformationalchangeinnhsnortheast AT martineccles mixedmethodsevaluationoftransformationalchangeinnhsnortheast |