Developing an implementation fidelity checklist for a vocational rehabilitation intervention
Abstract Background Despite growing numbers of studies reporting the efficacy of complex interventions and their implementation, many studies fail to report information on implementation fidelity or describe how fidelity measures used within the study were developed. This study aimed to develop a fi...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2022-11-01
|
| Series: | Pilot and Feasibility Studies |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40814-022-01194-x |
| _version_ | 1798044530455347200 |
|---|---|
| author | Katie Powers Sara Clarke Julie Phillips Jain A. Holmes Rachel Cripps Kristelle Craven Amanda Farrin Roshan das Nair Kathryn A. Radford |
| author_facet | Katie Powers Sara Clarke Julie Phillips Jain A. Holmes Rachel Cripps Kristelle Craven Amanda Farrin Roshan das Nair Kathryn A. Radford |
| author_sort | Katie Powers |
| collection | DOAJ |
| description | Abstract Background Despite growing numbers of studies reporting the efficacy of complex interventions and their implementation, many studies fail to report information on implementation fidelity or describe how fidelity measures used within the study were developed. This study aimed to develop a fidelity checklist for measuring the implementation fidelity of an early, stroke-specialist vocational rehabilitation intervention (ESSVR) in the RETAKE trial. Methods To develop the fidelity measure, previous checklists were reviewed to inform the assessment structure, and core intervention components were extracted from intervention descriptions into a checklist, which was ratified by eight experts in fidelity measurement and complex interventions. Guidance notes were generated to assist with checklist completion. To test the measure, two researchers independently applied the checklist to fifteen stroke survivor intervention case notes using retrospective observational case review. The scoring was assessed for interrater reliability. Results A fidelity checklist containing 21 core components and 6 desirable components across 4 stages of intervention delivery was developed with corresponding guidance notes. Interrater reliability of each checklist item ranged from moderate to perfect (Cohen’s kappa 0.69–1). Conclusions The resulting checklist to assess implementation fidelity is fit for assessing the delivery of vocational rehabilitation for stroke survivors using retrospective observational case review. The checklist proved its utility as a measure of fidelity and may be used to inform the design of future implementation strategies. Trial registration ISRCTN, ISRCTN12464275. Registered on 13 March 2018. |
| first_indexed | 2024-04-11T23:05:43Z |
| format | Article |
| id | doaj.art-d1d4ffb83fa24115bc3545957129eedd |
| institution | Directory Open Access Journal |
| issn | 2055-5784 |
| language | English |
| last_indexed | 2024-04-11T23:05:43Z |
| publishDate | 2022-11-01 |
| publisher | BMC |
| record_format | Article |
| series | Pilot and Feasibility Studies |
| spelling | doaj.art-d1d4ffb83fa24115bc3545957129eedd2022-12-22T03:58:02ZengBMCPilot and Feasibility Studies2055-57842022-11-018111210.1186/s40814-022-01194-xDeveloping an implementation fidelity checklist for a vocational rehabilitation interventionKatie Powers0Sara Clarke1Julie Phillips2Jain A. Holmes3Rachel Cripps4Kristelle Craven5Amanda Farrin6Roshan das Nair7Kathryn A. Radford8Centre for Rehabilitation and Ageing Research, Queen’s Medical Centre, University of NottinghamCentre for Rehabilitation and Ageing Research, Queen’s Medical Centre, University of NottinghamCentre for Rehabilitation and Ageing Research, Queen’s Medical Centre, University of NottinghamCentre for Rehabilitation and Ageing Research, Queen’s Medical Centre, University of NottinghamSchool of Population Health and Environmental Sciences, King’s College LondonCentre for Rehabilitation and Ageing Research, Queen’s Medical Centre, University of NottinghamClinical Trials Research Unit (CTRU), Leeds Institute of Clinical Trials Research, University of LeedsMental Health & Clinical Neurosciences, University of NottinghamCentre for Rehabilitation and Ageing Research, Queen’s Medical Centre, University of NottinghamAbstract Background Despite growing numbers of studies reporting the efficacy of complex interventions and their implementation, many studies fail to report information on implementation fidelity or describe how fidelity measures used within the study were developed. This study aimed to develop a fidelity checklist for measuring the implementation fidelity of an early, stroke-specialist vocational rehabilitation intervention (ESSVR) in the RETAKE trial. Methods To develop the fidelity measure, previous checklists were reviewed to inform the assessment structure, and core intervention components were extracted from intervention descriptions into a checklist, which was ratified by eight experts in fidelity measurement and complex interventions. Guidance notes were generated to assist with checklist completion. To test the measure, two researchers independently applied the checklist to fifteen stroke survivor intervention case notes using retrospective observational case review. The scoring was assessed for interrater reliability. Results A fidelity checklist containing 21 core components and 6 desirable components across 4 stages of intervention delivery was developed with corresponding guidance notes. Interrater reliability of each checklist item ranged from moderate to perfect (Cohen’s kappa 0.69–1). Conclusions The resulting checklist to assess implementation fidelity is fit for assessing the delivery of vocational rehabilitation for stroke survivors using retrospective observational case review. The checklist proved its utility as a measure of fidelity and may be used to inform the design of future implementation strategies. Trial registration ISRCTN, ISRCTN12464275. Registered on 13 March 2018.https://doi.org/10.1186/s40814-022-01194-xTreatment fidelityMeasurement DevelopmentVocational rehabilitationOccupational therapyComplex interventions |
| spellingShingle | Katie Powers Sara Clarke Julie Phillips Jain A. Holmes Rachel Cripps Kristelle Craven Amanda Farrin Roshan das Nair Kathryn A. Radford Developing an implementation fidelity checklist for a vocational rehabilitation intervention Pilot and Feasibility Studies Treatment fidelity Measurement Development Vocational rehabilitation Occupational therapy Complex interventions |
| title | Developing an implementation fidelity checklist for a vocational rehabilitation intervention |
| title_full | Developing an implementation fidelity checklist for a vocational rehabilitation intervention |
| title_fullStr | Developing an implementation fidelity checklist for a vocational rehabilitation intervention |
| title_full_unstemmed | Developing an implementation fidelity checklist for a vocational rehabilitation intervention |
| title_short | Developing an implementation fidelity checklist for a vocational rehabilitation intervention |
| title_sort | developing an implementation fidelity checklist for a vocational rehabilitation intervention |
| topic | Treatment fidelity Measurement Development Vocational rehabilitation Occupational therapy Complex interventions |
| url | https://doi.org/10.1186/s40814-022-01194-x |
| work_keys_str_mv | AT katiepowers developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT saraclarke developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT juliephillips developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT jainaholmes developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT rachelcripps developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT kristellecraven developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT amandafarrin developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT roshandasnair developinganimplementationfidelitychecklistforavocationalrehabilitationintervention AT kathrynaradford developinganimplementationfidelitychecklistforavocationalrehabilitationintervention |