Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
BackgroundFidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2020-11-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2020.601813/full |
| _version_ | 1819171567907635200 |
|---|---|
| author | Nathalie Georgia Brandt Calum Thomas McHale Gerald Michael Humphris Gerald Michael Humphris |
| author_facet | Nathalie Georgia Brandt Calum Thomas McHale Gerald Michael Humphris Gerald Michael Humphris |
| author_sort | Nathalie Georgia Brandt |
| collection | DOAJ |
| description | BackgroundFidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients’ fear of cancer recurrence, as an example.ObjectivesTo illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability.MethodsThe FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability.ResultsThe qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, rICC = 0.84, 95% CI [0.51, 0.96].ConclusionThe study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended.Clinical Trial Registrationwww.ClinicalTrials.gov, identifier: NCT03763825. |
| first_indexed | 2024-12-22T19:53:21Z |
| format | Article |
| id | doaj.art-49332372f4324ee09304efe6602db5a0 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-22T19:53:21Z |
| publishDate | 2020-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-49332372f4324ee09304efe6602db5a02022-12-21T18:14:30ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-11-011110.3389/fpsyg.2020.601813601813Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc InterventionNathalie Georgia Brandt0Calum Thomas McHale1Gerald Michael Humphris2Gerald Michael Humphris3Division of Population and Behavioural Sciences, School of Medicine, University of St Andrews, St Andrews, United KingdomDivision of Population and Behavioural Sciences, School of Medicine, University of St Andrews, St Andrews, United KingdomDivision of Population and Behavioural Sciences, School of Medicine, University of St Andrews, St Andrews, United KingdomEdinburgh Cancer Centre, Western General Hospital, National Health Service Lothian, Edinburgh, United KingdomBackgroundFidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients’ fear of cancer recurrence, as an example.ObjectivesTo illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability.MethodsThe FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability.ResultsThe qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, rICC = 0.84, 95% CI [0.51, 0.96].ConclusionThe study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended.Clinical Trial Registrationwww.ClinicalTrials.gov, identifier: NCT03763825.https://www.frontiersin.org/articles/10.3389/fpsyg.2020.601813/fullfidelityimplementationMini-AFTERc interventionbreast cancerfear of cancer recurrence |
| spellingShingle | Nathalie Georgia Brandt Calum Thomas McHale Gerald Michael Humphris Gerald Michael Humphris Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention Frontiers in Psychology fidelity implementation Mini-AFTERc intervention breast cancer fear of cancer recurrence |
| title | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
| title_full | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
| title_fullStr | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
| title_full_unstemmed | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
| title_short | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
| title_sort | development and testing of a novel measure to assess fidelity of implementation example of the mini afterc intervention |
| topic | fidelity implementation Mini-AFTERc intervention breast cancer fear of cancer recurrence |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2020.601813/full |
| work_keys_str_mv | AT nathaliegeorgiabrandt developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention AT calumthomasmchale developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention AT geraldmichaelhumphris developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention AT geraldmichaelhumphris developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention |