Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions
Abstract Background Intervention fidelity is the degree to which interventions have been implemented as intended by their developers. Assessing fidelity is crucial for accurate interpretation of intervention effectiveness, but fidelity is often poorly addressed within trials of complex healthcare in...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2018-09-01
|
| Series: | Trials |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s13063-018-2838-6 |
| _version_ | 1819026978544549888 |
|---|---|
| author | Daragh McGee Fabiana Lorencatto Karen Matvienko-Sikar Elaine Toomey |
| author_facet | Daragh McGee Fabiana Lorencatto Karen Matvienko-Sikar Elaine Toomey |
| author_sort | Daragh McGee |
| collection | DOAJ |
| description | Abstract Background Intervention fidelity is the degree to which interventions have been implemented as intended by their developers. Assessing fidelity is crucial for accurate interpretation of intervention effectiveness, but fidelity is often poorly addressed within trials of complex healthcare interventions. The reasons for this are unclear, and information on the use of methods to enhance and assess fidelity in trials of complex interventions remains insufficient. This study aimed to explore the knowledge, practice and attitudes towards intervention fidelity amongst researchers, triallists and healthcare professionals involved with the design and conduct of trials of complex healthcare interventions. Methods An online survey consisting of closed and open-ended questions exploring four sections (Demographics, Fidelity knowledge, Practice and Attitudes) was conducted. This was an opportunistic sample of individuals with experience of direct involvement in trials of complex healthcare interventions (e.g. design/development, conduct, evaluation). Results Data from 264 participants representing 15 countries were analysed. The majority (65.9%, n = 174) of participants identified themselves as ‘Researchers’. The majority of participants were familiar with the term “intervention fidelity” (69.7%, n = 184) and indicated that fidelity is important (89.7%, n = 236). Mean self-reported understanding of fidelity was moderate. Although 68% (n = 182) had previously used strategies to assess (e.g. audio/video-recording sessions) and enhance (e.g. training manual) fidelity in trials of complex interventions, only a limited proportion of participants indicated always reporting these strategies in subsequent publications (30.9%, n = 56). Poor knowledge or understanding was the most commonly cited barrier to addressing intervention fidelity in trials (77.4%, n = 202). Over half of respondents (52.1%, n = 137) had never completed specific fidelity training or research, and the vast majority (89.7%, n = 236) would welcome specific training in this area. Conclusion Despite good awareness of intervention fidelity and its importance, poor knowledge and understanding appears to be a key factor limiting how intervention fidelity is addressed in trials of complex interventions. Participants identified a need for further training and education in this area. Additionally, clarification of the terminology, definition and components of intervention fidelity would facilitate better understanding of the concept. A discrepancy between participants’ use of fidelity strategies and subsequent reporting raises concerns around inadequate fidelity reporting in the trials literature. |
| first_indexed | 2024-12-21T05:35:10Z |
| format | Article |
| id | doaj.art-b1c9b19a96c746b9a5d9cb88a0ea5710 |
| institution | Directory Open Access Journal |
| issn | 1745-6215 |
| language | English |
| last_indexed | 2024-12-21T05:35:10Z |
| publishDate | 2018-09-01 |
| publisher | BMC |
| record_format | Article |
| series | Trials |
| spelling | doaj.art-b1c9b19a96c746b9a5d9cb88a0ea57102022-12-21T19:14:26ZengBMCTrials1745-62152018-09-0119111410.1186/s13063-018-2838-6Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventionsDaragh McGee0Fabiana Lorencatto1Karen Matvienko-Sikar2Elaine Toomey3School of Medicine, Clinical Science Institute, National University of Ireland GalwayCentre for Behaviour Change, University College LondonSchool of Public Health, Western Gateway Building, University College CorkHealth Behaviour Change Research Group, Room 2058, School of Psychology, Arts Millennium Building, National University of Ireland GalwayAbstract Background Intervention fidelity is the degree to which interventions have been implemented as intended by their developers. Assessing fidelity is crucial for accurate interpretation of intervention effectiveness, but fidelity is often poorly addressed within trials of complex healthcare interventions. The reasons for this are unclear, and information on the use of methods to enhance and assess fidelity in trials of complex interventions remains insufficient. This study aimed to explore the knowledge, practice and attitudes towards intervention fidelity amongst researchers, triallists and healthcare professionals involved with the design and conduct of trials of complex healthcare interventions. Methods An online survey consisting of closed and open-ended questions exploring four sections (Demographics, Fidelity knowledge, Practice and Attitudes) was conducted. This was an opportunistic sample of individuals with experience of direct involvement in trials of complex healthcare interventions (e.g. design/development, conduct, evaluation). Results Data from 264 participants representing 15 countries were analysed. The majority (65.9%, n = 174) of participants identified themselves as ‘Researchers’. The majority of participants were familiar with the term “intervention fidelity” (69.7%, n = 184) and indicated that fidelity is important (89.7%, n = 236). Mean self-reported understanding of fidelity was moderate. Although 68% (n = 182) had previously used strategies to assess (e.g. audio/video-recording sessions) and enhance (e.g. training manual) fidelity in trials of complex interventions, only a limited proportion of participants indicated always reporting these strategies in subsequent publications (30.9%, n = 56). Poor knowledge or understanding was the most commonly cited barrier to addressing intervention fidelity in trials (77.4%, n = 202). Over half of respondents (52.1%, n = 137) had never completed specific fidelity training or research, and the vast majority (89.7%, n = 236) would welcome specific training in this area. Conclusion Despite good awareness of intervention fidelity and its importance, poor knowledge and understanding appears to be a key factor limiting how intervention fidelity is addressed in trials of complex interventions. Participants identified a need for further training and education in this area. Additionally, clarification of the terminology, definition and components of intervention fidelity would facilitate better understanding of the concept. A discrepancy between participants’ use of fidelity strategies and subsequent reporting raises concerns around inadequate fidelity reporting in the trials literature.http://link.springer.com/article/10.1186/s13063-018-2838-6Intervention fidelityComplex interventionsRandomised control trialsResearch methodsSurvey |
| spellingShingle | Daragh McGee Fabiana Lorencatto Karen Matvienko-Sikar Elaine Toomey Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions Trials Intervention fidelity Complex interventions Randomised control trials Research methods Survey |
| title | Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions |
| title_full | Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions |
| title_fullStr | Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions |
| title_full_unstemmed | Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions |
| title_short | Surveying knowledge, practice and attitudes towards intervention fidelity within trials of complex healthcare interventions |
| title_sort | surveying knowledge practice and attitudes towards intervention fidelity within trials of complex healthcare interventions |
| topic | Intervention fidelity Complex interventions Randomised control trials Research methods Survey |
| url | http://link.springer.com/article/10.1186/s13063-018-2838-6 |
| work_keys_str_mv | AT daraghmcgee surveyingknowledgepracticeandattitudestowardsinterventionfidelitywithintrialsofcomplexhealthcareinterventions AT fabianalorencatto surveyingknowledgepracticeandattitudestowardsinterventionfidelitywithintrialsofcomplexhealthcareinterventions AT karenmatvienkosikar surveyingknowledgepracticeandattitudestowardsinterventionfidelitywithintrialsofcomplexhealthcareinterventions AT elainetoomey surveyingknowledgepracticeandattitudestowardsinterventionfidelitywithintrialsofcomplexhealthcareinterventions |