Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure

BackgroundTo promote and ensure coaches' fidelity in delivering an online health coaching program to parents of children with suspected developmental delay, we developed and implemented a novel coaching fidelity rating tool, CO-FIDEL (COaches Fidelity in Intervention DELivery). We aimed to (1)...

Full description

Bibliographic Details
Main Authors: Tatiana Ogourtsova, Annette Majnemer, Amelie Brown, Helen Jillian Filliter, Kristy Wittmeier, Jessica Hanson, Maureen O’Donnell
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-02-01
Series:Frontiers in Rehabilitation Sciences
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fresc.2023.1057641/full
_version_ 1797901812572880896
author Tatiana Ogourtsova
Tatiana Ogourtsova
Tatiana Ogourtsova
Annette Majnemer
Annette Majnemer
Annette Majnemer
Amelie Brown
Helen Jillian Filliter
Helen Jillian Filliter
Kristy Wittmeier
Kristy Wittmeier
Kristy Wittmeier
Jessica Hanson
Jessica Hanson
Jessica Hanson
Maureen O’Donnell
Maureen O’Donnell
author_facet Tatiana Ogourtsova
Tatiana Ogourtsova
Tatiana Ogourtsova
Annette Majnemer
Annette Majnemer
Annette Majnemer
Amelie Brown
Helen Jillian Filliter
Helen Jillian Filliter
Kristy Wittmeier
Kristy Wittmeier
Kristy Wittmeier
Jessica Hanson
Jessica Hanson
Jessica Hanson
Maureen O’Donnell
Maureen O’Donnell
author_sort Tatiana Ogourtsova
collection DOAJ
description BackgroundTo promote and ensure coaches' fidelity in delivering an online health coaching program to parents of children with suspected developmental delay, we developed and implemented a novel coaching fidelity rating tool, CO-FIDEL (COaches Fidelity in Intervention DELivery). We aimed to (1) Demonstrate CO-FIDEL's feasibility in evaluating coaches' fidelity and its change over time; and (2) Explore coaches' satisfaction with and usefulness of the tool.MethodsIn an observational study design, coaches (n = 4) were assessed using the CO-FIDEL following each coaching session (n = 13–14 sessions/parent-participant) during the pilot phase of a large randomized clinical trial involving eleven (n = 11) parent-participants. Outcome measures included subsections' fidelity measures, overall coaching fidelity, and coaching fidelity changes over time analyzed using descriptive and non-parametric statistics. In addition, using a four-point Likert Scale and open-ended questions, coaches were surveyed on their satisfaction and preference levels, as well as facilitators, barriers, and impacts related to the use of CO-FIDEL. These were analyzed using descriptive statistics and content analysis.ResultsOne hundred and thirty-nine (n = 139) coaching sessions were evaluated with the CO-FIDEL. On average, overall fidelity was high (88.0 ± 6.3 to 99.5 ± 0.8%). Four coaching sessions were needed to achieve and maintain a ≥ 85.0% fidelity in all four sections of the tool. Two coaches showed significant improvements in their coaching skills over time in some of the CO-FIDEL sections (Coach B/Section 1/between parent-participant B1 and B3: 89.9 ± 4.6 vs. 98.5 ± 2.6, Z = −2.74, p = 0.00596; Coach C/Section 4/between parent-participant C1 and C2: 82.4 ± 7.5 vs. 89.1 ± 4.1, Z = −2.66; p = 0.00758), and in overall fidelity (Coach C, between parent-participant C1 and C2: 88.67 ± 6.32 vs. 94.53 ± 1.23, Z = −2.66; p = 0. 00758). Coaches mainly reported moderate-high satisfaction with and usefulness of the tool, and pointed out areas of improvement (e.g., ceiling effect, missing elements).ConclusionsA new tool ascertaining coaches' fidelity was developed, applied, and shown to be feasible. Future research should address the identified challenges and examine the psychometric properties of the CO-FIDEL.
first_indexed 2024-04-10T09:07:51Z
format Article
id doaj.art-919f5dfcb00e4a01835194cdf9ccf5f6
institution Directory Open Access Journal
issn 2673-6861
language English
last_indexed 2024-04-10T09:07:51Z
publishDate 2023-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Rehabilitation Sciences
spelling doaj.art-919f5dfcb00e4a01835194cdf9ccf5f62023-02-21T05:49:34ZengFrontiers Media S.A.Frontiers in Rehabilitation Sciences2673-68612023-02-01410.3389/fresc.2023.10576411057641Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measureTatiana Ogourtsova0Tatiana Ogourtsova1Tatiana Ogourtsova2Annette Majnemer3Annette Majnemer4Annette Majnemer5Amelie Brown6Helen Jillian Filliter7Helen Jillian Filliter8Kristy Wittmeier9Kristy Wittmeier10Kristy Wittmeier11Jessica Hanson12Jessica Hanson13Jessica Hanson14Maureen O’Donnell15Maureen O’Donnell16Jewish Rehabilitation Hospital, Laval, QC, CanadaFaculty of Medicine, School of Physical and Occupational Therapy, McGill University, Montreal, QC, CanadaCentre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, QC, CanadaFaculty of Medicine, School of Physical and Occupational Therapy, McGill University, Montreal, QC, CanadaCentre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, QC, CanadaMontreal Children’s Hospital, Research Institute of the McGill University Health Centre, Montreal, QC, CanadaMontreal Children’s Hospital, Research Institute of the McGill University Health Centre, Montreal, QC, CanadaDepartment of Pediatrics, Dalhousie University, Halifax, NS, CanadaAutism Team, IWK Health Centre, Halifax, NS, CanadaRehabilitation Centre for Children, Winnipeg, MB, CanadaDepartment of Pediatrics and Child Health Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB, CanadaChildren’s Hospital Research Institute of Manitoba, Winnipeg, MB, CanadaJewish Rehabilitation Hospital, Laval, QC, CanadaFaculty of Medicine, School of Physical and Occupational Therapy, McGill University, Montreal, QC, CanadaCentre for Interdisciplinary Research in Rehabilitation of Greater Montreal (CRIR), Montreal, QC, Canada0Provincial Health Services Authority BC, Vancouver, BC, Canada1Faculty of Medicine, Department of Pediatrics, University of British Columbia, Vancouver, BC, CanadaBackgroundTo promote and ensure coaches' fidelity in delivering an online health coaching program to parents of children with suspected developmental delay, we developed and implemented a novel coaching fidelity rating tool, CO-FIDEL (COaches Fidelity in Intervention DELivery). We aimed to (1) Demonstrate CO-FIDEL's feasibility in evaluating coaches' fidelity and its change over time; and (2) Explore coaches' satisfaction with and usefulness of the tool.MethodsIn an observational study design, coaches (n = 4) were assessed using the CO-FIDEL following each coaching session (n = 13–14 sessions/parent-participant) during the pilot phase of a large randomized clinical trial involving eleven (n = 11) parent-participants. Outcome measures included subsections' fidelity measures, overall coaching fidelity, and coaching fidelity changes over time analyzed using descriptive and non-parametric statistics. In addition, using a four-point Likert Scale and open-ended questions, coaches were surveyed on their satisfaction and preference levels, as well as facilitators, barriers, and impacts related to the use of CO-FIDEL. These were analyzed using descriptive statistics and content analysis.ResultsOne hundred and thirty-nine (n = 139) coaching sessions were evaluated with the CO-FIDEL. On average, overall fidelity was high (88.0 ± 6.3 to 99.5 ± 0.8%). Four coaching sessions were needed to achieve and maintain a ≥ 85.0% fidelity in all four sections of the tool. Two coaches showed significant improvements in their coaching skills over time in some of the CO-FIDEL sections (Coach B/Section 1/between parent-participant B1 and B3: 89.9 ± 4.6 vs. 98.5 ± 2.6, Z = −2.74, p = 0.00596; Coach C/Section 4/between parent-participant C1 and C2: 82.4 ± 7.5 vs. 89.1 ± 4.1, Z = −2.66; p = 0.00758), and in overall fidelity (Coach C, between parent-participant C1 and C2: 88.67 ± 6.32 vs. 94.53 ± 1.23, Z = −2.66; p = 0. 00758). Coaches mainly reported moderate-high satisfaction with and usefulness of the tool, and pointed out areas of improvement (e.g., ceiling effect, missing elements).ConclusionsA new tool ascertaining coaches' fidelity was developed, applied, and shown to be feasible. Future research should address the identified challenges and examine the psychometric properties of the CO-FIDEL.https://www.frontiersin.org/articles/10.3389/fresc.2023.1057641/fullcoachingchildhood disabilitycoaching fidelitydevelopmental disabilityhealth coaching
spellingShingle Tatiana Ogourtsova
Tatiana Ogourtsova
Tatiana Ogourtsova
Annette Majnemer
Annette Majnemer
Annette Majnemer
Amelie Brown
Helen Jillian Filliter
Helen Jillian Filliter
Kristy Wittmeier
Kristy Wittmeier
Kristy Wittmeier
Jessica Hanson
Jessica Hanson
Jessica Hanson
Maureen O’Donnell
Maureen O’Donnell
Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure
Frontiers in Rehabilitation Sciences
coaching
childhood disability
coaching fidelity
developmental disability
health coaching
title Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure
title_full Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure
title_fullStr Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure
title_full_unstemmed Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure
title_short Pediatric tele-coaching fidelity evaluation: Feasibility, perceived satisfaction and usefulness of a new measure
title_sort pediatric tele coaching fidelity evaluation feasibility perceived satisfaction and usefulness of a new measure
topic coaching
childhood disability
coaching fidelity
developmental disability
health coaching
url https://www.frontiersin.org/articles/10.3389/fresc.2023.1057641/full
work_keys_str_mv AT tatianaogourtsova pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT tatianaogourtsova pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT tatianaogourtsova pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT annettemajnemer pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT annettemajnemer pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT annettemajnemer pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT ameliebrown pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT helenjillianfilliter pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT helenjillianfilliter pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT kristywittmeier pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT kristywittmeier pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT kristywittmeier pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT jessicahanson pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT jessicahanson pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT jessicahanson pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT maureenodonnell pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure
AT maureenodonnell pediatrictelecoachingfidelityevaluationfeasibilityperceivedsatisfactionandusefulnessofanewmeasure