The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children
<p><strong>Background:</strong> The Parenting for Lifelong Health for Young Children (PLH-YC) programme aims to reduce violence against children and child behaviour problems among families in low- and middle-income countries (LMICs). Although the programme has been tested...
| Hoofdauteurs: | , , , , |
|---|---|
| Formaat: | Journal article |
| Taal: | English |
| Gepubliceerd in: |
Wiley
2022
|
| _version_ | 1826311564058165248 |
|---|---|
| author | Martin, M Lachman, JM Murphy, H Gardner, F Foran, H |
| author_facet | Martin, M Lachman, JM Murphy, H Gardner, F Foran, H |
| author_sort | Martin, M |
| collection | OXFORD |
| description | <p><strong>Background:</strong> The Parenting for Lifelong Health for Young Children (PLH-YC) programme aims to reduce violence against children and child behaviour problems among families in low- and middle-income countries (LMICs). Although the programme has been tested in four randomised controlled trials and delivered in over 25 countries, there are gaps in understanding regarding the programme's implementation fidelity and, more generally, concerning the implementation fidelity of parenting programmes in LMICs.</p>
<p><strong>Aims:</strong> This study aims to address these gaps by examining the psychometric properties of the PLH-YC-Facilitator Assessment Tool (FAT)—an observational tool used to measure the competent adherence of PLH-YC facilitators. Examining the psychometric properties of the FAT is important in order to determine whether there is an association between facilitator competent adherence and programme outcomes and, if correlated, to improve facilitator performance. It is also important to develop the implementation literature among parenting interventions in LMICs.</p>
<p><strong>Methods:</strong> The study examined the content validity, intra-rater reliability, and inter-rater reliability of the FAT. Revision of the tool was based on consultation with programme trainers, experts, and assessors. A training curriculum and assessment manual was created. Assessors were trained in Southeastern Europe and their assessments of facilitator delivery were analysed as part of a large-scale factorial experiment (<em>N</em> = 79 facilitators).</p>
<p><strong>Results:</strong> The content validity process with PLH-YC trainers, experts, and assessors resulted in substantial improvements to the tool. Analyses of percentage agreements and intraclass correlations found that, even with practical challenges, assessments were completed with adequate yet not strong intra- and inter-rater reliability.</p>
<p><strong>Conclusions:</strong> This study contributes to the literature on the implementation of parenting programmes in LMICs. The study found that the FAT appears to capture its intended constructs and can be used with an acceptable degree of consistency. Further research on the tool's reliability and validity—specifically, its internal consistency, construct validity, and predictive validity—is recommended.</p> |
| first_indexed | 2024-03-07T08:11:38Z |
| format | Journal article |
| id | oxford-uuid:cab9674c-450c-41a2-b2e9-2cbc70bf16ab |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T08:11:38Z |
| publishDate | 2022 |
| publisher | Wiley |
| record_format | dspace |
| spelling | oxford-uuid:cab9674c-450c-41a2-b2e9-2cbc70bf16ab2023-12-01T06:15:11ZThe development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young childrenJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:cab9674c-450c-41a2-b2e9-2cbc70bf16abEnglishSymplectic ElementsWiley2022Martin, MLachman, JMMurphy, HGardner, FForan, H<p><strong>Background:</strong> The Parenting for Lifelong Health for Young Children (PLH-YC) programme aims to reduce violence against children and child behaviour problems among families in low- and middle-income countries (LMICs). Although the programme has been tested in four randomised controlled trials and delivered in over 25 countries, there are gaps in understanding regarding the programme's implementation fidelity and, more generally, concerning the implementation fidelity of parenting programmes in LMICs.</p> <p><strong>Aims:</strong> This study aims to address these gaps by examining the psychometric properties of the PLH-YC-Facilitator Assessment Tool (FAT)—an observational tool used to measure the competent adherence of PLH-YC facilitators. Examining the psychometric properties of the FAT is important in order to determine whether there is an association between facilitator competent adherence and programme outcomes and, if correlated, to improve facilitator performance. It is also important to develop the implementation literature among parenting interventions in LMICs.</p> <p><strong>Methods:</strong> The study examined the content validity, intra-rater reliability, and inter-rater reliability of the FAT. Revision of the tool was based on consultation with programme trainers, experts, and assessors. A training curriculum and assessment manual was created. Assessors were trained in Southeastern Europe and their assessments of facilitator delivery were analysed as part of a large-scale factorial experiment (<em>N</em> = 79 facilitators).</p> <p><strong>Results:</strong> The content validity process with PLH-YC trainers, experts, and assessors resulted in substantial improvements to the tool. Analyses of percentage agreements and intraclass correlations found that, even with practical challenges, assessments were completed with adequate yet not strong intra- and inter-rater reliability.</p> <p><strong>Conclusions:</strong> This study contributes to the literature on the implementation of parenting programmes in LMICs. The study found that the FAT appears to capture its intended constructs and can be used with an acceptable degree of consistency. Further research on the tool's reliability and validity—specifically, its internal consistency, construct validity, and predictive validity—is recommended.</p> |
| spellingShingle | Martin, M Lachman, JM Murphy, H Gardner, F Foran, H The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children |
| title | The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children |
| title_full | The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children |
| title_fullStr | The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children |
| title_full_unstemmed | The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children |
| title_short | The development, reliability, and validity of the facilitator assessment tool: an implementation fidelity measure used in parenting for lifelong health for young children |
| title_sort | development reliability and validity of the facilitator assessment tool an implementation fidelity measure used in parenting for lifelong health for young children |
| work_keys_str_mv | AT martinm thedevelopmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT lachmanjm thedevelopmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT murphyh thedevelopmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT gardnerf thedevelopmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT foranh thedevelopmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT martinm developmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT lachmanjm developmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT murphyh developmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT gardnerf developmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren AT foranh developmentreliabilityandvalidityofthefacilitatorassessmenttoolanimplementationfidelitymeasureusedinparentingforlifelonghealthforyoungchildren |