Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare
<p>Abstract</p> <p>Background</p> <p>There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale).</p>...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2011-05-01
|
| Series: | BMC Health Services Research |
| Online Access: | http://www.biomedcentral.com/1472-6963/11/107 |
| _version_ | 1818060871495057408 |
|---|---|
| author | Newburn-Cook Christine V Estabrooks Carole A Squires Janet E Gierl Mark |
| author_facet | Newburn-Cook Christine V Estabrooks Carole A Squires Janet E Gierl Mark |
| author_sort | Newburn-Cook Christine V |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale).</p> <p>Methods</p> <p>We used the <it>Standards for Educational and Psychological Testing </it>as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression.</p> <p>Results</p> <p>Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression.</p> <p>Conclusions</p> <p>The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change.</p> |
| first_indexed | 2024-12-10T13:39:18Z |
| format | Article |
| id | doaj.art-dc43348359f74d28acea888c02cb291d |
| institution | Directory Open Access Journal |
| issn | 1472-6963 |
| language | English |
| last_indexed | 2024-12-10T13:39:18Z |
| publishDate | 2011-05-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Health Services Research |
| spelling | doaj.art-dc43348359f74d28acea888c02cb291d2022-12-22T01:46:44ZengBMCBMC Health Services Research1472-69632011-05-0111110710.1186/1472-6963-11-107Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcareNewburn-Cook Christine VEstabrooks Carole ASquires Janet EGierl Mark<p>Abstract</p> <p>Background</p> <p>There is a lack of acceptable, reliable, and valid survey instruments to measure conceptual research utilization (CRU). In this study, we investigated the psychometric properties of a newly developed scale (the CRU Scale).</p> <p>Methods</p> <p>We used the <it>Standards for Educational and Psychological Testing </it>as a validation framework to assess four sources of validity evidence: content, response processes, internal structure, and relations to other variables. A panel of nine international research utilization experts performed a formal content validity assessment. To determine response process validity, we conducted a series of one-on-one scale administration sessions with 10 healthcare aides. Internal structure and relations to other variables validity was examined using CRU Scale response data from a sample of 707 healthcare aides working in 30 urban Canadian nursing homes. Principal components analysis and confirmatory factor analyses were conducted to determine internal structure. Relations to other variables were examined using: (1) bivariate correlations; (2) change in mean values of CRU with increasing levels of other kinds of research utilization; and (3) multivariate linear regression.</p> <p>Results</p> <p>Content validity index scores for the five items ranged from 0.55 to 1.00. The principal components analysis predicted a 5-item 1-factor model. This was inconsistent with the findings from the confirmatory factor analysis, which showed best fit for a 4-item 1-factor model. Bivariate associations between CRU and other kinds of research utilization were statistically significant (p < 0.01) for the latent CRU scale score and all five CRU items. The CRU scale score was also shown to be significant predictor of overall research utilization in multivariate linear regression.</p> <p>Conclusions</p> <p>The CRU scale showed acceptable initial psychometric properties with respect to responses from healthcare aides in nursing homes. Based on our validity, reliability, and acceptability analyses, we recommend using a reduced (four-item) version of the CRU scale to yield sound assessments of CRU by healthcare aides. Refinement to the wording of one item is also needed. Planned future research will include: latent scale scoring, identification of variables that predict and are outcomes to conceptual research use, and longitudinal work to determine CRU Scale sensitivity to change.</p>http://www.biomedcentral.com/1472-6963/11/107 |
| spellingShingle | Newburn-Cook Christine V Estabrooks Carole A Squires Janet E Gierl Mark Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare BMC Health Services Research |
| title | Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare |
| title_full | Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare |
| title_fullStr | Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare |
| title_full_unstemmed | Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare |
| title_short | Validation of the conceptual research utilization scale: an application of the standards for educational and psychological testing in healthcare |
| title_sort | validation of the conceptual research utilization scale an application of the standards for educational and psychological testing in healthcare |
| url | http://www.biomedcentral.com/1472-6963/11/107 |
| work_keys_str_mv | AT newburncookchristinev validationoftheconceptualresearchutilizationscaleanapplicationofthestandardsforeducationalandpsychologicaltestinginhealthcare AT estabrookscarolea validationoftheconceptualresearchutilizationscaleanapplicationofthestandardsforeducationalandpsychologicaltestinginhealthcare AT squiresjanete validationoftheconceptualresearchutilizationscaleanapplicationofthestandardsforeducationalandpsychologicaltestinginhealthcare AT gierlmark validationoftheconceptualresearchutilizationscaleanapplicationofthestandardsforeducationalandpsychologicaltestinginhealthcare |