Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration
Programs utilizing research-tested evaluation tools can help identify effective educational strategies and document program effectiveness and impact. Using the case of the UF/IFAS Extension Family Nutrition Program (FNP), this article illustrates steps for conducting a rigorous assessment of the mea...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Mississippi State University
2020-06-01
|
| Series: | Journal of Human Sciences and Extension |
| Subjects: | |
| Online Access: | https://scholarsjunction.msstate.edu/jhse/vol8/iss2/9/ |
| _version_ | 1811308264767356928 |
|---|---|
| author | Glenn D. Israel Halil I. Sari Nicole Owens Duffy Sebastian Galindo-Gonzalez David C. Diehl Saul J. Abarca Orozco Elder Garcia Varela Laura Sweeney |
| author_facet | Glenn D. Israel Halil I. Sari Nicole Owens Duffy Sebastian Galindo-Gonzalez David C. Diehl Saul J. Abarca Orozco Elder Garcia Varela Laura Sweeney |
| author_sort | Glenn D. Israel |
| collection | DOAJ |
| description | Programs utilizing research-tested evaluation tools can help identify effective educational strategies and document program effectiveness and impact. Using the case of the UF/IFAS Extension Family Nutrition Program (FNP), this article illustrates steps for conducting a rigorous assessment of the measurement properties of evaluation instruments. The Youth Behavior Survey (YBS) was originally developed to measure students’ nutrition and physical activity behaviors before and after an educational intervention. In order to report FNP behavior change data under indicators for the national evaluation framework, the evaluation instrument was revised. The revision included modifying item wording to reflect national indicators and changing response options. The psychometric characteristics of the revised instrument were assessed in comparison to those of the original instrument. The main objective was to examine aspects of content and construct validity for the scores produced by the instruments. The assessment included content validity of the instrument, item discrimination, consistency of relationships in item response patterns, and change between pre-test and post-test scores. We concluded that the scores produced by the revised instrument were modestly more accurate than the original. This research suggests procedures that can be applied widely to evaluating instruments for other educational interventions. |
| first_indexed | 2024-04-13T09:19:55Z |
| format | Article |
| id | doaj.art-77ea23655e3541f68c2ab277f26154ef |
| institution | Directory Open Access Journal |
| issn | 2325-5226 |
| language | English |
| last_indexed | 2024-04-13T09:19:55Z |
| publishDate | 2020-06-01 |
| publisher | Mississippi State University |
| record_format | Article |
| series | Journal of Human Sciences and Extension |
| spelling | doaj.art-77ea23655e3541f68c2ab277f26154ef2022-12-22T02:52:38ZengMississippi State UniversityJournal of Human Sciences and Extension2325-52262020-06-0182121https://doi.org/10.54718/SJGB4387Procedures for Improving Self-report Measurements to Capture Behavior Change: An IllustrationGlenn D. Israel0Halil I. Sari1Nicole Owens Duffy2Sebastian Galindo-Gonzalez3David C. Diehl4Saul J. Abarca Orozco5Elder Garcia Varela6Laura Sweeney7University of FloridaKilis 7 Aralık ÜniversitesiUniversity of FloridaUniversity of FloridaUniversity of FloridaUniversidad Cristobal ColonUniversity of FloridaUniversity of Florida Programs utilizing research-tested evaluation tools can help identify effective educational strategies and document program effectiveness and impact. Using the case of the UF/IFAS Extension Family Nutrition Program (FNP), this article illustrates steps for conducting a rigorous assessment of the measurement properties of evaluation instruments. The Youth Behavior Survey (YBS) was originally developed to measure students’ nutrition and physical activity behaviors before and after an educational intervention. In order to report FNP behavior change data under indicators for the national evaluation framework, the evaluation instrument was revised. The revision included modifying item wording to reflect national indicators and changing response options. The psychometric characteristics of the revised instrument were assessed in comparison to those of the original instrument. The main objective was to examine aspects of content and construct validity for the scores produced by the instruments. The assessment included content validity of the instrument, item discrimination, consistency of relationships in item response patterns, and change between pre-test and post-test scores. We concluded that the scores produced by the revised instrument were modestly more accurate than the original. This research suggests procedures that can be applied widely to evaluating instruments for other educational interventions.https://scholarsjunction.msstate.edu/jhse/vol8/iss2/9/measurementreliabilityvaliditybehavior changenutritionphysical activityhealthy lifestyle constructyoung children |
| spellingShingle | Glenn D. Israel Halil I. Sari Nicole Owens Duffy Sebastian Galindo-Gonzalez David C. Diehl Saul J. Abarca Orozco Elder Garcia Varela Laura Sweeney Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration Journal of Human Sciences and Extension measurement reliability validity behavior change nutrition physical activity healthy lifestyle construct young children |
| title | Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration |
| title_full | Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration |
| title_fullStr | Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration |
| title_full_unstemmed | Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration |
| title_short | Procedures for Improving Self-report Measurements to Capture Behavior Change: An Illustration |
| title_sort | procedures for improving self report measurements to capture behavior change an illustration |
| topic | measurement reliability validity behavior change nutrition physical activity healthy lifestyle construct young children |
| url | https://scholarsjunction.msstate.edu/jhse/vol8/iss2/9/ |
| work_keys_str_mv | AT glenndisrael proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT halilisari proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT nicoleowensduffy proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT sebastiangalindogonzalez proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT davidcdiehl proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT sauljabarcaorozco proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT eldergarciavarela proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration AT laurasweeney proceduresforimprovingselfreportmeasurementstocapturebehaviorchangeanillustration |