Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study
Abstract Background Billions of dollars are spent annually on grant-funded STEM (science, technology, engineering, and mathematics) education programs. These programs help students stay on track toward STEM careers when standard educational practices do not adequately prepare them for these careers....
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-04-01
|
| Series: | International Journal of STEM Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40594-022-00348-w |
| _version_ | 1811280192903053312 |
|---|---|
| author | Robert J. Ruhf Cody T. Williams Megan Zelinsky Lyssa Wilson Becho |
| author_facet | Robert J. Ruhf Cody T. Williams Megan Zelinsky Lyssa Wilson Becho |
| author_sort | Robert J. Ruhf |
| collection | DOAJ |
| description | Abstract Background Billions of dollars are spent annually on grant-funded STEM (science, technology, engineering, and mathematics) education programs. These programs help students stay on track toward STEM careers when standard educational practices do not adequately prepare them for these careers. It is important to know that reliable and accurate student participation and completion data are being collected about these programs. This multiple case study investigates how student data are collected and reported for a national STEM education program in the United States, the National Science Foundation (NSF) Advanced Technological Education (ATE) program. Our overall aim is to provide insights to funding agencies, STEM education faculty, and others who are interested in addressing issues related to the collection and reporting of student participation and completion data within their own contexts. Emphasis is placed on the barriers encountered in collecting participation and completion data, particularly with regard to unduplicated participation counts and marketable credential data. The ATE program was selected for this study because there is already a mechanism (known as the ATE Survey) in place for annually collecting systematic data across all projects within the program. Results A multiple case study, including interviews of primary investigators, allowed for in-depth analysis of the ATE Survey’s point-in-time data on project-level participation in various activities, and for identification of the following barriers to tracking student-level data: lack of time and help to gather these data, lack of a consistent system for tracking students across different institutions, and a perceived lack of guidance from the funding agency about what data to track. We also saw that different data are needed from different projects to determine a project’s true impact. Defining “success” the same way across all projects is inadequate. Conclusions Although, due to the limited sample size, these findings cannot be generalized to the larger ATE population, they provide specific insights into the various barriers that projects encounter in collecting participation and completion data. |
| first_indexed | 2024-04-13T01:10:06Z |
| format | Article |
| id | doaj.art-8484365dbde94a22b1159cb1caa0259c |
| institution | Directory Open Access Journal |
| issn | 2196-7822 |
| language | English |
| last_indexed | 2024-04-13T01:10:06Z |
| publishDate | 2022-04-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | International Journal of STEM Education |
| spelling | doaj.art-8484365dbde94a22b1159cb1caa0259c2022-12-22T03:09:12ZengSpringerOpenInternational Journal of STEM Education2196-78222022-04-019111210.1186/s40594-022-00348-wBarriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case studyRobert J. Ruhf0Cody T. Williams1Megan Zelinsky2Lyssa Wilson Becho3Science and Mathematics Program Improvement, Western Michigan UniversityScience and Mathematics Program Improvement, Western Michigan UniversityThe Evaluation Center, Western Michigan UniversityThe Evaluation Center, Western Michigan UniversityAbstract Background Billions of dollars are spent annually on grant-funded STEM (science, technology, engineering, and mathematics) education programs. These programs help students stay on track toward STEM careers when standard educational practices do not adequately prepare them for these careers. It is important to know that reliable and accurate student participation and completion data are being collected about these programs. This multiple case study investigates how student data are collected and reported for a national STEM education program in the United States, the National Science Foundation (NSF) Advanced Technological Education (ATE) program. Our overall aim is to provide insights to funding agencies, STEM education faculty, and others who are interested in addressing issues related to the collection and reporting of student participation and completion data within their own contexts. Emphasis is placed on the barriers encountered in collecting participation and completion data, particularly with regard to unduplicated participation counts and marketable credential data. The ATE program was selected for this study because there is already a mechanism (known as the ATE Survey) in place for annually collecting systematic data across all projects within the program. Results A multiple case study, including interviews of primary investigators, allowed for in-depth analysis of the ATE Survey’s point-in-time data on project-level participation in various activities, and for identification of the following barriers to tracking student-level data: lack of time and help to gather these data, lack of a consistent system for tracking students across different institutions, and a perceived lack of guidance from the funding agency about what data to track. We also saw that different data are needed from different projects to determine a project’s true impact. Defining “success” the same way across all projects is inadequate. Conclusions Although, due to the limited sample size, these findings cannot be generalized to the larger ATE population, they provide specific insights into the various barriers that projects encounter in collecting participation and completion data.https://doi.org/10.1186/s40594-022-00348-wSTEM educationSTEM fundingCommunity collegeHigher educationStudent countsMarketable credentials |
| spellingShingle | Robert J. Ruhf Cody T. Williams Megan Zelinsky Lyssa Wilson Becho Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study International Journal of STEM Education STEM education STEM funding Community college Higher education Student counts Marketable credentials |
| title | Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study |
| title_full | Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study |
| title_fullStr | Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study |
| title_full_unstemmed | Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study |
| title_short | Barriers to collecting student participation and completion data for a national STEM education grant program in the United States: a multiple case study |
| title_sort | barriers to collecting student participation and completion data for a national stem education grant program in the united states a multiple case study |
| topic | STEM education STEM funding Community college Higher education Student counts Marketable credentials |
| url | https://doi.org/10.1186/s40594-022-00348-w |
| work_keys_str_mv | AT robertjruhf barrierstocollectingstudentparticipationandcompletiondataforanationalstemeducationgrantprogramintheunitedstatesamultiplecasestudy AT codytwilliams barrierstocollectingstudentparticipationandcompletiondataforanationalstemeducationgrantprogramintheunitedstatesamultiplecasestudy AT meganzelinsky barrierstocollectingstudentparticipationandcompletiondataforanationalstemeducationgrantprogramintheunitedstatesamultiplecasestudy AT lyssawilsonbecho barrierstocollectingstudentparticipationandcompletiondataforanationalstemeducationgrantprogramintheunitedstatesamultiplecasestudy |