How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education
Physician-oriented online education could be a pathway to improve care for patients with heart failure, however, it is difficult to measure the impact of such education. Self-efficacy is a potential outcome measure. In this article, we develop a methodology for analyzing an educational intervention...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2024-03-01
|
| Series: | Journal of Medical Education and Curricular Development |
| Online Access: | https://doi.org/10.1177/23821205241232497 |
| _version_ | 1827321751206363136 |
|---|---|
| author | Willem Raat Evelyne Housiaux Miek Smeets Stefan Janssens Birgitte Schoenmakers Bert Vaes |
| author_facet | Willem Raat Evelyne Housiaux Miek Smeets Stefan Janssens Birgitte Schoenmakers Bert Vaes |
| author_sort | Willem Raat |
| collection | DOAJ |
| description | Physician-oriented online education could be a pathway to improve care for patients with heart failure, however, it is difficult to measure the impact of such education. Self-efficacy is a potential outcome measure. In this article, we develop a methodology for analyzing an educational intervention for general practitioners (GPs) using self-efficacy as a concept. This study was partly conducted within the setting of an observational study, IMPACT-B, where we developed online education for GPs. We designed and refined a 24-item questionnaire using item analysis, and exploratory and confirmatory factor analysis. Ninety-one GPs completed the questionnaire before and after the online education. Follow-up data after 6 months was available for 13 GPs. Item analysis revealed a high degree of internal consistency (coefficient alpha 0.95) and validity. Each additional year of experience was associated with an average baseline self-efficacy score of 0.50 points (95% CI [0.21-0.80]), and each additional patient in HF follow-up with an average score of 2.0 points (95% CI [0.48-3.5]). Items that differentiated most between GPs with high and low self-efficacy were the treatment of congestion as well as titrating medication and MRA in heart failure with reduced ejection fraction. Factor analysis reduced the number of questions to 14, mapping to three factors (diagnosis, treatment, and follow-up), and improved the model fit as measured by the goodness-of-fit indicator comparative-fit-index (from 0.83 to 0.91). We demonstrated a method to assess the impact of online education on general practitioners. This led to a questionnaire that was reliable, valid, and convenient to use in an implementation context. |
| first_indexed | 2024-04-25T01:13:40Z |
| format | Article |
| id | doaj.art-7493655281aa44758bed5556da927555 |
| institution | Directory Open Access Journal |
| issn | 2382-1205 |
| language | English |
| last_indexed | 2024-04-25T01:13:40Z |
| publishDate | 2024-03-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | Journal of Medical Education and Curricular Development |
| spelling | doaj.art-7493655281aa44758bed5556da9275552024-03-10T02:03:19ZengSAGE PublishingJournal of Medical Education and Curricular Development2382-12052024-03-011110.1177/23821205241232497How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure EducationWillem Raat0Evelyne Housiaux1Miek Smeets2Stefan Janssens3Birgitte Schoenmakers4Bert Vaes5 Department of Public Health and Primary Care, , Leuven, Belgium Department of Public Health and Primary Care, , Leuven, Belgium Department of Public Health and Primary Care, , Leuven, Belgium Department of Cardiovascular Diseases, University Hospitals Leuven, , Leuven, Belgium Department of Public Health and Primary Care, , Leuven, Belgium Department of Public Health and Primary Care, , Leuven, BelgiumPhysician-oriented online education could be a pathway to improve care for patients with heart failure, however, it is difficult to measure the impact of such education. Self-efficacy is a potential outcome measure. In this article, we develop a methodology for analyzing an educational intervention for general practitioners (GPs) using self-efficacy as a concept. This study was partly conducted within the setting of an observational study, IMPACT-B, where we developed online education for GPs. We designed and refined a 24-item questionnaire using item analysis, and exploratory and confirmatory factor analysis. Ninety-one GPs completed the questionnaire before and after the online education. Follow-up data after 6 months was available for 13 GPs. Item analysis revealed a high degree of internal consistency (coefficient alpha 0.95) and validity. Each additional year of experience was associated with an average baseline self-efficacy score of 0.50 points (95% CI [0.21-0.80]), and each additional patient in HF follow-up with an average score of 2.0 points (95% CI [0.48-3.5]). Items that differentiated most between GPs with high and low self-efficacy were the treatment of congestion as well as titrating medication and MRA in heart failure with reduced ejection fraction. Factor analysis reduced the number of questions to 14, mapping to three factors (diagnosis, treatment, and follow-up), and improved the model fit as measured by the goodness-of-fit indicator comparative-fit-index (from 0.83 to 0.91). We demonstrated a method to assess the impact of online education on general practitioners. This led to a questionnaire that was reliable, valid, and convenient to use in an implementation context.https://doi.org/10.1177/23821205241232497 |
| spellingShingle | Willem Raat Evelyne Housiaux Miek Smeets Stefan Janssens Birgitte Schoenmakers Bert Vaes How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education Journal of Medical Education and Curricular Development |
| title | How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education |
| title_full | How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education |
| title_fullStr | How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education |
| title_full_unstemmed | How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education |
| title_short | How to Evaluate Online Education for General Practitioners: Development of a Tailored Questionnaire for Heart Failure Education |
| title_sort | how to evaluate online education for general practitioners development of a tailored questionnaire for heart failure education |
| url | https://doi.org/10.1177/23821205241232497 |
| work_keys_str_mv | AT willemraat howtoevaluateonlineeducationforgeneralpractitionersdevelopmentofatailoredquestionnaireforheartfailureeducation AT evelynehousiaux howtoevaluateonlineeducationforgeneralpractitionersdevelopmentofatailoredquestionnaireforheartfailureeducation AT mieksmeets howtoevaluateonlineeducationforgeneralpractitionersdevelopmentofatailoredquestionnaireforheartfailureeducation AT stefanjanssens howtoevaluateonlineeducationforgeneralpractitionersdevelopmentofatailoredquestionnaireforheartfailureeducation AT birgitteschoenmakers howtoevaluateonlineeducationforgeneralpractitionersdevelopmentofatailoredquestionnaireforheartfailureeducation AT bertvaes howtoevaluateonlineeducationforgeneralpractitionersdevelopmentofatailoredquestionnaireforheartfailureeducation |