The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review
Training and development programs are increasingly delivered online with numerous studies reporting no differences in learning outcomes between online and traditional learning. However, there are no established standardized methods to evaluate the effectiveness of online learning. This review aims...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Online Learning Consortium
2022-12-01
|
| Series: | Online Learning |
| Subjects: | |
| Online Access: | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/3115 |
| _version_ | 1827360151682678784 |
|---|---|
| author | Jason D Stemp Debannita Ghosh Urooj R Khan James H Boyd |
| author_facet | Jason D Stemp Debannita Ghosh Urooj R Khan James H Boyd |
| author_sort | Jason D Stemp |
| collection | DOAJ |
| description |
Training and development programs are increasingly delivered online with numerous studies reporting no differences in learning outcomes between online and traditional learning. However, there are no established standardized methods to evaluate the effectiveness of online learning. This review aims to map the state of research around health-related education to determine what e-learning evaluation methods are being used, the strengths or deficiencies of these methods, and which are appropriate for measuring the effectiveness of online education. Databases searched were PubMed, ProQuest, Education Resources Information Centre, Cumulative Index to Nursing and Allied Health Literature, Scopus, PsychInfo, and Medline. Studies were included if they were published between 2011 and 2021, reported health-related online education and included an evaluation component. Thirty studies were obtained from numerous countries with varied methodologies and designs. Participants ranged from undergraduate students to medical professionals. Evaluation methods included student participation, students’ reaction to the training program, self-efficacy, knowledge assessment, long-term performance, and the Kirkpatrick Evaluation Framework. The review identified that course evaluations, such as measuring student satisfaction scores alone, are insufficient when used to quantify learning effectiveness for online education. This was particularly important as studies are reporting these single metrics as positive effects of training interventions without justification. Suggestions within the reviewed papers were to adopt and implement an appropriate validated method within the course curriculum to evaluate learning outcomes.
|
| first_indexed | 2024-03-08T06:42:45Z |
| format | Article |
| id | doaj.art-ecc03a446e2a4d7ead62a7015407ae81 |
| institution | Directory Open Access Journal |
| issn | 2472-5749 2472-5730 |
| language | English |
| last_indexed | 2024-03-08T06:42:45Z |
| publishDate | 2022-12-01 |
| publisher | Online Learning Consortium |
| record_format | Article |
| series | Online Learning |
| spelling | doaj.art-ecc03a446e2a4d7ead62a7015407ae812024-02-03T08:36:24ZengOnline Learning ConsortiumOnline Learning2472-57492472-57302022-12-0126410.24059/olj.v26i4.3115The Role of Evaluation Methods in Health-Related E-learning: A Rapid ReviewJason D Stemp0Debannita Ghosh1Urooj R Khan2James H Boyd3La Trobe UniversityAustralian Catholic UniversityLa Trobe UniversityLa Trobe University Training and development programs are increasingly delivered online with numerous studies reporting no differences in learning outcomes between online and traditional learning. However, there are no established standardized methods to evaluate the effectiveness of online learning. This review aims to map the state of research around health-related education to determine what e-learning evaluation methods are being used, the strengths or deficiencies of these methods, and which are appropriate for measuring the effectiveness of online education. Databases searched were PubMed, ProQuest, Education Resources Information Centre, Cumulative Index to Nursing and Allied Health Literature, Scopus, PsychInfo, and Medline. Studies were included if they were published between 2011 and 2021, reported health-related online education and included an evaluation component. Thirty studies were obtained from numerous countries with varied methodologies and designs. Participants ranged from undergraduate students to medical professionals. Evaluation methods included student participation, students’ reaction to the training program, self-efficacy, knowledge assessment, long-term performance, and the Kirkpatrick Evaluation Framework. The review identified that course evaluations, such as measuring student satisfaction scores alone, are insufficient when used to quantify learning effectiveness for online education. This was particularly important as studies are reporting these single metrics as positive effects of training interventions without justification. Suggestions within the reviewed papers were to adopt and implement an appropriate validated method within the course curriculum to evaluate learning outcomes. https://olj.onlinelearningconsortium.org/index.php/olj/article/view/3115Assessment toolsevaluation methodlearning impact measureoutcome measuree-learningonline education |
| spellingShingle | Jason D Stemp Debannita Ghosh Urooj R Khan James H Boyd The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review Online Learning Assessment tools evaluation method learning impact measure outcome measure e-learning online education |
| title | The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review |
| title_full | The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review |
| title_fullStr | The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review |
| title_full_unstemmed | The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review |
| title_short | The Role of Evaluation Methods in Health-Related E-learning: A Rapid Review |
| title_sort | role of evaluation methods in health related e learning a rapid review |
| topic | Assessment tools evaluation method learning impact measure outcome measure e-learning online education |
| url | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/3115 |
| work_keys_str_mv | AT jasondstemp theroleofevaluationmethodsinhealthrelatedelearningarapidreview AT debannitaghosh theroleofevaluationmethodsinhealthrelatedelearningarapidreview AT uroojrkhan theroleofevaluationmethodsinhealthrelatedelearningarapidreview AT jameshboyd theroleofevaluationmethodsinhealthrelatedelearningarapidreview AT jasondstemp roleofevaluationmethodsinhealthrelatedelearningarapidreview AT debannitaghosh roleofevaluationmethodsinhealthrelatedelearningarapidreview AT uroojrkhan roleofevaluationmethodsinhealthrelatedelearningarapidreview AT jameshboyd roleofevaluationmethodsinhealthrelatedelearningarapidreview |