Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment
This study aimed to identify misconceptions in medical student knowledge by mining user interactions in the MedU online learning environment. Data from 13000 attempts at a single virtual patient case were extracted from the MedU MySQL database. A subgroup discovery method was applied to identify pat...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Online Learning Consortium
2015-12-01
|
| Series: | Online Learning |
| Subjects: | |
| Online Access: | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/802 |
| _version_ | 1797328042913169408 |
|---|---|
| author | Eric G Poitras Laura Naismith Tenzin Doleck Susanne P Lajoie |
| author_facet | Eric G Poitras Laura Naismith Tenzin Doleck Susanne P Lajoie |
| author_sort | Eric G Poitras |
| collection | DOAJ |
| description | This study aimed to identify misconceptions in medical student knowledge by mining user interactions in the MedU online learning environment. Data from 13000 attempts at a single virtual patient case were extracted from the MedU MySQL database. A subgroup discovery method was applied to identify patterns in learner-generated annotations and responses to multiple-choice items on the diagnosis and management of acute myocardial infarction (i.e., heart attack). First, the algorithm generated rules where single terms from the learner annotations were used to predict incorrect answers to the multiple-choice items. Second, the possible combinations of terms and their relevant synonyms were used to determine whether their inclusion led to better rates of prediction. The second step was found to significantly increase prediction precision and weighted relative accuracy, uncovering four misconceptions at a rate greater than 70%. These findings serve to inform the design of an adaptive system that tailors the delivery of formative feedback to promote better learning outcomes in the domain of clinical reasoning. |
| first_indexed | 2024-03-08T06:46:10Z |
| format | Article |
| id | doaj.art-68e8afd5dde4458297aa4ec95d42c07d |
| institution | Directory Open Access Journal |
| issn | 2472-5749 2472-5730 |
| language | English |
| last_indexed | 2024-03-08T06:46:10Z |
| publishDate | 2015-12-01 |
| publisher | Online Learning Consortium |
| record_format | Article |
| series | Online Learning |
| spelling | doaj.art-68e8afd5dde4458297aa4ec95d42c07d2024-02-03T07:57:45ZengOnline Learning ConsortiumOnline Learning2472-57492472-57302015-12-0120210.24059/olj.v20i2.802Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient EnvironmentEric G Poitras0Laura Naismith1Tenzin Doleck2Susanne P Lajoie3University of UtahUniversity Health Network, Toronto Western HospitalMcGill UniversityMcGill UniversityThis study aimed to identify misconceptions in medical student knowledge by mining user interactions in the MedU online learning environment. Data from 13000 attempts at a single virtual patient case were extracted from the MedU MySQL database. A subgroup discovery method was applied to identify patterns in learner-generated annotations and responses to multiple-choice items on the diagnosis and management of acute myocardial infarction (i.e., heart attack). First, the algorithm generated rules where single terms from the learner annotations were used to predict incorrect answers to the multiple-choice items. Second, the possible combinations of terms and their relevant synonyms were used to determine whether their inclusion led to better rates of prediction. The second step was found to significantly increase prediction precision and weighted relative accuracy, uncovering four misconceptions at a rate greater than 70%. These findings serve to inform the design of an adaptive system that tailors the delivery of formative feedback to promote better learning outcomes in the domain of clinical reasoning.https://olj.onlinelearningconsortium.org/index.php/olj/article/view/802Learning AnalyticsOnline LearningMisconceptions |
| spellingShingle | Eric G Poitras Laura Naismith Tenzin Doleck Susanne P Lajoie Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment Online Learning Learning Analytics Online Learning Misconceptions |
| title | Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment |
| title_full | Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment |
| title_fullStr | Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment |
| title_full_unstemmed | Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment |
| title_short | Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment |
| title_sort | using learning analytics to identify medical student misconceptions in an online virtual patient environment |
| topic | Learning Analytics Online Learning Misconceptions |
| url | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/802 |
| work_keys_str_mv | AT ericgpoitras usinglearninganalyticstoidentifymedicalstudentmisconceptionsinanonlinevirtualpatientenvironment AT lauranaismith usinglearninganalyticstoidentifymedicalstudentmisconceptionsinanonlinevirtualpatientenvironment AT tenzindoleck usinglearninganalyticstoidentifymedicalstudentmisconceptionsinanonlinevirtualpatientenvironment AT susanneplajoie usinglearninganalyticstoidentifymedicalstudentmisconceptionsinanonlinevirtualpatientenvironment |