Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial
<p>Abstract</p> <p>Background</p> <p>Long-menu questions (LMQs) are viewed as an alternative method for answering open-ended questions (OEQs) in computerized assessment. So far this question type and its influence on examination scores have not been studied sufficiently...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2006-10-01
|
| Series: | BMC Medical Education |
| Online Access: | http://www.biomedcentral.com/1472-6920/6/50 |
| _version_ | 1818445185145634816 |
|---|---|
| author | Fischer Martin R Richter Bernd Fahron Urte Dicken Hans-Dieter Baehring Thomas Rotthoff Thomas Scherbaum Werner A |
| author_facet | Fischer Martin R Richter Bernd Fahron Urte Dicken Hans-Dieter Baehring Thomas Rotthoff Thomas Scherbaum Werner A |
| author_sort | Fischer Martin R |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>Long-menu questions (LMQs) are viewed as an alternative method for answering open-ended questions (OEQs) in computerized assessment. So far this question type and its influence on examination scores have not been studied sufficiently. However, the increasing use of computerized assessments will also lead to an increasing use of this question type.</p> <p>Using a summative online key feature (KF) examination we evaluated whether LMQs can be compared with OEQs in regard to the level of difficulty, performance and response times. We also evaluated the content for its suitability for LMQs.</p> <p>Methods</p> <p>We randomized 146 fourth year medical students into two groups. For the purpose of this study we created 7 peer-reviewed KF-cases with a total of 25 questions. All questions had the same content in both groups, but nine questions had a different answer type. Group A answered 9 questions with an LM type, group B with an OE type. In addition to the LM answer, group A could give an OE answer if the appropriate answer was not included in the list.</p> <p>Results</p> <p>The average number of correct answers for LMQs and OEQs showed no significant difference (p = 0.93). Among all 630 LM answers only one correct term (0.32%) was not included in the list of answers. The response time for LMQs did not significantly differ from that of OEQs (p = 0.65).</p> <p>Conclusion</p> <p>LMQs and OEQs do not differ significantly. Compared to standard multiple-choice questions (MCQs), the response time for LMQs and OEQs is longer. This is probably due to the fact that they require active problem solving skills and more practice. LMQs correspond more suitable to Short answer questions (SAQ) then to OEQ and should only be used when the answers can be clearly phrased, using only a few, precise synonyms.</p> <p>LMQs can decrease cueing effects and significantly simplify the scoring in computerized assessment.</p> |
| first_indexed | 2024-12-14T19:27:48Z |
| format | Article |
| id | doaj.art-e8b47b3621b14bb3aa5f352654c8c429 |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-12-14T19:27:48Z |
| publishDate | 2006-10-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-e8b47b3621b14bb3aa5f352654c8c4292022-12-21T22:50:09ZengBMCBMC Medical Education1472-69202006-10-01615010.1186/1472-6920-6-50Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trialFischer Martin RRichter BerndFahron UrteDicken Hans-DieterBaehring ThomasRotthoff ThomasScherbaum Werner A<p>Abstract</p> <p>Background</p> <p>Long-menu questions (LMQs) are viewed as an alternative method for answering open-ended questions (OEQs) in computerized assessment. So far this question type and its influence on examination scores have not been studied sufficiently. However, the increasing use of computerized assessments will also lead to an increasing use of this question type.</p> <p>Using a summative online key feature (KF) examination we evaluated whether LMQs can be compared with OEQs in regard to the level of difficulty, performance and response times. We also evaluated the content for its suitability for LMQs.</p> <p>Methods</p> <p>We randomized 146 fourth year medical students into two groups. For the purpose of this study we created 7 peer-reviewed KF-cases with a total of 25 questions. All questions had the same content in both groups, but nine questions had a different answer type. Group A answered 9 questions with an LM type, group B with an OE type. In addition to the LM answer, group A could give an OE answer if the appropriate answer was not included in the list.</p> <p>Results</p> <p>The average number of correct answers for LMQs and OEQs showed no significant difference (p = 0.93). Among all 630 LM answers only one correct term (0.32%) was not included in the list of answers. The response time for LMQs did not significantly differ from that of OEQs (p = 0.65).</p> <p>Conclusion</p> <p>LMQs and OEQs do not differ significantly. Compared to standard multiple-choice questions (MCQs), the response time for LMQs and OEQs is longer. This is probably due to the fact that they require active problem solving skills and more practice. LMQs correspond more suitable to Short answer questions (SAQ) then to OEQ and should only be used when the answers can be clearly phrased, using only a few, precise synonyms.</p> <p>LMQs can decrease cueing effects and significantly simplify the scoring in computerized assessment.</p>http://www.biomedcentral.com/1472-6920/6/50 |
| spellingShingle | Fischer Martin R Richter Bernd Fahron Urte Dicken Hans-Dieter Baehring Thomas Rotthoff Thomas Scherbaum Werner A Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial BMC Medical Education |
| title | Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial |
| title_full | Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial |
| title_fullStr | Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial |
| title_full_unstemmed | Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial |
| title_short | Comparison between Long-Menu and Open-Ended Questions in computerized medical assessments. A randomized controlled trial |
| title_sort | comparison between long menu and open ended questions in computerized medical assessments a randomized controlled trial |
| url | http://www.biomedcentral.com/1472-6920/6/50 |
| work_keys_str_mv | AT fischermartinr comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial AT richterbernd comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial AT fahronurte comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial AT dickenhansdieter comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial AT baehringthomas comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial AT rotthoffthomas comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial AT scherbaumwernera comparisonbetweenlongmenuandopenendedquestionsincomputerizedmedicalassessmentsarandomizedcontrolledtrial |