Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress
<p>Abstract</p> <p>Background</p> <p>Programmatic assessment that looks across a whole year may contribute to better decisions compared with those made from isolated assessments alone. The aim of this study is to describe and evaluate a programmatic system to handle stu...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2011-06-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | http://www.biomedcentral.com/1472-6920/11/29 |
| _version_ | 1811276056820187136 |
|---|---|
| author | McKenzie Jan M Ali Anthony N Egan Tony G Tweed Mike J Wilkinson Tim J Moore MaryLeigh Rudland Joy R |
| author_facet | McKenzie Jan M Ali Anthony N Egan Tony G Tweed Mike J Wilkinson Tim J Moore MaryLeigh Rudland Joy R |
| author_sort | McKenzie Jan M |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>Programmatic assessment that looks across a whole year may contribute to better decisions compared with those made from isolated assessments alone. The aim of this study is to describe and evaluate a programmatic system to handle student assessment results that is aligned not only with learning and remediation, but also with defensibility. The key components are standards based assessments, use of "Conditional Pass", and regular progress meetings.</p> <p>Methods</p> <p>The new assessment system is described. The evaluation is based on years 4-6 of a 6-year medical course. The types of concerns staff had about students were clustered into themes alongside any interventions and outcomes for the students concerned. The likelihoods of passing the year according to type of problem were compared before and after phasing in of the new assessment system.</p> <p>Results</p> <p>The new system was phased in over four years. In the fourth year of implementation 701 students had 3539 assessment results, of which 4.1% were Conditional Pass. More in-depth analysis for 1516 results available from 447 students revealed the odds ratio (95% confidence intervals) for failure was highest for students with problems identified in more than one part of the course (18.8 (7.7-46.2) p < 0.0001) or with problems with professionalism (17.2 (9.1-33.3) p < 0.0001). The odds ratio for failure was lowest for problems with assignments (0.7 (0.1-5.2) NS). Compared with the previous system, more students failed the year under the new system on the basis of performance during the year (20 or 4.5% compared with four or 1.1% under the previous system (p < 0.01)).</p> <p>Conclusions</p> <p>The new system detects more students in difficulty and has resulted in less "failure to fail". The requirement to state conditions required to pass has contributed to a paper trail that should improve defensibility. Most importantly it has helped detect and act on some of the more difficult areas to assess such as professionalism.</p> |
| first_indexed | 2024-04-12T23:49:46Z |
| format | Article |
| id | doaj.art-f0ddfe249f274d1f90b443f8db35b723 |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-04-12T23:49:46Z |
| publishDate | 2011-06-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-f0ddfe249f274d1f90b443f8db35b7232022-12-22T03:11:45ZengBMCBMC Medical Education1472-69202011-06-011112910.1186/1472-6920-11-29Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progressMcKenzie Jan MAli Anthony NEgan Tony GTweed Mike JWilkinson Tim JMoore MaryLeighRudland Joy R<p>Abstract</p> <p>Background</p> <p>Programmatic assessment that looks across a whole year may contribute to better decisions compared with those made from isolated assessments alone. The aim of this study is to describe and evaluate a programmatic system to handle student assessment results that is aligned not only with learning and remediation, but also with defensibility. The key components are standards based assessments, use of "Conditional Pass", and regular progress meetings.</p> <p>Methods</p> <p>The new assessment system is described. The evaluation is based on years 4-6 of a 6-year medical course. The types of concerns staff had about students were clustered into themes alongside any interventions and outcomes for the students concerned. The likelihoods of passing the year according to type of problem were compared before and after phasing in of the new assessment system.</p> <p>Results</p> <p>The new system was phased in over four years. In the fourth year of implementation 701 students had 3539 assessment results, of which 4.1% were Conditional Pass. More in-depth analysis for 1516 results available from 447 students revealed the odds ratio (95% confidence intervals) for failure was highest for students with problems identified in more than one part of the course (18.8 (7.7-46.2) p < 0.0001) or with problems with professionalism (17.2 (9.1-33.3) p < 0.0001). The odds ratio for failure was lowest for problems with assignments (0.7 (0.1-5.2) NS). Compared with the previous system, more students failed the year under the new system on the basis of performance during the year (20 or 4.5% compared with four or 1.1% under the previous system (p < 0.01)).</p> <p>Conclusions</p> <p>The new system detects more students in difficulty and has resulted in less "failure to fail". The requirement to state conditions required to pass has contributed to a paper trail that should improve defensibility. Most importantly it has helped detect and act on some of the more difficult areas to assess such as professionalism.</p>http://www.biomedcentral.com/1472-6920/11/29AssessmentProfessionalismMonitoring progressFeedback |
| spellingShingle | McKenzie Jan M Ali Anthony N Egan Tony G Tweed Mike J Wilkinson Tim J Moore MaryLeigh Rudland Joy R Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress BMC Medical Education Assessment Professionalism Monitoring progress Feedback |
| title | Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress |
| title_full | Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress |
| title_fullStr | Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress |
| title_full_unstemmed | Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress |
| title_short | Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress |
| title_sort | joining the dots conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress |
| topic | Assessment Professionalism Monitoring progress Feedback |
| url | http://www.biomedcentral.com/1472-6920/11/29 |
| work_keys_str_mv | AT mckenziejanm joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress AT alianthonyn joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress AT egantonyg joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress AT tweedmikej joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress AT wilkinsontimj joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress AT mooremaryleigh joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress AT rudlandjoyr joiningthedotsconditionalpassandprogrammaticassessmentenhancesrecognitionofproblemswithprofessionalismandfactorshamperingstudentprogress |