The GP tests of competence assessment: which part best predicts fitness to practise decisions?
Abstract Background The General Medical Council (GMC) conducts Tests of Competence (ToC) for doctors referred for Fitness to Practise (FtP) issues. GPs take a single best answer knowledge test, an Objective Structured Clinical Examination (OSCE), and a Simulated Surgery (SimSurg) assessment which is...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2018-01-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12909-017-1111-0 |
| _version_ | 1811310169453232128 |
|---|---|
| author | Hirosha Keshani Jayaweera Henry W. W. Potts Karim Keshwani Chris Valerio Magdalen Baker Leila Mehdizadeh Alison Sturrock |
| author_facet | Hirosha Keshani Jayaweera Henry W. W. Potts Karim Keshwani Chris Valerio Magdalen Baker Leila Mehdizadeh Alison Sturrock |
| author_sort | Hirosha Keshani Jayaweera |
| collection | DOAJ |
| description | Abstract Background The General Medical Council (GMC) conducts Tests of Competence (ToC) for doctors referred for Fitness to Practise (FtP) issues. GPs take a single best answer knowledge test, an Objective Structured Clinical Examination (OSCE), and a Simulated Surgery (SimSurg) assessment which is a simulated GP consultation. The aim of this study was to examine the similarities between OSCEs and SimSurg to determine whether each assessment contributed something unique to GP ToCs. Methods A mixed methods approach was used. Data were collated on 153 GPs who were required to undertake a ToC as a part of being investigated for FtP issues between February 2010 and October 2016. Using correlation analysis, we examined to what degree performance on the knowledge test, OSCE, and SimSurg related to case examiner recommendations and FtP outcomes, including the unique predictive power of these three assessments. The outcome measures were case examiner recommendations (i) not fit to practise; ii) fit to practise on a limited basis; or iii) fit to practise) as well as FtP outcomes (i) erased/removed from the register; ii) having restrictions/conditions; or iii) be in good standing). For the qualitative component, 45 GP assessors were asked to rate whether they assess the same competencies and which assessment provides better feedback about candidates. Results There was significant overlap between OSCEs and SimSurg, p < 0.001. SimSurg had additional predictive power in the presence of OSCEs and the knowledge test (p = 0.030) in distinguishing doctors from different FtP categories, while OSCEs did not (p = 0.080). Both the OSCEs (p = 0.004) and SimSurg (p < 0.001) had significant negative correlations with case examiner recommendations when accounting for the effects of the other two assessments. Inductive thematic analysis of the responses to the questionnaire showed that assessors perceived OSCEs to be better suited to target specific knowledge and skills. SimSurg was thought to produce a more global picture as the scenarios more accurately portray a patient consultation. Conclusion While all three assessments are strong predictors of both case examiner recommendations and FtP outcomes, our findings suggest that the efficiency of GP ToCs can be improved by removing some of this overlapping content. |
| first_indexed | 2024-04-13T09:53:40Z |
| format | Article |
| id | doaj.art-4544d30235154efc9152ee1ac52484bd |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-04-13T09:53:40Z |
| publishDate | 2018-01-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-4544d30235154efc9152ee1ac52484bd2022-12-22T02:51:30ZengBMCBMC Medical Education1472-69202018-01-011811910.1186/s12909-017-1111-0The GP tests of competence assessment: which part best predicts fitness to practise decisions?Hirosha Keshani Jayaweera0Henry W. W. Potts1Karim Keshwani2Chris Valerio3Magdalen Baker4Leila Mehdizadeh5Alison Sturrock6Research Department of Medical Education, University College LondonInstitute of Health Informatics, University College LondonResearch Department of Medical Education, University College LondonResearch Department of Medical Education, University College LondonResearch Department of Medical Education, University College LondonResearch Department of Medical Education, University College LondonResearch Department of Medical Education, University College LondonAbstract Background The General Medical Council (GMC) conducts Tests of Competence (ToC) for doctors referred for Fitness to Practise (FtP) issues. GPs take a single best answer knowledge test, an Objective Structured Clinical Examination (OSCE), and a Simulated Surgery (SimSurg) assessment which is a simulated GP consultation. The aim of this study was to examine the similarities between OSCEs and SimSurg to determine whether each assessment contributed something unique to GP ToCs. Methods A mixed methods approach was used. Data were collated on 153 GPs who were required to undertake a ToC as a part of being investigated for FtP issues between February 2010 and October 2016. Using correlation analysis, we examined to what degree performance on the knowledge test, OSCE, and SimSurg related to case examiner recommendations and FtP outcomes, including the unique predictive power of these three assessments. The outcome measures were case examiner recommendations (i) not fit to practise; ii) fit to practise on a limited basis; or iii) fit to practise) as well as FtP outcomes (i) erased/removed from the register; ii) having restrictions/conditions; or iii) be in good standing). For the qualitative component, 45 GP assessors were asked to rate whether they assess the same competencies and which assessment provides better feedback about candidates. Results There was significant overlap between OSCEs and SimSurg, p < 0.001. SimSurg had additional predictive power in the presence of OSCEs and the knowledge test (p = 0.030) in distinguishing doctors from different FtP categories, while OSCEs did not (p = 0.080). Both the OSCEs (p = 0.004) and SimSurg (p < 0.001) had significant negative correlations with case examiner recommendations when accounting for the effects of the other two assessments. Inductive thematic analysis of the responses to the questionnaire showed that assessors perceived OSCEs to be better suited to target specific knowledge and skills. SimSurg was thought to produce a more global picture as the scenarios more accurately portray a patient consultation. Conclusion While all three assessments are strong predictors of both case examiner recommendations and FtP outcomes, our findings suggest that the efficiency of GP ToCs can be improved by removing some of this overlapping content.http://link.springer.com/article/10.1186/s12909-017-1111-0Tests of competenceGeneral practiceOSCEsSimulated surgery |
| spellingShingle | Hirosha Keshani Jayaweera Henry W. W. Potts Karim Keshwani Chris Valerio Magdalen Baker Leila Mehdizadeh Alison Sturrock The GP tests of competence assessment: which part best predicts fitness to practise decisions? BMC Medical Education Tests of competence General practice OSCEs Simulated surgery |
| title | The GP tests of competence assessment: which part best predicts fitness to practise decisions? |
| title_full | The GP tests of competence assessment: which part best predicts fitness to practise decisions? |
| title_fullStr | The GP tests of competence assessment: which part best predicts fitness to practise decisions? |
| title_full_unstemmed | The GP tests of competence assessment: which part best predicts fitness to practise decisions? |
| title_short | The GP tests of competence assessment: which part best predicts fitness to practise decisions? |
| title_sort | gp tests of competence assessment which part best predicts fitness to practise decisions |
| topic | Tests of competence General practice OSCEs Simulated surgery |
| url | http://link.springer.com/article/10.1186/s12909-017-1111-0 |
| work_keys_str_mv | AT hiroshakeshanijayaweera thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT henrywwpotts thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT karimkeshwani thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT chrisvalerio thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT magdalenbaker thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT leilamehdizadeh thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT alisonsturrock thegptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT hiroshakeshanijayaweera gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT henrywwpotts gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT karimkeshwani gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT chrisvalerio gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT magdalenbaker gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT leilamehdizadeh gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions AT alisonsturrock gptestsofcompetenceassessmentwhichpartbestpredictsfitnesstopractisedecisions |