Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection
Objectives To determine how current psychometric testing approaches used in selection of postgraduate training in UK Public Health are associated with socioeconomic and sociocultural background of applicants (including ethnicity).Design Observational study using contemporaneous data collected during...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2023-03-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/13/3/e069738.full |
| _version_ | 1811154798647443456 |
|---|---|
| author | Azeem Majeed Mala Rao Ganesh Sathyamoorthy Richard J Pinder Fran Bury |
| author_facet | Azeem Majeed Mala Rao Ganesh Sathyamoorthy Richard J Pinder Fran Bury |
| author_sort | Azeem Majeed |
| collection | DOAJ |
| description | Objectives To determine how current psychometric testing approaches used in selection of postgraduate training in UK Public Health are associated with socioeconomic and sociocultural background of applicants (including ethnicity).Design Observational study using contemporaneous data collected during recruitment and psychometric test scores.Setting Assessment centre of UK national Public Health recruitment for postgraduate Public Health training. The assessment centre element of selection comprises three psychometric assessments: Rust Advanced Numerical Reasoning, Watson-Glaser Critical Thinking Assessment II and Public Health situational judgement test.Participants 629 applicants completed the assessment centre in 2021. 219 (34.8%) were UK medical graduates, 73 (116%) were international medical graduates and 337 (53.6%) were from backgrounds other than medicine.Main outcome measure Multivariable-adjusted progression statistics in the form of adjusted OR (aOR), accounting for age, sex, ethnicity, professional background and surrogate measures of familial socioeconomic and sociocultural status.Results 357 (56.8%) candidates passed all three psychometric tests. Candidate characteristics negatively associated with progression were black ethnicity (aOR 0.19, 0.08 to 0.44), Asian ethnicity (aOR 0.35, 0.16 to 0.71) and coming from a non-UK medical graduate background (aOR 0.05, 0.03 to 0.12); similar differential attainment was observed in each of the psychometric tests. Even within the UK-trained medical cohort, candidates from white British backgrounds were more likely to progress than those from ethnic minorities (89.2% vs 75.0%, p=0.003).Conclusion Although perceived to mitigate the risks of conscious and unconscious bias in selection to medical postgraduate training, these psychometric tests demonstrate unexplained variation that suggests differential attainment. Other specialties should enhance their data collection to evaluate the impact of differential attainment on current selection processes and take forward opportunities to mitigate differential attainment where possible. |
| first_indexed | 2024-04-10T04:23:06Z |
| format | Article |
| id | doaj.art-b43b2254f86e49f69f627676799aa8ce |
| institution | Directory Open Access Journal |
| issn | 2044-6055 |
| language | English |
| last_indexed | 2024-04-10T04:23:06Z |
| publishDate | 2023-03-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj.art-b43b2254f86e49f69f627676799aa8ce2023-03-10T22:30:09ZengBMJ Publishing GroupBMJ Open2044-60552023-03-0113310.1136/bmjopen-2022-069738Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selectionAzeem Majeed0Mala Rao1Ganesh Sathyamoorthy2Richard J Pinder3Fran Bury4Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, UKDepartment of Primary Care and Public Health, School of Public Health, Imperial College London, London, UKDepartment of Primary Care and Public Health, School of Public Health, Imperial College London, London, UKDepartment of Primary Care and Public Health, School of Public Health, Imperial College London, London, UKDepartment of Primary Care and Public Health, School of Public Health, Imperial College London, London, UKObjectives To determine how current psychometric testing approaches used in selection of postgraduate training in UK Public Health are associated with socioeconomic and sociocultural background of applicants (including ethnicity).Design Observational study using contemporaneous data collected during recruitment and psychometric test scores.Setting Assessment centre of UK national Public Health recruitment for postgraduate Public Health training. The assessment centre element of selection comprises three psychometric assessments: Rust Advanced Numerical Reasoning, Watson-Glaser Critical Thinking Assessment II and Public Health situational judgement test.Participants 629 applicants completed the assessment centre in 2021. 219 (34.8%) were UK medical graduates, 73 (116%) were international medical graduates and 337 (53.6%) were from backgrounds other than medicine.Main outcome measure Multivariable-adjusted progression statistics in the form of adjusted OR (aOR), accounting for age, sex, ethnicity, professional background and surrogate measures of familial socioeconomic and sociocultural status.Results 357 (56.8%) candidates passed all three psychometric tests. Candidate characteristics negatively associated with progression were black ethnicity (aOR 0.19, 0.08 to 0.44), Asian ethnicity (aOR 0.35, 0.16 to 0.71) and coming from a non-UK medical graduate background (aOR 0.05, 0.03 to 0.12); similar differential attainment was observed in each of the psychometric tests. Even within the UK-trained medical cohort, candidates from white British backgrounds were more likely to progress than those from ethnic minorities (89.2% vs 75.0%, p=0.003).Conclusion Although perceived to mitigate the risks of conscious and unconscious bias in selection to medical postgraduate training, these psychometric tests demonstrate unexplained variation that suggests differential attainment. Other specialties should enhance their data collection to evaluate the impact of differential attainment on current selection processes and take forward opportunities to mitigate differential attainment where possible.https://bmjopen.bmj.com/content/13/3/e069738.full |
| spellingShingle | Azeem Majeed Mala Rao Ganesh Sathyamoorthy Richard J Pinder Fran Bury Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection BMJ Open |
| title | Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection |
| title_full | Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection |
| title_fullStr | Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection |
| title_full_unstemmed | Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection |
| title_short | Differential attainment in specialty training recruitment in the UK: an observational analysis of the impact of psychometric testing assessment in Public Health postgraduate selection |
| title_sort | differential attainment in specialty training recruitment in the uk an observational analysis of the impact of psychometric testing assessment in public health postgraduate selection |
| url | https://bmjopen.bmj.com/content/13/3/e069738.full |
| work_keys_str_mv | AT azeemmajeed differentialattainmentinspecialtytrainingrecruitmentintheukanobservationalanalysisoftheimpactofpsychometrictestingassessmentinpublichealthpostgraduateselection AT malarao differentialattainmentinspecialtytrainingrecruitmentintheukanobservationalanalysisoftheimpactofpsychometrictestingassessmentinpublichealthpostgraduateselection AT ganeshsathyamoorthy differentialattainmentinspecialtytrainingrecruitmentintheukanobservationalanalysisoftheimpactofpsychometrictestingassessmentinpublichealthpostgraduateselection AT richardjpinder differentialattainmentinspecialtytrainingrecruitmentintheukanobservationalanalysisoftheimpactofpsychometrictestingassessmentinpublichealthpostgraduateselection AT franbury differentialattainmentinspecialtytrainingrecruitmentintheukanobservationalanalysisoftheimpactofpsychometrictestingassessmentinpublichealthpostgraduateselection |