Evaluation of Residency Admission Exams
ABSTRACT Introduction: Residency admission exams, although not intended to evaluate medical training, do so in an indirect way. The evaluation of the quality of the medical residency tests allows, among other things, to re-evaluate the training process itself and the skills expected of the candidat...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | Portuguese |
| Published: |
Associção Brasileira de Educação Médica
|
| Series: | Revista Brasileira de Educação Médica |
| Subjects: | |
| Online Access: | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022018000200026&lng=en&tlng=en |
| _version_ | 1818116442144374784 |
|---|---|
| author | Júlio César Soares Aragão Bruna Casiraghi Otávio Cabral Coelho Amanda Rangel Macedo Sarzedas Stéfanie Maria Moura Peloggia Tássio de Faria Huguenin |
| author_facet | Júlio César Soares Aragão Bruna Casiraghi Otávio Cabral Coelho Amanda Rangel Macedo Sarzedas Stéfanie Maria Moura Peloggia Tássio de Faria Huguenin |
| author_sort | Júlio César Soares Aragão |
| collection | DOAJ |
| description | ABSTRACT Introduction: Residency admission exams, although not intended to evaluate medical training, do so in an indirect way. The evaluation of the quality of the medical residency tests allows, among other things, to re-evaluate the training process itself and the skills expected of the candidates. Objective: To evaluate first phase exam tests of different medical residency programs in the largest Brazilian urban centers. Method: We evaluated 500 questions of residency admission exams in the states of São Paulo, Rio de Janeiro and Minas Gerais. The items were evaluated in terms of their origin, geographical location, area of knowledge, contextualization, context scenarios and complexity by Bloom's taxonomy. Results: Most of the questions presented contextualization (64.4%, n = 322), with predominant scenarios of high complexity and in hospital environment. The predominant taxonomic category was identified as recognition (41.60%, n = 208), the second most frequent was judgment, in 26% of the questions (n = 130), followed by synthesis (15%, n = 75), analysis (7.60%, n = 38), comprehension (6%, n = 30) and application (3.8%, n = 19). Considering the dichotomization between questions of theoretical and clinical reasoning, we found a balance between both (clinical reasoning: 48.9%, n = 243; theoretical reasoning: 51.4%, n = 257). The association of contextualization with clinical reasoning was high, with the relative risk of an item requiring clinical reasoning in the presence of contextualization of 26.31 (CI 11.06 – 62.59). Final considerations: The scenario outlined by the present research demonstrates that the different selective processes for medical residency in Brazil differ greatly in relation to the selection profile, with hospital-centered focus, favoring scenarios of high complexity in a hospital environment. Although much has been done and discussed in order to promote changes in medical education in Brazil, the selection process for Medical Residency still fails to reflect the changes advocated since the end of the last century and consolidated in the public policies of the beginning of this century. If we consider that the selected professionals are likely to remain at that institution after the end of their undergraduate studies, then we can have some understanding of the feedback cycle that is created in the programs. |
| first_indexed | 2024-12-11T04:22:35Z |
| format | Article |
| id | doaj.art-741004fa6d4246bdb47efcb07deee302 |
| institution | Directory Open Access Journal |
| issn | 1981-5271 |
| language | Portuguese |
| last_indexed | 2024-12-11T04:22:35Z |
| publisher | Associção Brasileira de Educação Médica |
| record_format | Article |
| series | Revista Brasileira de Educação Médica |
| spelling | doaj.art-741004fa6d4246bdb47efcb07deee3022022-12-22T01:21:04ZporAssocição Brasileira de Educação MédicaRevista Brasileira de Educação Médica1981-5271422263310.1590/1981-52712015v421n2rb20170016S0100-55022018000200026Evaluation of Residency Admission ExamsJúlio César Soares AragãoBruna CasiraghiOtávio Cabral CoelhoAmanda Rangel Macedo SarzedasStéfanie Maria Moura PeloggiaTássio de Faria HugueninABSTRACT Introduction: Residency admission exams, although not intended to evaluate medical training, do so in an indirect way. The evaluation of the quality of the medical residency tests allows, among other things, to re-evaluate the training process itself and the skills expected of the candidates. Objective: To evaluate first phase exam tests of different medical residency programs in the largest Brazilian urban centers. Method: We evaluated 500 questions of residency admission exams in the states of São Paulo, Rio de Janeiro and Minas Gerais. The items were evaluated in terms of their origin, geographical location, area of knowledge, contextualization, context scenarios and complexity by Bloom's taxonomy. Results: Most of the questions presented contextualization (64.4%, n = 322), with predominant scenarios of high complexity and in hospital environment. The predominant taxonomic category was identified as recognition (41.60%, n = 208), the second most frequent was judgment, in 26% of the questions (n = 130), followed by synthesis (15%, n = 75), analysis (7.60%, n = 38), comprehension (6%, n = 30) and application (3.8%, n = 19). Considering the dichotomization between questions of theoretical and clinical reasoning, we found a balance between both (clinical reasoning: 48.9%, n = 243; theoretical reasoning: 51.4%, n = 257). The association of contextualization with clinical reasoning was high, with the relative risk of an item requiring clinical reasoning in the presence of contextualization of 26.31 (CI 11.06 – 62.59). Final considerations: The scenario outlined by the present research demonstrates that the different selective processes for medical residency in Brazil differ greatly in relation to the selection profile, with hospital-centered focus, favoring scenarios of high complexity in a hospital environment. Although much has been done and discussed in order to promote changes in medical education in Brazil, the selection process for Medical Residency still fails to reflect the changes advocated since the end of the last century and consolidated in the public policies of the beginning of this century. If we consider that the selected professionals are likely to remain at that institution after the end of their undergraduate studies, then we can have some understanding of the feedback cycle that is created in the programs.http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022018000200026&lng=en&tlng=enInternato e ResidênciaAvaliação EducacionalClassificaçãoQuestões de Exames |
| spellingShingle | Júlio César Soares Aragão Bruna Casiraghi Otávio Cabral Coelho Amanda Rangel Macedo Sarzedas Stéfanie Maria Moura Peloggia Tássio de Faria Huguenin Evaluation of Residency Admission Exams Revista Brasileira de Educação Médica Internato e Residência Avaliação Educacional Classificação Questões de Exames |
| title | Evaluation of Residency Admission Exams |
| title_full | Evaluation of Residency Admission Exams |
| title_fullStr | Evaluation of Residency Admission Exams |
| title_full_unstemmed | Evaluation of Residency Admission Exams |
| title_short | Evaluation of Residency Admission Exams |
| title_sort | evaluation of residency admission exams |
| topic | Internato e Residência Avaliação Educacional Classificação Questões de Exames |
| url | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022018000200026&lng=en&tlng=en |
| work_keys_str_mv | AT juliocesarsoaresaragao evaluationofresidencyadmissionexams AT brunacasiraghi evaluationofresidencyadmissionexams AT otaviocabralcoelho evaluationofresidencyadmissionexams AT amandarangelmacedosarzedas evaluationofresidencyadmissionexams AT stefaniemariamourapeloggia evaluationofresidencyadmissionexams AT tassiodefariahuguenin evaluationofresidencyadmissionexams |