Assessment of medical students’ Surgery knowledge based on Progress Test
ABSTRACT Progress Testing (PT) is an assessment tool whose use has grown throughout Brazil in the last decade. PT makes it possible to assess the students’ knowledge gain throughout the undergraduate course and, for their interpretations to be valid, their items (questions) must have adequate qualit...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Colégio Brasileiro de Cirurgiões
2023-12-01
|
| Series: | Revista do Colégio Brasileiro de Cirurgiões |
| Subjects: | |
| Online Access: | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0100-69912023000100404&lng=en&tlng=en |
| _version_ | 1827595473164173312 |
|---|---|
| author | Pedro Tadao Hamamoto Filho Angélica Maria Bicudo Gerson Alves Pereira-Júnior |
| author_facet | Pedro Tadao Hamamoto Filho Angélica Maria Bicudo Gerson Alves Pereira-Júnior |
| author_sort | Pedro Tadao Hamamoto Filho |
| collection | DOAJ |
| description | ABSTRACT Progress Testing (PT) is an assessment tool whose use has grown throughout Brazil in the last decade. PT makes it possible to assess the students’ knowledge gain throughout the undergraduate course and, for their interpretations to be valid, their items (questions) must have adequate quality from the point of view of content validity and reliability of results. In this study, we analyzed the psychometric characteristics of the items and the performance of students in the content area of surgery from 2017 to 2023. For the analyses, we used the assumptions of Classical Test Theory, Bloom’s taxonomy and Cronbach’s alpha reliability coefficient. The items were easy (average difficulty index between 0.3-0.4), with fair to good discrimination (discrimination index between 0.3-0.4) and with a predominance of medium to high taxonomy. Reliability remained substantial over the years (>0.6). Students’ knowledge gain in surgery was found to be progressive and more important from the 3rd year of the undergraduate course, reaching approximately 70-75% in the 6th year. This measurements framework can be replicated in other contexts for a better understanding of student learning and for qualification of evaluation processes. |
| first_indexed | 2024-03-09T02:54:04Z |
| format | Article |
| id | doaj.art-5bbdebfc9ecd4d25a467836bbd8b9367 |
| institution | Directory Open Access Journal |
| issn | 1809-4546 |
| language | English |
| last_indexed | 2024-03-09T02:54:04Z |
| publishDate | 2023-12-01 |
| publisher | Colégio Brasileiro de Cirurgiões |
| record_format | Article |
| series | Revista do Colégio Brasileiro de Cirurgiões |
| spelling | doaj.art-5bbdebfc9ecd4d25a467836bbd8b93672023-12-05T07:50:50ZengColégio Brasileiro de CirurgiõesRevista do Colégio Brasileiro de Cirurgiões1809-45462023-12-015010.1590/0100-6991e-20233636-enAssessment of medical students’ Surgery knowledge based on Progress TestPedro Tadao Hamamoto Filhohttps://orcid.org/0000-0001-6436-9307Angélica Maria Bicudohttps://orcid.org/0000-0003-3043-5147Gerson Alves Pereira-Júniorhttps://orcid.org/0000-0003-3920-3000ABSTRACT Progress Testing (PT) is an assessment tool whose use has grown throughout Brazil in the last decade. PT makes it possible to assess the students’ knowledge gain throughout the undergraduate course and, for their interpretations to be valid, their items (questions) must have adequate quality from the point of view of content validity and reliability of results. In this study, we analyzed the psychometric characteristics of the items and the performance of students in the content area of surgery from 2017 to 2023. For the analyses, we used the assumptions of Classical Test Theory, Bloom’s taxonomy and Cronbach’s alpha reliability coefficient. The items were easy (average difficulty index between 0.3-0.4), with fair to good discrimination (discrimination index between 0.3-0.4) and with a predominance of medium to high taxonomy. Reliability remained substantial over the years (>0.6). Students’ knowledge gain in surgery was found to be progressive and more important from the 3rd year of the undergraduate course, reaching approximately 70-75% in the 6th year. This measurements framework can be replicated in other contexts for a better understanding of student learning and for qualification of evaluation processes.http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0100-69912023000100404&lng=en&tlng=enSurgeryEducational MeasurementMedical EducationPsychometrics |
| spellingShingle | Pedro Tadao Hamamoto Filho Angélica Maria Bicudo Gerson Alves Pereira-Júnior Assessment of medical students’ Surgery knowledge based on Progress Test Revista do Colégio Brasileiro de Cirurgiões Surgery Educational Measurement Medical Education Psychometrics |
| title | Assessment of medical students’ Surgery knowledge based on Progress Test |
| title_full | Assessment of medical students’ Surgery knowledge based on Progress Test |
| title_fullStr | Assessment of medical students’ Surgery knowledge based on Progress Test |
| title_full_unstemmed | Assessment of medical students’ Surgery knowledge based on Progress Test |
| title_short | Assessment of medical students’ Surgery knowledge based on Progress Test |
| title_sort | assessment of medical students surgery knowledge based on progress test |
| topic | Surgery Educational Measurement Medical Education Psychometrics |
| url | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0100-69912023000100404&lng=en&tlng=en |
| work_keys_str_mv | AT pedrotadaohamamotofilho assessmentofmedicalstudentssurgeryknowledgebasedonprogresstest AT angelicamariabicudo assessmentofmedicalstudentssurgeryknowledgebasedonprogresstest AT gersonalvespereirajunior assessmentofmedicalstudentssurgeryknowledgebasedonprogresstest |