Script concordance test in medical schools in Brazil: possibilities and limitations
CONTEXT AND OBJECTIVE: Routine use of the script concordance test (SCT) is not common in Brazilian universities. This study aimed to analyze application of the SCT in the medical school of a Brazilian university. DESIGN AND SETTING: Quantitative, analytical and descriptive study in the medical sc...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Associação Paulista de Medicina
|
| Series: | São Paulo Medical Journal |
| Subjects: | |
| Online Access: | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1516-31802016000200116&lng=en&tlng=en |
| _version_ | 1818419083421417472 |
|---|---|
| author | Alexandre Roberti Maria do Rosário Ferraz Roberti Edna Regina Silva Pereira Nilce Maria da Silva Campos Costa |
| author_facet | Alexandre Roberti Maria do Rosário Ferraz Roberti Edna Regina Silva Pereira Nilce Maria da Silva Campos Costa |
| author_sort | Alexandre Roberti |
| collection | DOAJ |
| description | CONTEXT AND OBJECTIVE: Routine use of the script concordance test (SCT) is not common in Brazilian universities. This study aimed to analyze application of the SCT in the medical school of a Brazilian university. DESIGN AND SETTING: Quantitative, analytical and descriptive study in the medical school of a Brazilian university. METHODS: A total of 159/550 students participated. The test comprised ten clinical cases within internal medicine, with five items per case, rated on a five-point Likert scale. The test was scored in accordance with a marking key that had been validated by a reference panel. RESULTS: In the pre-clinical and clinical phases, the mean scores were 51.6% and 63.4% of the maximum possible scores, respectively. Comparison of the means of the responses among all the years showed that there were significant differences in 40% of the items. The panel marked all the possible answers in five items, while in one item, all the panelists marked a single answer. Cronbach's alpha was 0.64. The results indicated that the more senior students performed better. Construction of an SCT with discriminative questions was not easy. The low reliability index may have occurred due to: a) problems with the construction of the questions; b) limitations of the reference panel; and/or c) the scoring key. CONCLUSION: This instrument is very difficult to construct, apply and correct. These difficulties may make application of an SCT as an assessment method unfeasible in units with limited resources. |
| first_indexed | 2024-12-14T12:32:56Z |
| format | Article |
| id | doaj.art-7d77818eafc3450e96c645e7c4d4d5a2 |
| institution | Directory Open Access Journal |
| issn | 1806-9460 |
| language | English |
| last_indexed | 2024-12-14T12:32:56Z |
| publisher | Associação Paulista de Medicina |
| record_format | Article |
| series | São Paulo Medical Journal |
| spelling | doaj.art-7d77818eafc3450e96c645e7c4d4d5a22022-12-21T23:01:07ZengAssociação Paulista de MedicinaSão Paulo Medical Journal1806-9460134211612010.1590/1516-3180.2015.00100108S1516-31802016000200116Script concordance test in medical schools in Brazil: possibilities and limitationsAlexandre RobertiMaria do Rosário Ferraz RobertiEdna Regina Silva PereiraNilce Maria da Silva Campos CostaCONTEXT AND OBJECTIVE: Routine use of the script concordance test (SCT) is not common in Brazilian universities. This study aimed to analyze application of the SCT in the medical school of a Brazilian university. DESIGN AND SETTING: Quantitative, analytical and descriptive study in the medical school of a Brazilian university. METHODS: A total of 159/550 students participated. The test comprised ten clinical cases within internal medicine, with five items per case, rated on a five-point Likert scale. The test was scored in accordance with a marking key that had been validated by a reference panel. RESULTS: In the pre-clinical and clinical phases, the mean scores were 51.6% and 63.4% of the maximum possible scores, respectively. Comparison of the means of the responses among all the years showed that there were significant differences in 40% of the items. The panel marked all the possible answers in five items, while in one item, all the panelists marked a single answer. Cronbach's alpha was 0.64. The results indicated that the more senior students performed better. Construction of an SCT with discriminative questions was not easy. The low reliability index may have occurred due to: a) problems with the construction of the questions; b) limitations of the reference panel; and/or c) the scoring key. CONCLUSION: This instrument is very difficult to construct, apply and correct. These difficulties may make application of an SCT as an assessment method unfeasible in units with limited resources.http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1516-31802016000200116&lng=en&tlng=enEducational measurementStudents medicalEducation medicalCurriculumCognition |
| spellingShingle | Alexandre Roberti Maria do Rosário Ferraz Roberti Edna Regina Silva Pereira Nilce Maria da Silva Campos Costa Script concordance test in medical schools in Brazil: possibilities and limitations São Paulo Medical Journal Educational measurement Students medical Education medical Curriculum Cognition |
| title | Script concordance test in medical schools in Brazil: possibilities and limitations |
| title_full | Script concordance test in medical schools in Brazil: possibilities and limitations |
| title_fullStr | Script concordance test in medical schools in Brazil: possibilities and limitations |
| title_full_unstemmed | Script concordance test in medical schools in Brazil: possibilities and limitations |
| title_short | Script concordance test in medical schools in Brazil: possibilities and limitations |
| title_sort | script concordance test in medical schools in brazil possibilities and limitations |
| topic | Educational measurement Students medical Education medical Curriculum Cognition |
| url | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1516-31802016000200116&lng=en&tlng=en |
| work_keys_str_mv | AT alexandreroberti scriptconcordancetestinmedicalschoolsinbrazilpossibilitiesandlimitations AT mariadorosarioferrazroberti scriptconcordancetestinmedicalschoolsinbrazilpossibilitiesandlimitations AT ednareginasilvapereira scriptconcordancetestinmedicalschoolsinbrazilpossibilitiesandlimitations AT nilcemariadasilvacamposcosta scriptconcordancetestinmedicalschoolsinbrazilpossibilitiesandlimitations |