Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students
Introduction: Nowadays according to competency based curriculum, selecting an appropriate assessment method is inevitable. This study aimed to investigate application of Direct Observation of Procedural Skills (DOPS) in undergraduate medical students. Methods: This is a cross sectional study co...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Shiraz University of Medical Sciences
2018-07-01
|
| Series: | Journal of Advances in Medical Education and Professionalism |
| Subjects: | |
| Online Access: | http://jamp.sums.ac.ir/index.php/JAMP/article/view/1079 |
| _version_ | 1818908865068007424 |
|---|---|
| author | AREZOU FARAJPOUR MITRA AMINI ELHAM PISHBIN ZAHRA MOSTAFAVIAN SOMAYEH AKBARI FARMAD |
| author_facet | AREZOU FARAJPOUR MITRA AMINI ELHAM PISHBIN ZAHRA MOSTAFAVIAN SOMAYEH AKBARI FARMAD |
| author_sort | AREZOU FARAJPOUR |
| collection | DOAJ |
| description | Introduction: Nowadays according to competency based
curriculum, selecting an appropriate assessment method is
inevitable. This study aimed to investigate application of Direct
Observation of Procedural Skills (DOPS) in undergraduate
medical students.
Methods: This is a cross sectional study conducted during
emergency ward rotation in last year medical students using
consensus sampling method. Each student performed 2 procedures
at least twice under the observation of 2 assessors using modified
DOPS rating scales designed for each procedure simultaneously.
Correlation between DOPS score and final routine exam was
measured. Face and content validity was determined by the
panel of experts. Moreover, through the test-retest and interrater
reliability, the correlation of each score and total score was
investigated. The spent time was calculated too. The statistical
analysis was carried out using SPSS version 18.
Results: Totally 60 students did 240 procedures under DOPS.
The face and content validity confirmed by an expert panel. The
findings showed that there was a significant correlation between
the scores of each test and the total DOPS score (r1=0.736**,
r2=0.793**, r3=0.564**, r4=0.685**; p<0.001). There was a significant
correlation between the first and second scores of doing the same
procedure (Pearson Cor.=0.74, p<0.001) and also between the
scores of the two individual examiners when observing the same
procedure (Pearson Cor.=0.84-0.94, p<0.001). The results showed
that there was no correlation (Pearson Correlation=0.018, p<0.89)
between the scores of this test and the final routine ward exam
scores. The average time for doing DOPS test and the average
time for providing feedback were 11.17±7.5 Max and 9.2±4.5 Min,
respectively.
Conclusion: The use of novel performance assessment methods
such as DOPS is highly beneficial in order to ensure the adequacy
of learning in medical students and assess their readiness for
accepting professional responsibilities. DOPS as a practical and
reliable test with acceptable validation can be used to assess
clinical skills of undergraduate medical students. |
| first_indexed | 2024-12-19T22:17:48Z |
| format | Article |
| id | doaj.art-4bb0d2bddbf34e4fb7386c86d6cb78a8 |
| institution | Directory Open Access Journal |
| issn | 2322-2220 2322-3561 |
| language | English |
| last_indexed | 2024-12-19T22:17:48Z |
| publishDate | 2018-07-01 |
| publisher | Shiraz University of Medical Sciences |
| record_format | Article |
| series | Journal of Advances in Medical Education and Professionalism |
| spelling | doaj.art-4bb0d2bddbf34e4fb7386c86d6cb78a82022-12-21T20:03:43ZengShiraz University of Medical SciencesJournal of Advances in Medical Education and Professionalism2322-22202322-35612018-07-0163130136Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical studentsAREZOU FARAJPOUR0MITRA AMINI1ELHAM PISHBIN2ZAHRA MOSTAFAVIAN3SOMAYEH AKBARI FARMAD4School of Medical Education, Shahid Beheshti University of Medical Sciences, Tehran, IranClinical Education Research Center, Shiraz University of Medical Sciences, Shiraz, IranDepartment of Emergency Medicine, Mashhad University of Medical Sciences, Mashhad, IranDepartment of Community Medicine, Mashhad Branch, Islamic Azad University, Mashhad, IranSchool of Medical Education, Shahid Beheshti University of Medical Sciences, Tehran, IranIntroduction: Nowadays according to competency based curriculum, selecting an appropriate assessment method is inevitable. This study aimed to investigate application of Direct Observation of Procedural Skills (DOPS) in undergraduate medical students. Methods: This is a cross sectional study conducted during emergency ward rotation in last year medical students using consensus sampling method. Each student performed 2 procedures at least twice under the observation of 2 assessors using modified DOPS rating scales designed for each procedure simultaneously. Correlation between DOPS score and final routine exam was measured. Face and content validity was determined by the panel of experts. Moreover, through the test-retest and interrater reliability, the correlation of each score and total score was investigated. The spent time was calculated too. The statistical analysis was carried out using SPSS version 18. Results: Totally 60 students did 240 procedures under DOPS. The face and content validity confirmed by an expert panel. The findings showed that there was a significant correlation between the scores of each test and the total DOPS score (r1=0.736**, r2=0.793**, r3=0.564**, r4=0.685**; p<0.001). There was a significant correlation between the first and second scores of doing the same procedure (Pearson Cor.=0.74, p<0.001) and also between the scores of the two individual examiners when observing the same procedure (Pearson Cor.=0.84-0.94, p<0.001). The results showed that there was no correlation (Pearson Correlation=0.018, p<0.89) between the scores of this test and the final routine ward exam scores. The average time for doing DOPS test and the average time for providing feedback were 11.17±7.5 Max and 9.2±4.5 Min, respectively. Conclusion: The use of novel performance assessment methods such as DOPS is highly beneficial in order to ensure the adequacy of learning in medical students and assess their readiness for accepting professional responsibilities. DOPS as a practical and reliable test with acceptable validation can be used to assess clinical skills of undergraduate medical students.http://jamp.sums.ac.ir/index.php/JAMP/article/view/1079ReliabilityValidityFeasibilitySatisfactionUndergraduateMedical student |
| spellingShingle | AREZOU FARAJPOUR MITRA AMINI ELHAM PISHBIN ZAHRA MOSTAFAVIAN SOMAYEH AKBARI FARMAD Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students Journal of Advances in Medical Education and Professionalism Reliability Validity Feasibility Satisfaction Undergraduate Medical student |
| title | Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students |
| title_full | Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students |
| title_fullStr | Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students |
| title_full_unstemmed | Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students |
| title_short | Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students |
| title_sort | using modified direct observation of procedural skills dops to assess undergraduate medical students |
| topic | Reliability Validity Feasibility Satisfaction Undergraduate Medical student |
| url | http://jamp.sums.ac.ir/index.php/JAMP/article/view/1079 |
| work_keys_str_mv | AT arezoufarajpour usingmodifieddirectobservationofproceduralskillsdopstoassessundergraduatemedicalstudents AT mitraamini usingmodifieddirectobservationofproceduralskillsdopstoassessundergraduatemedicalstudents AT elhampishbin usingmodifieddirectobservationofproceduralskillsdopstoassessundergraduatemedicalstudents AT zahramostafavian usingmodifieddirectobservationofproceduralskillsdopstoassessundergraduatemedicalstudents AT somayehakbarifarmad usingmodifieddirectobservationofproceduralskillsdopstoassessundergraduatemedicalstudents |