Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study
Fieldwork education is an integral part of the educational process in occupational therapy and assessing student competency at the end of fieldwork is important. The aim of this study was to design and conduct an Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Prac...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Eastern Kentucky University
2022-07-01
|
| Series: | Journal of Occupational Therapy Education |
| Subjects: |
| _version_ | 1811309001030238208 |
|---|---|
| author | Marzieh Pashmdarfard Afsoon Hassani Mehraban Narges Shafaroodi Kamran Soltani Arabshahi Soroor Parvizy Akram Azad Samaneh Karamali Esmaeili |
| author_facet | Marzieh Pashmdarfard Afsoon Hassani Mehraban Narges Shafaroodi Kamran Soltani Arabshahi Soroor Parvizy Akram Azad Samaneh Karamali Esmaeili |
| author_sort | Marzieh Pashmdarfard |
| collection | DOAJ |
| description | Fieldwork education is an integral part of the educational process in occupational therapy and assessing student competency at the end of fieldwork is important. The aim of this study was to design and conduct an Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF) for occupational therapy students on Level II fieldwork in Iran. A seven-station OSCE was designed and conducted with 13 students. Face and content validity of the exam scenarios and grading checklists was assessed via faculty review. The correlation between scores from each station and total OSCE scores were obtained to assess construct validity. Inter-rater reliability between two independent examiners at each OSCE station was determined. The participants’ (including both students and examiners) reactions to and learning from the exam was assessed using a self-report questionnaire that included participants' attitudes, satisfaction, and emotional response to the OSCE. Finally, a focus group of 12 examiners was conducted to examine the strengths and weaknesses of the exam. It was ascertained that the OSCE had good and acceptable face, content, and construct validity as well as inter-examiner reliability. All students reported that the exam was stressful, and most students (n=8, 61%) and examiners (n=5, 42%) reported there was not enough time for each station. Strength and weaknesses of the exam as related to the exam condition, exam content, students, and examiners were reported. Based on the qualitative and quantitative analysis of the results, in order to use OSCE as a method of evaluating occupational therapy students, some changes should be applied.
|
| first_indexed | 2024-04-13T09:33:13Z |
| format | Article |
| id | doaj.art-717585b834674f9f9603e7e9cb9cf55a |
| institution | Directory Open Access Journal |
| issn | 2573-1378 |
| language | English |
| last_indexed | 2024-04-13T09:33:13Z |
| publishDate | 2022-07-01 |
| publisher | Eastern Kentucky University |
| record_format | Article |
| series | Journal of Occupational Therapy Education |
| spelling | doaj.art-717585b834674f9f9603e7e9cb9cf55a2022-12-22T02:52:10ZengEastern Kentucky UniversityJournal of Occupational Therapy Education2573-13782022-07-016310.26681/jote.2022.060212Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot studyMarzieh Pashmdarfard0Afsoon Hassani Mehraban1Narges Shafaroodi2Kamran Soltani Arabshahi3Soroor Parvizy4Akram Azad5Samaneh Karamali Esmaeili6Shahid Beheshti University of Medical SciencesIran University of Medical SciencesIran University of Medical SciencesIran University of Medical SciencesIran University of Medical SciencesIran University of Medical SciencesIran University of Medical SciencesFieldwork education is an integral part of the educational process in occupational therapy and assessing student competency at the end of fieldwork is important. The aim of this study was to design and conduct an Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF) for occupational therapy students on Level II fieldwork in Iran. A seven-station OSCE was designed and conducted with 13 students. Face and content validity of the exam scenarios and grading checklists was assessed via faculty review. The correlation between scores from each station and total OSCE scores were obtained to assess construct validity. Inter-rater reliability between two independent examiners at each OSCE station was determined. The participants’ (including both students and examiners) reactions to and learning from the exam was assessed using a self-report questionnaire that included participants' attitudes, satisfaction, and emotional response to the OSCE. Finally, a focus group of 12 examiners was conducted to examine the strengths and weaknesses of the exam. It was ascertained that the OSCE had good and acceptable face, content, and construct validity as well as inter-examiner reliability. All students reported that the exam was stressful, and most students (n=8, 61%) and examiners (n=5, 42%) reported there was not enough time for each station. Strength and weaknesses of the exam as related to the exam condition, exam content, students, and examiners were reported. Based on the qualitative and quantitative analysis of the results, in order to use OSCE as a method of evaluating occupational therapy students, some changes should be applied. fieldworkoccupational therapyoscevalidityreliability |
| spellingShingle | Marzieh Pashmdarfard Afsoon Hassani Mehraban Narges Shafaroodi Kamran Soltani Arabshahi Soroor Parvizy Akram Azad Samaneh Karamali Esmaeili Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study Journal of Occupational Therapy Education fieldwork occupational therapy osce validity reliability |
| title | Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study |
| title_full | Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study |
| title_fullStr | Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study |
| title_full_unstemmed | Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study |
| title_short | Validation of Objective Structured Clinical Examination (OSCE) based on the Occupational Therapy Practice Framework (OTPF): A pilot study |
| title_sort | validation of objective structured clinical examination osce based on the occupational therapy practice framework otpf a pilot study |
| topic | fieldwork occupational therapy osce validity reliability |
| work_keys_str_mv | AT marziehpashmdarfard validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy AT afsoonhassanimehraban validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy AT nargesshafaroodi validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy AT kamransoltaniarabshahi validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy AT soroorparvizy validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy AT akramazad validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy AT samanehkaramaliesmaeili validationofobjectivestructuredclinicalexaminationoscebasedontheoccupationaltherapypracticeframeworkotpfapilotstudy |