Remote online open book examinations: through the lenses of faculty and students in health professions programmes
Abstract Background Open book examinations have been used to assess students’ higher order cognitive skills. These examinations can be conducted online remotely with the advancement of technology. However, there are concerns regarding its validity and reliability particularly if the examinations are...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-06-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12909-023-04368-0 |
| _version_ | 1797811402265591808 |
|---|---|
| author | Hui Meng Er Pei Se Wong Vishna Devi Nadarajah |
| author_facet | Hui Meng Er Pei Se Wong Vishna Devi Nadarajah |
| author_sort | Hui Meng Er |
| collection | DOAJ |
| description | Abstract Background Open book examinations have been used to assess students’ higher order cognitive skills. These examinations can be conducted online remotely with the advancement of technology. However, there are concerns regarding its validity and reliability particularly if the examinations are not proctored. The objective of this study was to explore the perceptions of faculty and students in health professions programmes about remote online open book examinations (ROOBE). Methods Semi-structured interviews were conducted among 22 faculty staff who were involved in ROOBE in health professions programmes. All interviews were audio recorded, transcribed verbatim and analysed using a thematic analysis approach. The perceptions of 249 medical students were obtained using an online questionnaire after they completed ROOBE. Results The faculty agreed that open book examinations could promote students’ higher order cognitive skills and reduce students’ stress. However, they were concerned about students’ academic integrity during non-invigilated ROOBE which could affect recognition by accreditation and professional bodies. The shift from traditional practice of closed-book examinations to ROOBE required change management with the support of guidelines and faculty training. Majority of the students claimed that the examinations were challenging as they assessed their ability to apply knowledge in real world problems. Nevertheless, they preferred ROOBE due to less anxiety and memorisation, and more emphasis on problem solving skills. The shortcomings were insufficient time for information searching during examinations and uncertainty in preparedness for future practice as they focused less on memorisation of factual knowledge during examination preparation. Cheating among peers and internet instability during non-invigilated ROOBE were the concerns highlighted by some students. Conclusions Faculty and students expressed favourable views about ROOBE in promoting higher order cognitive skills. Adequate technological support was essential during ROOBE. While there was a need to address issues related to academic integrity, ROOBE could be included as an authentic assessment within the systems of assessment. |
| first_indexed | 2024-03-13T07:23:08Z |
| format | Article |
| id | doaj.art-4ac833da42aa43c0aec590f4a2925f5f |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-03-13T07:23:08Z |
| publishDate | 2023-06-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-4ac833da42aa43c0aec590f4a2925f5f2023-06-04T11:31:40ZengBMCBMC Medical Education1472-69202023-06-0123111410.1186/s12909-023-04368-0Remote online open book examinations: through the lenses of faculty and students in health professions programmesHui Meng Er0Pei Se Wong1Vishna Devi Nadarajah2IMU Centre for Education and School of Pharmacy, International Medical UniversityIMU Centre for Education and School of Pharmacy, International Medical UniversityIMU Centre for Education and School of Medicine, International Medical UniversityAbstract Background Open book examinations have been used to assess students’ higher order cognitive skills. These examinations can be conducted online remotely with the advancement of technology. However, there are concerns regarding its validity and reliability particularly if the examinations are not proctored. The objective of this study was to explore the perceptions of faculty and students in health professions programmes about remote online open book examinations (ROOBE). Methods Semi-structured interviews were conducted among 22 faculty staff who were involved in ROOBE in health professions programmes. All interviews were audio recorded, transcribed verbatim and analysed using a thematic analysis approach. The perceptions of 249 medical students were obtained using an online questionnaire after they completed ROOBE. Results The faculty agreed that open book examinations could promote students’ higher order cognitive skills and reduce students’ stress. However, they were concerned about students’ academic integrity during non-invigilated ROOBE which could affect recognition by accreditation and professional bodies. The shift from traditional practice of closed-book examinations to ROOBE required change management with the support of guidelines and faculty training. Majority of the students claimed that the examinations were challenging as they assessed their ability to apply knowledge in real world problems. Nevertheless, they preferred ROOBE due to less anxiety and memorisation, and more emphasis on problem solving skills. The shortcomings were insufficient time for information searching during examinations and uncertainty in preparedness for future practice as they focused less on memorisation of factual knowledge during examination preparation. Cheating among peers and internet instability during non-invigilated ROOBE were the concerns highlighted by some students. Conclusions Faculty and students expressed favourable views about ROOBE in promoting higher order cognitive skills. Adequate technological support was essential during ROOBE. While there was a need to address issues related to academic integrity, ROOBE could be included as an authentic assessment within the systems of assessment.https://doi.org/10.1186/s12909-023-04368-0RemoteOnlineOpen bookExaminationHealth professions |
| spellingShingle | Hui Meng Er Pei Se Wong Vishna Devi Nadarajah Remote online open book examinations: through the lenses of faculty and students in health professions programmes BMC Medical Education Remote Online Open book Examination Health professions |
| title | Remote online open book examinations: through the lenses of faculty and students in health professions programmes |
| title_full | Remote online open book examinations: through the lenses of faculty and students in health professions programmes |
| title_fullStr | Remote online open book examinations: through the lenses of faculty and students in health professions programmes |
| title_full_unstemmed | Remote online open book examinations: through the lenses of faculty and students in health professions programmes |
| title_short | Remote online open book examinations: through the lenses of faculty and students in health professions programmes |
| title_sort | remote online open book examinations through the lenses of faculty and students in health professions programmes |
| topic | Remote Online Open book Examination Health professions |
| url | https://doi.org/10.1186/s12909-023-04368-0 |
| work_keys_str_mv | AT huimenger remoteonlineopenbookexaminationsthroughthelensesoffacultyandstudentsinhealthprofessionsprogrammes AT peisewong remoteonlineopenbookexaminationsthroughthelensesoffacultyandstudentsinhealthprofessionsprogrammes AT vishnadevinadarajah remoteonlineopenbookexaminationsthroughthelensesoffacultyandstudentsinhealthprofessionsprogrammes |