Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback

Abstract To test and evaluate the second installment of DENTIFY, a virtual reality haptic simulator for Operative Dentistry (OD), on preclinical dental students, by focusing on user performance and self-assessment. Twenty voluntary unpaid preclinical dental students, with different background experi...

Full description

Bibliographic Details
Main Authors: Pedro Rodrigues, Francisco Nicolau, Martim Norte, Ezequiel Zorzal, João Botelho, Vanessa Machado, Luís Proença, Ricardo Alves, Carlos Zagalo, Daniel Simões Lopes, José João Mendes
Format: Article
Language:English
Published: Nature Portfolio 2023-02-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-023-29537-5
_version_ 1827984722406408192
author Pedro Rodrigues
Francisco Nicolau
Martim Norte
Ezequiel Zorzal
João Botelho
Vanessa Machado
Luís Proença
Ricardo Alves
Carlos Zagalo
Daniel Simões Lopes
José João Mendes
author_facet Pedro Rodrigues
Francisco Nicolau
Martim Norte
Ezequiel Zorzal
João Botelho
Vanessa Machado
Luís Proença
Ricardo Alves
Carlos Zagalo
Daniel Simões Lopes
José João Mendes
author_sort Pedro Rodrigues
collection DOAJ
description Abstract To test and evaluate the second installment of DENTIFY, a virtual reality haptic simulator for Operative Dentistry (OD), on preclinical dental students, by focusing on user performance and self-assessment. Twenty voluntary unpaid preclinical dental students, with different background experience, were enrolled for this study. After the completion of an informed consent, a demographic questionnaire, and being introduced to the prototype (on the first testing session), three testing sessions followed (S1, S2, S3). Each session involved the following steps: (I) free experimentation; (II) task execution; S3 also included (III) completion of questionnaires associated with the experiment (total of 8 Self-Assessment Questions (SAQ)); and (IV) guided interview. As expected, drill time decreased steadily for all tasks when increasing prototype use, verified by RM ANOVA. Regarding performance metrics (Comparisons by Student’s t-test and ANOVA) recorded at S3, in overall, a higher performance was verified for participants with the following characteristics: female, non-gamer, no previous VR experience and with over 2 semesters of previous experience of working on phantom models. The correlation between the participants’ performance (drill time), for the four tasks, and user self-assessment evaluation, verified by Spearman’s rho analysis, allowed to conclude that a higher performance was observed in students who responded that DENTIFY improved their self perception of manual force applied. Regarding the questionnaires, Spearman’s rho analysis showed a positive correlation between the improvement DENTIFY inputs on conventional teaching sensed by students, also enhancing their interest in learning OD, their desire to have more simulator hours and the improvement sensed on manual dexterity. All participating students adhered well to the DENTIFY experimentation. DENTIFY allows for student self-assessment and contributes to improving student performance. Simulators with VR and haptic pens for teaching in OD should be designed as a consistent and gradual teaching strategy, allowing multiplicity of simulated scenarios, bimanual manipulation, and the possibility of real-time feedback to allow for the student’s immediate self-assessment. Additionally, they should create performance reports per student to ensure self-perception/criticism of their evolution over longer periods of learning time.
first_indexed 2024-04-09T23:02:51Z
format Article
id doaj.art-66c57d8dc68e4bdcb0bc7fcade80a8f0
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-04-09T23:02:51Z
publishDate 2023-02-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-66c57d8dc68e4bdcb0bc7fcade80a8f02023-03-22T10:51:19ZengNature PortfolioScientific Reports2045-23222023-02-0113111110.1038/s41598-023-29537-5Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedbackPedro Rodrigues0Francisco Nicolau1Martim Norte2Ezequiel Zorzal3João Botelho4Vanessa Machado5Luís Proença6Ricardo Alves7Carlos Zagalo8Daniel Simões Lopes9José João Mendes10Clinical Research Unit (CRU), Egas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceEgas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceEgas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceINESC IDClinical Research Unit (CRU), Egas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceClinical Research Unit (CRU), Egas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceEgas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceClinical Research Unit (CRU), Egas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceClinical Research Unit (CRU), Egas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceInstituto Superior Técnico, Universidade de LisboaClinical Research Unit (CRU), Egas Moniz Center for Interdisciplinary Research, Egas Moniz School of Health and ScienceAbstract To test and evaluate the second installment of DENTIFY, a virtual reality haptic simulator for Operative Dentistry (OD), on preclinical dental students, by focusing on user performance and self-assessment. Twenty voluntary unpaid preclinical dental students, with different background experience, were enrolled for this study. After the completion of an informed consent, a demographic questionnaire, and being introduced to the prototype (on the first testing session), three testing sessions followed (S1, S2, S3). Each session involved the following steps: (I) free experimentation; (II) task execution; S3 also included (III) completion of questionnaires associated with the experiment (total of 8 Self-Assessment Questions (SAQ)); and (IV) guided interview. As expected, drill time decreased steadily for all tasks when increasing prototype use, verified by RM ANOVA. Regarding performance metrics (Comparisons by Student’s t-test and ANOVA) recorded at S3, in overall, a higher performance was verified for participants with the following characteristics: female, non-gamer, no previous VR experience and with over 2 semesters of previous experience of working on phantom models. The correlation between the participants’ performance (drill time), for the four tasks, and user self-assessment evaluation, verified by Spearman’s rho analysis, allowed to conclude that a higher performance was observed in students who responded that DENTIFY improved their self perception of manual force applied. Regarding the questionnaires, Spearman’s rho analysis showed a positive correlation between the improvement DENTIFY inputs on conventional teaching sensed by students, also enhancing their interest in learning OD, their desire to have more simulator hours and the improvement sensed on manual dexterity. All participating students adhered well to the DENTIFY experimentation. DENTIFY allows for student self-assessment and contributes to improving student performance. Simulators with VR and haptic pens for teaching in OD should be designed as a consistent and gradual teaching strategy, allowing multiplicity of simulated scenarios, bimanual manipulation, and the possibility of real-time feedback to allow for the student’s immediate self-assessment. Additionally, they should create performance reports per student to ensure self-perception/criticism of their evolution over longer periods of learning time.https://doi.org/10.1038/s41598-023-29537-5
spellingShingle Pedro Rodrigues
Francisco Nicolau
Martim Norte
Ezequiel Zorzal
João Botelho
Vanessa Machado
Luís Proença
Ricardo Alves
Carlos Zagalo
Daniel Simões Lopes
José João Mendes
Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback
Scientific Reports
title Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback
title_full Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback
title_fullStr Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback
title_full_unstemmed Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback
title_short Preclinical dental students self-assessment of an improved operative dentistry virtual reality simulator with haptic feedback
title_sort preclinical dental students self assessment of an improved operative dentistry virtual reality simulator with haptic feedback
url https://doi.org/10.1038/s41598-023-29537-5
work_keys_str_mv AT pedrorodrigues preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT francisconicolau preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT martimnorte preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT ezequielzorzal preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT joaobotelho preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT vanessamachado preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT luisproenca preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT ricardoalves preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT carloszagalo preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT danielsimoeslopes preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback
AT josejoaomendes preclinicaldentalstudentsselfassessmentofanimprovedoperativedentistryvirtualrealitysimulatorwithhapticfeedback