Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system
Statement of problem: The development of facial scanners has improved capabilities to create three-dimensional (3D) virtual patients for accurate facial and smile analysis. However, most of these scanners are expensive, stationary and involve a significant clinical footprint. The use of the Apple iP...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-05-01
|
| Series: | Heliyon |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2405844023030414 |
| _version_ | 1797815673433358336 |
|---|---|
| author | James Andrews Abdulraheem Alwafi Yashodhan M. Bichu Benjamin T. Pliska Nesrine Mostafa Bingshuang Zou |
| author_facet | James Andrews Abdulraheem Alwafi Yashodhan M. Bichu Benjamin T. Pliska Nesrine Mostafa Bingshuang Zou |
| author_sort | James Andrews |
| collection | DOAJ |
| description | Statement of problem: The development of facial scanners has improved capabilities to create three-dimensional (3D) virtual patients for accurate facial and smile analysis. However, most of these scanners are expensive, stationary and involve a significant clinical footprint. The use of the Apple iPhone and its integrated “TrueDepth” near-infrared (NIR) scanner combined with an image processing application (app) offers the potential to capture and analyze the unique 3D nature of the face; the accuracy and reliability of which are yet to be established for use in clinical dentistry. Purpose: This study was designed to validate both the trueness and precision of the iPhone 11 Pro smartphone TrueDepth NIR scanner in conjunction with the Bellus3D Face app in capturing 3D facial images in a sample of adult participants in comparison to the conventional 3dMDface stereophotogrammetry system. Material and methods: Twenty-nine adult participants were prospectively recruited. Eighteen soft tissue landmarks were marked on each participant's face before imaging. 3D facial images were captured using a 3dMDface system and the Apple iPhone TrueDepth NIR scanner combined with the Bellus3D Face app respectively. The best fit of each experimental model to the 3dMD scan was analyzed using Geomagic Control X software. The root mean square (RMS) was used to measure the “trueness” as the absolute deviation of each TrueDepth scan from the reference 3dMD image. Individual facial landmark deviations were also assessed to evaluate the reliability in different craniofacial regions. The “precision” of the smartphone was tested by taking 10 consecutive scans of the same subject and comparing those to the reference scan. Intra-observer and inter-observer reliabilities were assessed using the intra-class correlation coefficient (ICC). Results: Relative to the 3dMDface system, the mean RMS difference of the iPhone/Bellus3D app was 0.86 ± 0.31 mm. 97% of all the landmarks were within 2 mm of error compared with the reference data. The ICC for intra-observer reproducibility or precision of the iPhone/Bellus3D app was 0.96, which was classified as excellent. The ICC for inter-observer reliability was 0.84, which was classified as good. Conclusions: These results suggest that 3D facial images acquired with this system, the iPhone TrueDepth NIR camera in conjunction with the Bellus3D Face app, are clinically accurate and reliable. Judicious use is advised in clinical situations that require high degrees of detail due to a lack of image resolution and a longer acquisition time. Generally, this system possesses the potential to serve as a practical alternative to conventional stereophotogrammetry systems for use in a clinical setting due to its accessibility and relative ease of use and further research is planned to appraise its updated clinical use. |
| first_indexed | 2024-03-13T08:26:17Z |
| format | Article |
| id | doaj.art-dd7bd738e3ff42a094f9ff97aaae512c |
| institution | Directory Open Access Journal |
| issn | 2405-8440 |
| language | English |
| last_indexed | 2024-03-13T08:26:17Z |
| publishDate | 2023-05-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Heliyon |
| spelling | doaj.art-dd7bd738e3ff42a094f9ff97aaae512c2023-05-31T04:45:42ZengElsevierHeliyon2405-84402023-05-0195e15834Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry systemJames Andrews0Abdulraheem Alwafi1Yashodhan M. Bichu2Benjamin T. Pliska3Nesrine Mostafa4Bingshuang Zou5Graduate Orthodontics, Department of Oral Health Science, Faculty of Dentistry, University of British Columbia, Vancouver, CanadaFaculty of Dentistry, Department of Dental Public Health, King Abdulaziz University, Jeddah, Saudi ArabiaPrivate Practice, Abu Dhabi, United Arab EmiratesDepartment of Oral Health Science, Faculty of Dentistry, University of British Columbia, Vancouver, CanadaDepartment of Oral Health Science, Faculty of Dentistry, University of British Columbia, Vancouver, CanadaDepartment of Oral Health Science, Faculty of Dentistry, University of British Columbia, Vancouver, Canada; Corresponding author. Department of Oral Health Science, Faculty of Dentistry, University of British Columbia 2199 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada.Statement of problem: The development of facial scanners has improved capabilities to create three-dimensional (3D) virtual patients for accurate facial and smile analysis. However, most of these scanners are expensive, stationary and involve a significant clinical footprint. The use of the Apple iPhone and its integrated “TrueDepth” near-infrared (NIR) scanner combined with an image processing application (app) offers the potential to capture and analyze the unique 3D nature of the face; the accuracy and reliability of which are yet to be established for use in clinical dentistry. Purpose: This study was designed to validate both the trueness and precision of the iPhone 11 Pro smartphone TrueDepth NIR scanner in conjunction with the Bellus3D Face app in capturing 3D facial images in a sample of adult participants in comparison to the conventional 3dMDface stereophotogrammetry system. Material and methods: Twenty-nine adult participants were prospectively recruited. Eighteen soft tissue landmarks were marked on each participant's face before imaging. 3D facial images were captured using a 3dMDface system and the Apple iPhone TrueDepth NIR scanner combined with the Bellus3D Face app respectively. The best fit of each experimental model to the 3dMD scan was analyzed using Geomagic Control X software. The root mean square (RMS) was used to measure the “trueness” as the absolute deviation of each TrueDepth scan from the reference 3dMD image. Individual facial landmark deviations were also assessed to evaluate the reliability in different craniofacial regions. The “precision” of the smartphone was tested by taking 10 consecutive scans of the same subject and comparing those to the reference scan. Intra-observer and inter-observer reliabilities were assessed using the intra-class correlation coefficient (ICC). Results: Relative to the 3dMDface system, the mean RMS difference of the iPhone/Bellus3D app was 0.86 ± 0.31 mm. 97% of all the landmarks were within 2 mm of error compared with the reference data. The ICC for intra-observer reproducibility or precision of the iPhone/Bellus3D app was 0.96, which was classified as excellent. The ICC for inter-observer reliability was 0.84, which was classified as good. Conclusions: These results suggest that 3D facial images acquired with this system, the iPhone TrueDepth NIR camera in conjunction with the Bellus3D Face app, are clinically accurate and reliable. Judicious use is advised in clinical situations that require high degrees of detail due to a lack of image resolution and a longer acquisition time. Generally, this system possesses the potential to serve as a practical alternative to conventional stereophotogrammetry systems for use in a clinical setting due to its accessibility and relative ease of use and further research is planned to appraise its updated clinical use.http://www.sciencedirect.com/science/article/pii/S24058440230304143D facial imagingSmartphoneValidationTrueDepth scannerStereophotogrammetry |
| spellingShingle | James Andrews Abdulraheem Alwafi Yashodhan M. Bichu Benjamin T. Pliska Nesrine Mostafa Bingshuang Zou Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system Heliyon 3D facial imaging Smartphone Validation TrueDepth scanner Stereophotogrammetry |
| title | Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system |
| title_full | Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system |
| title_fullStr | Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system |
| title_full_unstemmed | Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system |
| title_short | Validation of three-dimensional facial imaging captured with smartphone-based photogrammetry application in comparison to stereophotogrammetry system |
| title_sort | validation of three dimensional facial imaging captured with smartphone based photogrammetry application in comparison to stereophotogrammetry system |
| topic | 3D facial imaging Smartphone Validation TrueDepth scanner Stereophotogrammetry |
| url | http://www.sciencedirect.com/science/article/pii/S2405844023030414 |
| work_keys_str_mv | AT jamesandrews validationofthreedimensionalfacialimagingcapturedwithsmartphonebasedphotogrammetryapplicationincomparisontostereophotogrammetrysystem AT abdulraheemalwafi validationofthreedimensionalfacialimagingcapturedwithsmartphonebasedphotogrammetryapplicationincomparisontostereophotogrammetrysystem AT yashodhanmbichu validationofthreedimensionalfacialimagingcapturedwithsmartphonebasedphotogrammetryapplicationincomparisontostereophotogrammetrysystem AT benjamintpliska validationofthreedimensionalfacialimagingcapturedwithsmartphonebasedphotogrammetryapplicationincomparisontostereophotogrammetrysystem AT nesrinemostafa validationofthreedimensionalfacialimagingcapturedwithsmartphonebasedphotogrammetryapplicationincomparisontostereophotogrammetrysystem AT bingshuangzou validationofthreedimensionalfacialimagingcapturedwithsmartphonebasedphotogrammetryapplicationincomparisontostereophotogrammetrysystem |