Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
Abstract Introduction Deep learning (DL) has been widely used to estimate clinical images. The objective of this project was to create DL models to predict the early postoperative visual acuity after small-incision lenticule extraction (SMILE) surgery. Methods We enrolled three independent patient c...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Adis, Springer Healthcare
2023-02-01
|
Series: | Ophthalmology and Therapy |
Subjects: | |
Online Access: | https://doi.org/10.1007/s40123-023-00680-6 |
_version_ | 1797865396866383872 |
---|---|
author | Qi Wan Shali Yue Jing Tang Ran Wei Jing Tang Ke Ma Hongbo Yin Ying-ping Deng |
author_facet | Qi Wan Shali Yue Jing Tang Ran Wei Jing Tang Ke Ma Hongbo Yin Ying-ping Deng |
author_sort | Qi Wan |
collection | DOAJ |
description | Abstract Introduction Deep learning (DL) has been widely used to estimate clinical images. The objective of this project was to create DL models to predict the early postoperative visual acuity after small-incision lenticule extraction (SMILE) surgery. Methods We enrolled three independent patient cohorts (a retrospective cohort and two prospective SMILE cohorts) who underwent the SMILE refractive correction procedure at two different refractive surgery centers from July to September 2022. The medical records and surgical videos were collected for further analysis. Based on the uncorrected visual acuity (UCVA) at 24 h postsurgery, the eyes were divided into two groups: those showing good recovery and those showing poor recovery. We then trained a DL model (Resnet50) to predict eyes with early postoperative visual acuity of patients in the retrospective cohort who had undergone SMILE surgery from surgical videos and subsequently validated the model’s performance in the two prospective cohorts. Finally, Gradient-weighted Class Activation Mapping (Grad-CAM) was performed for interpretation of the model. Results Among the 318 eyes (159 patients) enrolled in the study, 10,176 good quality femtosecond laser scanning images were obtained from the surgical videos. We observed that the developed DL model achieved a high accuracy of 96% for image prediction. The area under the curve (AUC) value of the DL model in the retrospective cohort was 0.962 and 0.998 in the training and validation datasets, respectively. The AUC values in two prospective cohorts were 0.959 and 0.936. At the video level, the trained machine learning (ML) model (XGBoost) also accurately distinguished patients with good or poor recovery. The AUC value of the ML model was 0.998 and 0.889 in the retrospective cohort (training and test datasets, respectively) and 1.000 and 0.984 in the two prospective cohorts. We also trained a DL model which can accurately distinguish suction loss (100%), black spots (85%), and opaque bubble layer (96%). The Grad-CAM heatmap indicated that our models can recognize the area of scanning and precisely identify intraoperative complications. Conclusions Our findings suggest that artificial intelligence (DL and ML model) can accurately predict the early postoperative visual acuity and intraoperative complications after SMILE surgery just using surgical videos or images, which may display a great importance for artificial intelligence in application of refractive surgeries. |
first_indexed | 2024-04-09T23:07:19Z |
format | Article |
id | doaj.art-4d536cd951944189b59afa176246baab |
institution | Directory Open Access Journal |
issn | 2193-8245 2193-6528 |
language | English |
last_indexed | 2024-04-09T23:07:19Z |
publishDate | 2023-02-01 |
publisher | Adis, Springer Healthcare |
record_format | Article |
series | Ophthalmology and Therapy |
spelling | doaj.art-4d536cd951944189b59afa176246baab2023-03-22T10:36:28ZengAdis, Springer HealthcareOphthalmology and Therapy2193-82452193-65282023-02-011221263127910.1007/s40123-023-00680-6Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep LearningQi Wan0Shali Yue1Jing Tang2Ran Wei3Jing Tang4Ke Ma5Hongbo Yin6Ying-ping Deng7Department of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, The People’s Hospital of LeshanDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityAbstract Introduction Deep learning (DL) has been widely used to estimate clinical images. The objective of this project was to create DL models to predict the early postoperative visual acuity after small-incision lenticule extraction (SMILE) surgery. Methods We enrolled three independent patient cohorts (a retrospective cohort and two prospective SMILE cohorts) who underwent the SMILE refractive correction procedure at two different refractive surgery centers from July to September 2022. The medical records and surgical videos were collected for further analysis. Based on the uncorrected visual acuity (UCVA) at 24 h postsurgery, the eyes were divided into two groups: those showing good recovery and those showing poor recovery. We then trained a DL model (Resnet50) to predict eyes with early postoperative visual acuity of patients in the retrospective cohort who had undergone SMILE surgery from surgical videos and subsequently validated the model’s performance in the two prospective cohorts. Finally, Gradient-weighted Class Activation Mapping (Grad-CAM) was performed for interpretation of the model. Results Among the 318 eyes (159 patients) enrolled in the study, 10,176 good quality femtosecond laser scanning images were obtained from the surgical videos. We observed that the developed DL model achieved a high accuracy of 96% for image prediction. The area under the curve (AUC) value of the DL model in the retrospective cohort was 0.962 and 0.998 in the training and validation datasets, respectively. The AUC values in two prospective cohorts were 0.959 and 0.936. At the video level, the trained machine learning (ML) model (XGBoost) also accurately distinguished patients with good or poor recovery. The AUC value of the ML model was 0.998 and 0.889 in the retrospective cohort (training and test datasets, respectively) and 1.000 and 0.984 in the two prospective cohorts. We also trained a DL model which can accurately distinguish suction loss (100%), black spots (85%), and opaque bubble layer (96%). The Grad-CAM heatmap indicated that our models can recognize the area of scanning and precisely identify intraoperative complications. Conclusions Our findings suggest that artificial intelligence (DL and ML model) can accurately predict the early postoperative visual acuity and intraoperative complications after SMILE surgery just using surgical videos or images, which may display a great importance for artificial intelligence in application of refractive surgeries.https://doi.org/10.1007/s40123-023-00680-6Deep learningMachine learningPredictionScanning imagesSMILE |
spellingShingle | Qi Wan Shali Yue Jing Tang Ran Wei Jing Tang Ke Ma Hongbo Yin Ying-ping Deng Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning Ophthalmology and Therapy Deep learning Machine learning Prediction Scanning images SMILE |
title | Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning |
title_full | Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning |
title_fullStr | Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning |
title_full_unstemmed | Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning |
title_short | Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning |
title_sort | prediction of early visual outcome of small incision lenticule extraction smile based on deep learning |
topic | Deep learning Machine learning Prediction Scanning images SMILE |
url | https://doi.org/10.1007/s40123-023-00680-6 |
work_keys_str_mv | AT qiwan predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT shaliyue predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT jingtang predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT ranwei predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT jingtang predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT kema predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT hongboyin predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning AT yingpingdeng predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning |