Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning

Abstract Introduction Deep learning (DL) has been widely used to estimate clinical images. The objective of this project was to create DL models to predict the early postoperative visual acuity after small-incision lenticule extraction (SMILE) surgery. Methods We enrolled three independent patient c...

Full description

Bibliographic Details
Main Authors: Qi Wan, Shali Yue, Jing Tang, Ran Wei, Ke Ma, Hongbo Yin, Ying-ping Deng
Format: Article
Language:English
Published: Adis, Springer Healthcare 2023-02-01
Series:Ophthalmology and Therapy
Subjects:
Online Access:https://doi.org/10.1007/s40123-023-00680-6
_version_ 1797865396866383872
author Qi Wan
Shali Yue
Jing Tang
Ran Wei
Jing Tang
Ke Ma
Hongbo Yin
Ying-ping Deng
author_facet Qi Wan
Shali Yue
Jing Tang
Ran Wei
Jing Tang
Ke Ma
Hongbo Yin
Ying-ping Deng
author_sort Qi Wan
collection DOAJ
description Abstract Introduction Deep learning (DL) has been widely used to estimate clinical images. The objective of this project was to create DL models to predict the early postoperative visual acuity after small-incision lenticule extraction (SMILE) surgery. Methods We enrolled three independent patient cohorts (a retrospective cohort and two prospective SMILE cohorts) who underwent the SMILE refractive correction procedure at two different refractive surgery centers from July to September 2022. The medical records and surgical videos were collected for further analysis. Based on the uncorrected visual acuity (UCVA) at 24 h postsurgery, the eyes were divided into two groups: those showing good recovery and those showing poor recovery. We then trained a DL model (Resnet50) to predict eyes with early postoperative visual acuity of patients in the retrospective cohort who had undergone SMILE surgery from surgical videos and subsequently validated the model’s performance in the two prospective cohorts. Finally, Gradient-weighted Class Activation Mapping (Grad-CAM) was performed for interpretation of the model. Results Among the 318 eyes (159 patients) enrolled in the study, 10,176 good quality femtosecond laser scanning images were obtained from the surgical videos. We observed that the developed DL model achieved a high accuracy of 96% for image prediction. The area under the curve (AUC) value of the DL model in the retrospective cohort was 0.962 and 0.998 in the training and validation datasets, respectively. The AUC values in two prospective cohorts were 0.959 and 0.936. At the video level, the trained machine learning (ML) model (XGBoost) also accurately distinguished patients with good or poor recovery. The AUC value of the ML model was 0.998 and 0.889 in the retrospective cohort (training and test datasets, respectively) and 1.000 and 0.984 in the two prospective cohorts. We also trained a DL model which can accurately distinguish suction loss (100%), black spots (85%), and opaque bubble layer (96%). The Grad-CAM heatmap indicated that our models can recognize the area of scanning and precisely identify intraoperative complications. Conclusions Our findings suggest that artificial intelligence (DL and ML model) can accurately predict the early postoperative visual acuity and intraoperative complications after SMILE surgery just using surgical videos or images, which may display a great importance for artificial intelligence in application of refractive surgeries.
first_indexed 2024-04-09T23:07:19Z
format Article
id doaj.art-4d536cd951944189b59afa176246baab
institution Directory Open Access Journal
issn 2193-8245
2193-6528
language English
last_indexed 2024-04-09T23:07:19Z
publishDate 2023-02-01
publisher Adis, Springer Healthcare
record_format Article
series Ophthalmology and Therapy
spelling doaj.art-4d536cd951944189b59afa176246baab2023-03-22T10:36:28ZengAdis, Springer HealthcareOphthalmology and Therapy2193-82452193-65282023-02-011221263127910.1007/s40123-023-00680-6Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep LearningQi Wan0Shali Yue1Jing Tang2Ran Wei3Jing Tang4Ke Ma5Hongbo Yin6Ying-ping Deng7Department of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, The People’s Hospital of LeshanDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityDepartment of Ophthalmology, West China Hospital of Sichuan UniversityAbstract Introduction Deep learning (DL) has been widely used to estimate clinical images. The objective of this project was to create DL models to predict the early postoperative visual acuity after small-incision lenticule extraction (SMILE) surgery. Methods We enrolled three independent patient cohorts (a retrospective cohort and two prospective SMILE cohorts) who underwent the SMILE refractive correction procedure at two different refractive surgery centers from July to September 2022. The medical records and surgical videos were collected for further analysis. Based on the uncorrected visual acuity (UCVA) at 24 h postsurgery, the eyes were divided into two groups: those showing good recovery and those showing poor recovery. We then trained a DL model (Resnet50) to predict eyes with early postoperative visual acuity of patients in the retrospective cohort who had undergone SMILE surgery from surgical videos and subsequently validated the model’s performance in the two prospective cohorts. Finally, Gradient-weighted Class Activation Mapping (Grad-CAM) was performed for interpretation of the model. Results Among the 318 eyes (159 patients) enrolled in the study, 10,176 good quality femtosecond laser scanning images were obtained from the surgical videos. We observed that the developed DL model achieved a high accuracy of 96% for image prediction. The area under the curve (AUC) value of the DL model in the retrospective cohort was 0.962 and 0.998 in the training and validation datasets, respectively. The AUC values in two prospective cohorts were 0.959 and 0.936. At the video level, the trained machine learning (ML) model (XGBoost) also accurately distinguished patients with good or poor recovery. The AUC value of the ML model was 0.998 and 0.889 in the retrospective cohort (training and test datasets, respectively) and 1.000 and 0.984 in the two prospective cohorts. We also trained a DL model which can accurately distinguish suction loss (100%), black spots (85%), and opaque bubble layer (96%). The Grad-CAM heatmap indicated that our models can recognize the area of scanning and precisely identify intraoperative complications. Conclusions Our findings suggest that artificial intelligence (DL and ML model) can accurately predict the early postoperative visual acuity and intraoperative complications after SMILE surgery just using surgical videos or images, which may display a great importance for artificial intelligence in application of refractive surgeries.https://doi.org/10.1007/s40123-023-00680-6Deep learningMachine learningPredictionScanning imagesSMILE
spellingShingle Qi Wan
Shali Yue
Jing Tang
Ran Wei
Jing Tang
Ke Ma
Hongbo Yin
Ying-ping Deng
Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
Ophthalmology and Therapy
Deep learning
Machine learning
Prediction
Scanning images
SMILE
title Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
title_full Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
title_fullStr Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
title_full_unstemmed Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
title_short Prediction of Early Visual Outcome of Small-Incision Lenticule Extraction (SMILE) Based on Deep Learning
title_sort prediction of early visual outcome of small incision lenticule extraction smile based on deep learning
topic Deep learning
Machine learning
Prediction
Scanning images
SMILE
url https://doi.org/10.1007/s40123-023-00680-6
work_keys_str_mv AT qiwan predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT shaliyue predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT jingtang predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT ranwei predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT jingtang predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT kema predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT hongboyin predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning
AT yingpingdeng predictionofearlyvisualoutcomeofsmallincisionlenticuleextractionsmilebasedondeeplearning