Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification
Abstract Background Electron microscopy is important in the diagnosis of renal disease. For immune-mediated renal disease diagnosis, whether the electron-dense granule is present in the electron microscope image is of vital importance. Deep learning methods perform well at feature extraction and ass...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-05-01
|
| Series: | BMC Nephrology |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12882-023-03182-6 |
| _version_ | 1797827628242042880 |
|---|---|
| author | Jingyuan Zhang Aihua Zhang |
| author_facet | Jingyuan Zhang Aihua Zhang |
| author_sort | Jingyuan Zhang |
| collection | DOAJ |
| description | Abstract Background Electron microscopy is important in the diagnosis of renal disease. For immune-mediated renal disease diagnosis, whether the electron-dense granule is present in the electron microscope image is of vital importance. Deep learning methods perform well at feature extraction and assessment of histologic images. However, few studies on deep learning methods for electron microscopy images of renal biopsy have been published. This study aimed to develop a deep learning-based multi-model to automatically detect whether the electron-dense granule is present in the TEM image of renal biopsy, and then help diagnose immune-mediated renal disease. Methods Three deep learning models are trained to classify whether the electron-dense granule is present using 910 electron microscopy images of renal biopsies. We proposed two novel methods to improve the model accuracy. One model uses the pre-trained ResNet convolutional layers for feature extraction with transfer learning which was firstly improved with skip architecture, then uses Support Vector Machine as the classifier. We developed a multi-model to combine the traditional ResNet model with the improved one to further improve the accuracy. Results Deep learning-based multi-model has the highest model accuracy, and the average accuracy is about 88%. The improved ReseNet + SVM model performance is much better than the traditional ResNet model. The average accuracy of the improved ResNet + SVM model is 83%, while the traditional ResNet model accuracy is only 58%. Conclusions This study presents the first models for electron microscopy image classification of Renal Biopsy. Identifying whether the electron-dense granule is present plays an important role in the diagnosis of immune complex nephropathy. This study made it possible for Artificial Intelligence models assist to analyze complex electron microscopy images for disease diagnosis. |
| first_indexed | 2024-04-09T12:51:23Z |
| format | Article |
| id | doaj.art-2c9f4d13520e49e8b6d7993d001dfaef |
| institution | Directory Open Access Journal |
| issn | 1471-2369 |
| language | English |
| last_indexed | 2024-04-09T12:51:23Z |
| publishDate | 2023-05-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Nephrology |
| spelling | doaj.art-2c9f4d13520e49e8b6d7993d001dfaef2023-05-14T11:11:07ZengBMCBMC Nephrology1471-23692023-05-0124111210.1186/s12882-023-03182-6Deep learning-based multi-model approach on electron microscopy image of renal biopsy classificationJingyuan Zhang0Aihua Zhang1Children’s Hospital of Nanjing Medical UniversityChildren’s Hospital of Nanjing Medical UniversityAbstract Background Electron microscopy is important in the diagnosis of renal disease. For immune-mediated renal disease diagnosis, whether the electron-dense granule is present in the electron microscope image is of vital importance. Deep learning methods perform well at feature extraction and assessment of histologic images. However, few studies on deep learning methods for electron microscopy images of renal biopsy have been published. This study aimed to develop a deep learning-based multi-model to automatically detect whether the electron-dense granule is present in the TEM image of renal biopsy, and then help diagnose immune-mediated renal disease. Methods Three deep learning models are trained to classify whether the electron-dense granule is present using 910 electron microscopy images of renal biopsies. We proposed two novel methods to improve the model accuracy. One model uses the pre-trained ResNet convolutional layers for feature extraction with transfer learning which was firstly improved with skip architecture, then uses Support Vector Machine as the classifier. We developed a multi-model to combine the traditional ResNet model with the improved one to further improve the accuracy. Results Deep learning-based multi-model has the highest model accuracy, and the average accuracy is about 88%. The improved ReseNet + SVM model performance is much better than the traditional ResNet model. The average accuracy of the improved ResNet + SVM model is 83%, while the traditional ResNet model accuracy is only 58%. Conclusions This study presents the first models for electron microscopy image classification of Renal Biopsy. Identifying whether the electron-dense granule is present plays an important role in the diagnosis of immune complex nephropathy. This study made it possible for Artificial Intelligence models assist to analyze complex electron microscopy images for disease diagnosis.https://doi.org/10.1186/s12882-023-03182-6BiopsyDeep LearningDiagnostic ImagingModelRenal |
| spellingShingle | Jingyuan Zhang Aihua Zhang Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification BMC Nephrology Biopsy Deep Learning Diagnostic Imaging Model Renal |
| title | Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification |
| title_full | Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification |
| title_fullStr | Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification |
| title_full_unstemmed | Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification |
| title_short | Deep learning-based multi-model approach on electron microscopy image of renal biopsy classification |
| title_sort | deep learning based multi model approach on electron microscopy image of renal biopsy classification |
| topic | Biopsy Deep Learning Diagnostic Imaging Model Renal |
| url | https://doi.org/10.1186/s12882-023-03182-6 |
| work_keys_str_mv | AT jingyuanzhang deeplearningbasedmultimodelapproachonelectronmicroscopyimageofrenalbiopsyclassification AT aihuazhang deeplearningbasedmultimodelapproachonelectronmicroscopyimageofrenalbiopsyclassification |