Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks

Identifying and analyzing mixed pathogenic bacteria is important for clinical diagnosis and antibiotic therapy of multiple bacterial infection. In this paper, a dual-mode hyperspectral microscopic detection technology with hybrid deep neural networks (DNNs) was proposed for simultaneous quantitative...

Full description

Bibliographic Details
Main Authors: He Zhu, Jing Luo, Sailing He
Format: Article
Language:English
Published: MDPI AG 2024-02-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/14/4/1525
_version_ 1797299013983141888
author He Zhu
Jing Luo
Sailing He
author_facet He Zhu
Jing Luo
Sailing He
author_sort He Zhu
collection DOAJ
description Identifying and analyzing mixed pathogenic bacteria is important for clinical diagnosis and antibiotic therapy of multiple bacterial infection. In this paper, a dual-mode hyperspectral microscopic detection technology with hybrid deep neural networks (DNNs) was proposed for simultaneous quantitative analysis of four kinds of pathogenic bacteria in mixed samples. To acquire both transmission and fluorescence spectra regarding the mixed pathogens, we developed a dual-mode hyperspectral detection system with fine spectral resolution and wide wavelength range, which can also generate spatial images that can be used to calculate the total amount of mixed bacteria. The dual-mode spectra were regarded as mixed proportion characteristics and the input of the neural network for predicting the proportion of each bacterium present in the mixture. To better analyze the dual-mode spectral data, we customized a mixed bacteria measurement network (MB-Net) with hybrid DNNs architectures based on spectral feature fusion. Using the fusion strategy, two DNNs frameworks applied for transmission/fluorescence spectral feature processing were stacked to form the MB-Net that processes these features simultaneously, and the achieved average coefficient of determination (<i>R</i><sup>2</sup>) and RMSE of validation set are 0.96 and 0.03, respectively. To the best of our knowledge, it is the first time of simultaneously detecting four types of mixed pathogenic bacteria using spectral detection technology, showing excellent potential in clinical practice.
first_indexed 2024-03-07T22:43:25Z
format Article
id doaj.art-4278042e3f9148588aeadac52a5f79dc
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-07T22:43:25Z
publishDate 2024-02-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-4278042e3f9148588aeadac52a5f79dc2024-02-23T15:06:17ZengMDPI AGApplied Sciences2076-34172024-02-01144152510.3390/app14041525Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural NetworksHe Zhu0Jing Luo1Sailing He2Centre for Optical and Electromagnetic Research, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, ChinaCentre for Optical and Electromagnetic Research, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, ChinaCentre for Optical and Electromagnetic Research, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, ChinaIdentifying and analyzing mixed pathogenic bacteria is important for clinical diagnosis and antibiotic therapy of multiple bacterial infection. In this paper, a dual-mode hyperspectral microscopic detection technology with hybrid deep neural networks (DNNs) was proposed for simultaneous quantitative analysis of four kinds of pathogenic bacteria in mixed samples. To acquire both transmission and fluorescence spectra regarding the mixed pathogens, we developed a dual-mode hyperspectral detection system with fine spectral resolution and wide wavelength range, which can also generate spatial images that can be used to calculate the total amount of mixed bacteria. The dual-mode spectra were regarded as mixed proportion characteristics and the input of the neural network for predicting the proportion of each bacterium present in the mixture. To better analyze the dual-mode spectral data, we customized a mixed bacteria measurement network (MB-Net) with hybrid DNNs architectures based on spectral feature fusion. Using the fusion strategy, two DNNs frameworks applied for transmission/fluorescence spectral feature processing were stacked to form the MB-Net that processes these features simultaneously, and the achieved average coefficient of determination (<i>R</i><sup>2</sup>) and RMSE of validation set are 0.96 and 0.03, respectively. To the best of our knowledge, it is the first time of simultaneously detecting four types of mixed pathogenic bacteria using spectral detection technology, showing excellent potential in clinical practice.https://www.mdpi.com/2076-3417/14/4/1525hyperspectral detectiondeep learningmixed bacteria detection
spellingShingle He Zhu
Jing Luo
Sailing He
Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks
Applied Sciences
hyperspectral detection
deep learning
mixed bacteria detection
title Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks
title_full Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks
title_fullStr Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks
title_full_unstemmed Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks
title_short Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks
title_sort detecting multiple mixed bacteria using dual mode hyperspectral imaging and deep neural networks
topic hyperspectral detection
deep learning
mixed bacteria detection
url https://www.mdpi.com/2076-3417/14/4/1525
work_keys_str_mv AT hezhu detectingmultiplemixedbacteriausingdualmodehyperspectralimaginganddeepneuralnetworks
AT jingluo detectingmultiplemixedbacteriausingdualmodehyperspectralimaginganddeepneuralnetworks
AT sailinghe detectingmultiplemixedbacteriausingdualmodehyperspectralimaginganddeepneuralnetworks