COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data
The global epidemic caused by COVID-19 has had a severe impact on the health of human beings. The virus has wreaked havoc throughout the world since its declaration as a worldwide pandemic and has affected an expanding number of nations in numerous countries around the world. Recently, a substantial...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-02-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/10/4/564 |
| _version_ | 1797478324896792576 |
|---|---|
| author | Ali Bou Nassif Ismail Shahin Mohamed Bader Abdelfatah Hassan Naoufel Werghi |
| author_facet | Ali Bou Nassif Ismail Shahin Mohamed Bader Abdelfatah Hassan Naoufel Werghi |
| author_sort | Ali Bou Nassif |
| collection | DOAJ |
| description | The global epidemic caused by COVID-19 has had a severe impact on the health of human beings. The virus has wreaked havoc throughout the world since its declaration as a worldwide pandemic and has affected an expanding number of nations in numerous countries around the world. Recently, a substantial amount of work has been done by doctors, scientists, and many others working on the frontlines to battle the effects of the spreading virus. The integration of artificial intelligence, specifically deep- and machine-learning applications, in the health sector has contributed substantially to the fight against COVID-19 by providing a modern innovative approach for detecting, diagnosing, treating, and preventing the virus. In this proposed work, we focus mainly on the role of the speech signal and/or image processing in detecting the presence of COVID-19. Three types of experiments have been conducted, utilizing speech-based, image-based, and speech and image-based models. Long short-term memory (LSTM) has been utilized for the speech classification of the patient’s cough, voice, and breathing, obtaining an accuracy that exceeds 98%. Moreover, CNN models VGG16, VGG19, Densnet201, ResNet50, Inceptionv3, InceptionResNetV2, and Xception have been benchmarked for the classification of chest X-ray images. The VGG16 model outperforms all other CNN models, achieving an accuracy of 85.25% without fine-tuning and 89.64% after performing fine-tuning techniques. Furthermore, the speech–image-based model has been evaluated using the same seven models, attaining an accuracy of 82.22% by the InceptionResNetV2 model. Accordingly, it is inessential for the combined speech–image-based model to be employed for diagnosis purposes since the speech-based and image-based models have each shown higher terms of accuracy than the combined model. |
| first_indexed | 2024-03-09T21:30:22Z |
| format | Article |
| id | doaj.art-520f476b796d4f74b09170ae17170b82 |
| institution | Directory Open Access Journal |
| issn | 2227-7390 |
| language | English |
| last_indexed | 2024-03-09T21:30:22Z |
| publishDate | 2022-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj.art-520f476b796d4f74b09170ae17170b822023-11-23T20:56:42ZengMDPI AGMathematics2227-73902022-02-0110456410.3390/math10040564COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image DataAli Bou Nassif0Ismail Shahin1Mohamed Bader2Abdelfatah Hassan3Naoufel Werghi4Centre for Data Analytics and Cybersecurity, Department of Computer Engineering, University of Sharjah, Sharjah 27272, United Arab EmiratesCentre for Data Analytics and Cybersecurity, Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab EmiratesCentre for Data Analytics and Cybersecurity, Department of Electrical Engineering, University of Sharjah, Sharjah 27272, United Arab EmiratesCenter for Cyber-Physical Systems, Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi 127788, United Arab EmiratesCenter for Cyber-Physical Systems, Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi 127788, United Arab EmiratesThe global epidemic caused by COVID-19 has had a severe impact on the health of human beings. The virus has wreaked havoc throughout the world since its declaration as a worldwide pandemic and has affected an expanding number of nations in numerous countries around the world. Recently, a substantial amount of work has been done by doctors, scientists, and many others working on the frontlines to battle the effects of the spreading virus. The integration of artificial intelligence, specifically deep- and machine-learning applications, in the health sector has contributed substantially to the fight against COVID-19 by providing a modern innovative approach for detecting, diagnosing, treating, and preventing the virus. In this proposed work, we focus mainly on the role of the speech signal and/or image processing in detecting the presence of COVID-19. Three types of experiments have been conducted, utilizing speech-based, image-based, and speech and image-based models. Long short-term memory (LSTM) has been utilized for the speech classification of the patient’s cough, voice, and breathing, obtaining an accuracy that exceeds 98%. Moreover, CNN models VGG16, VGG19, Densnet201, ResNet50, Inceptionv3, InceptionResNetV2, and Xception have been benchmarked for the classification of chest X-ray images. The VGG16 model outperforms all other CNN models, achieving an accuracy of 85.25% without fine-tuning and 89.64% after performing fine-tuning techniques. Furthermore, the speech–image-based model has been evaluated using the same seven models, attaining an accuracy of 82.22% by the InceptionResNetV2 model. Accordingly, it is inessential for the combined speech–image-based model to be employed for diagnosis purposes since the speech-based and image-based models have each shown higher terms of accuracy than the combined model.https://www.mdpi.com/2227-7390/10/4/564convolution neural networkCOVID-19deep learninglong short-term memoryMel-frequency cepstral coefficientsX-ray image |
| spellingShingle | Ali Bou Nassif Ismail Shahin Mohamed Bader Abdelfatah Hassan Naoufel Werghi COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data Mathematics convolution neural network COVID-19 deep learning long short-term memory Mel-frequency cepstral coefficients X-ray image |
| title | COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data |
| title_full | COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data |
| title_fullStr | COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data |
| title_full_unstemmed | COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data |
| title_short | COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data |
| title_sort | covid 19 detection systems using deep learning algorithms based on speech and image data |
| topic | convolution neural network COVID-19 deep learning long short-term memory Mel-frequency cepstral coefficients X-ray image |
| url | https://www.mdpi.com/2227-7390/10/4/564 |
| work_keys_str_mv | AT alibounassif covid19detectionsystemsusingdeeplearningalgorithmsbasedonspeechandimagedata AT ismailshahin covid19detectionsystemsusingdeeplearningalgorithmsbasedonspeechandimagedata AT mohamedbader covid19detectionsystemsusingdeeplearningalgorithmsbasedonspeechandimagedata AT abdelfatahhassan covid19detectionsystemsusingdeeplearningalgorithmsbasedonspeechandimagedata AT naoufelwerghi covid19detectionsystemsusingdeeplearningalgorithmsbasedonspeechandimagedata |