Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification
Coffee leaf diseases can significantly impact the productivity and quality of the crops. Accurate and timely identification of these diseases is crucial for effective management and control. This paper proposes a hybrid feature fusion approach for identifying coffee leaf disease, including early and...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10154257/ |
| _version_ | 1797796508630777856 |
|---|---|
| author | Muhamad Faisal Jenq-Shiou Leu Jeremie T. Darmawan |
| author_facet | Muhamad Faisal Jenq-Shiou Leu Jeremie T. Darmawan |
| author_sort | Muhamad Faisal |
| collection | DOAJ |
| description | Coffee leaf diseases can significantly impact the productivity and quality of the crops. Accurate and timely identification of these diseases is crucial for effective management and control. This paper proposes a hybrid feature fusion approach for identifying coffee leaf disease, including early and late feature fusion. First, we propose several hybrid models to extract the information feature in the input images by combining MobileNetV3, Swin Transformer, and variational autoencoder (VAE). MobileNetV3, acting on the inductive bias of locality, can extract image features that are closer to one another (local features), while the Swin Transformer is able to extract feature interactions that are further apart (high-level features). These differently extracted features contain complementary information that enriches a unified feature map. Second, the extracted images from models are fused in the early fusion network. The early-fusion learner network is deployed to learn the rich information from the extracted feature. The late fusion network is implemented to comprehensively learn the fused feature before a classification network classifies coffee leaf diseases. The proposed hybrid feature fusion approach is evaluated on a challenging, real world Robusta Coffee Leaf (RoCoLe) dataset with various diseases, including red spider mite and leaf rust disease. The results show that our approach, the hybrid feature fusion of MobileNetV3 and Swin Transformer, outperforms the individual models with an accuracy of 84.29%. In conclusion, the hybrid feature fusion approach combining MobileNetV3 and Swin Transformer models is a promising approach for coffee leaf disease identification, providing accurate and timely diagnosis for effective management and control of the diseases in real-world conditions. |
| first_indexed | 2024-03-13T03:34:09Z |
| format | Article |
| id | doaj.art-2678871784a8418c874b3e95a5350e26 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T03:34:09Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-2678871784a8418c874b3e95a5350e262023-06-23T23:00:37ZengIEEEIEEE Access2169-35362023-01-0111622816229110.1109/ACCESS.2023.328693510154257Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease ClassificationMuhamad Faisal0https://orcid.org/0000-0002-9135-5864Jenq-Shiou Leu1https://orcid.org/0000-0001-7197-9912Jeremie T. Darmawan2https://orcid.org/0000-0001-9726-3613Department of Electronic and Computer Engineering (ECE), National Taiwan University of Science and Technology, Taipei, TaiwanDepartment of Electronic and Computer Engineering (ECE), National Taiwan University of Science and Technology, Taipei, TaiwanDepartment of Bioinformatics, Indonesia International Institute for Life Sciences, Jakarta, IndonesiaCoffee leaf diseases can significantly impact the productivity and quality of the crops. Accurate and timely identification of these diseases is crucial for effective management and control. This paper proposes a hybrid feature fusion approach for identifying coffee leaf disease, including early and late feature fusion. First, we propose several hybrid models to extract the information feature in the input images by combining MobileNetV3, Swin Transformer, and variational autoencoder (VAE). MobileNetV3, acting on the inductive bias of locality, can extract image features that are closer to one another (local features), while the Swin Transformer is able to extract feature interactions that are further apart (high-level features). These differently extracted features contain complementary information that enriches a unified feature map. Second, the extracted images from models are fused in the early fusion network. The early-fusion learner network is deployed to learn the rich information from the extracted feature. The late fusion network is implemented to comprehensively learn the fused feature before a classification network classifies coffee leaf diseases. The proposed hybrid feature fusion approach is evaluated on a challenging, real world Robusta Coffee Leaf (RoCoLe) dataset with various diseases, including red spider mite and leaf rust disease. The results show that our approach, the hybrid feature fusion of MobileNetV3 and Swin Transformer, outperforms the individual models with an accuracy of 84.29%. In conclusion, the hybrid feature fusion approach combining MobileNetV3 and Swin Transformer models is a promising approach for coffee leaf disease identification, providing accurate and timely diagnosis for effective management and control of the diseases in real-world conditions.https://ieeexplore.ieee.org/document/10154257/Coffee leaf disease classificationfeature fusionhybrid model |
| spellingShingle | Muhamad Faisal Jenq-Shiou Leu Jeremie T. Darmawan Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification IEEE Access Coffee leaf disease classification feature fusion hybrid model |
| title | Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification |
| title_full | Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification |
| title_fullStr | Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification |
| title_full_unstemmed | Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification |
| title_short | Model Selection of Hybrid Feature Fusion for Coffee Leaf Disease Classification |
| title_sort | model selection of hybrid feature fusion for coffee leaf disease classification |
| topic | Coffee leaf disease classification feature fusion hybrid model |
| url | https://ieeexplore.ieee.org/document/10154257/ |
| work_keys_str_mv | AT muhamadfaisal modelselectionofhybridfeaturefusionforcoffeeleafdiseaseclassification AT jenqshiouleu modelselectionofhybridfeaturefusionforcoffeeleafdiseaseclassification AT jeremietdarmawan modelselectionofhybridfeaturefusionforcoffeeleafdiseaseclassification |