Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland
<italic>Rumex obtusifolius</italic> Linnaeus (<italic>R. obtu.</italic> L.) is one of the vital broad-leaved weeds in grassland that needs removal. It affects dairy products and reduces their quality. Hand-removal methods are costly and time-consuming. Chemical treatment usin...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9864151/ |
| _version_ | 1797998977068564480 |
|---|---|
| author | Ahmed Husham Al-Badri Nor Azman Ismail Khamael Al-Dulaimi Amjad Rehman Ibrahim Abunadi Saeed Ali Bahaj |
| author_facet | Ahmed Husham Al-Badri Nor Azman Ismail Khamael Al-Dulaimi Amjad Rehman Ibrahim Abunadi Saeed Ali Bahaj |
| author_sort | Ahmed Husham Al-Badri |
| collection | DOAJ |
| description | <italic>Rumex obtusifolius</italic> Linnaeus (<italic>R. obtu.</italic> L.) is one of the vital broad-leaved weeds in grassland that needs removal. It affects dairy products and reduces their quality. Hand-removal methods are costly and time-consuming. Chemical treatment using herbicides has a negative impact on crops and causes environmental pollution. In smart farming, weeding is performed by using computer vision to recognize the weeds efficiently and effectively. Conventional machine learning (ML)-based algorithms face challenges, especially in identifying the weeds in real-world data due to a lack of features. Deep learning (DL) approaches use self-learning to extract all potential features that assist in classifying malignant weed species accurately. Recently, single deep learning methods achieved high performance in identifying well-separated and illumination but suffered from misclassification in more sophisticated cases such as overlapping and partial occlusion leaves. This paper presents a hybrid Convolutional Neural Network (CNN) model of three state-of-the-art CNNs to classify <italic>Rumex obtusifolius</italic>. The proposed model utilizes convolutional neural networks to extract features and classify images. The framework of the proposed method comprises three paramount stages to accomplish the classification key idea, including the data preparation phase, pre-processing phase, and classification phase. A hybrid model of three CNN extractor networks is used as the backbone in the classification stage. Our tested data is real-world data that includes multi-circumstances (overlap, occlusion, various illuminations, etc.) acquired from nature. The first extractor is the Visual Graphics Group-16 (VGG-16) for well-separated leaves and non-complicated issues. The second extractor is Residential Energy Services Network-50 (ResNet-50), to overcome complex real-world issues. The third extractor is Inception-v3 to solve the illumination problem. Therefore, combining three networks into one model improves the discriminatory ability to extract additional useful features. The proposed model has been tested using two benchmark datasets for <italic>Rumex</italic> weed plants. Both of these datasets were captured in real-world environments. The first dataset consists of 900 samples, while the second dataset consists of 677 samples. Each dataset is individually tested in the proposed model to evaluate the classification accuracy using a set of standard evaluation metrics including accuracy, precession, recall, True-Positive Rate (TPR), False-Positive Rate (FPR), and F1-score. The total averages of the proposed model on both datasets are 97.51%, 97.4%, 94.45%, and 95.9% on the accuracy, recall, precision, and F1-score, respectively. |
| first_indexed | 2024-04-11T10:57:23Z |
| format | Article |
| id | doaj.art-61e62b2d61e84411944c6fb64d281bd4 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-11T10:57:23Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-61e62b2d61e84411944c6fb64d281bd42022-12-22T04:28:43ZengIEEEIEEE Access2169-35362022-01-0110909409095710.1109/ACCESS.2022.32006039864151Hybrid CNN Model for Classification of Rumex Obtusifolius in GrasslandAhmed Husham Al-Badri0https://orcid.org/0000-0003-2919-1704Nor Azman Ismail1https://orcid.org/0000-0003-1785-008XKhamael Al-Dulaimi2https://orcid.org/0000-0001-7248-7522Amjad Rehman3https://orcid.org/0000-0002-3817-2655Ibrahim Abunadi4https://orcid.org/0000-0002-2546-2450Saeed Ali Bahaj5https://orcid.org/0000-0003-3406-4320School of Computing, Faculty of Engineering, Universiti Teknologi Malaysia, Johor Bahru, MalaysiaSchool of Computing, Faculty of Engineering, Universiti Teknologi Malaysia, Johor Bahru, MalaysiaComputer Science Department, College of Science, Al-Nahrain University, Baghdad, IraqArtificial Intelligence and Data Analytics Laboratory, CCIS, Prince Sultan University, Riyadh, Saudi ArabiaArtificial Intelligence and Data Analytics Laboratory, CCIS, Prince Sultan University, Riyadh, Saudi ArabiaMIS Department, College of Business Administration, Prince Sattam bin Abdulaziz University, Al-Kharj, Saudi Arabia<italic>Rumex obtusifolius</italic> Linnaeus (<italic>R. obtu.</italic> L.) is one of the vital broad-leaved weeds in grassland that needs removal. It affects dairy products and reduces their quality. Hand-removal methods are costly and time-consuming. Chemical treatment using herbicides has a negative impact on crops and causes environmental pollution. In smart farming, weeding is performed by using computer vision to recognize the weeds efficiently and effectively. Conventional machine learning (ML)-based algorithms face challenges, especially in identifying the weeds in real-world data due to a lack of features. Deep learning (DL) approaches use self-learning to extract all potential features that assist in classifying malignant weed species accurately. Recently, single deep learning methods achieved high performance in identifying well-separated and illumination but suffered from misclassification in more sophisticated cases such as overlapping and partial occlusion leaves. This paper presents a hybrid Convolutional Neural Network (CNN) model of three state-of-the-art CNNs to classify <italic>Rumex obtusifolius</italic>. The proposed model utilizes convolutional neural networks to extract features and classify images. The framework of the proposed method comprises three paramount stages to accomplish the classification key idea, including the data preparation phase, pre-processing phase, and classification phase. A hybrid model of three CNN extractor networks is used as the backbone in the classification stage. Our tested data is real-world data that includes multi-circumstances (overlap, occlusion, various illuminations, etc.) acquired from nature. The first extractor is the Visual Graphics Group-16 (VGG-16) for well-separated leaves and non-complicated issues. The second extractor is Residential Energy Services Network-50 (ResNet-50), to overcome complex real-world issues. The third extractor is Inception-v3 to solve the illumination problem. Therefore, combining three networks into one model improves the discriminatory ability to extract additional useful features. The proposed model has been tested using two benchmark datasets for <italic>Rumex</italic> weed plants. Both of these datasets were captured in real-world environments. The first dataset consists of 900 samples, while the second dataset consists of 677 samples. Each dataset is individually tested in the proposed model to evaluate the classification accuracy using a set of standard evaluation metrics including accuracy, precession, recall, True-Positive Rate (TPR), False-Positive Rate (FPR), and F1-score. The total averages of the proposed model on both datasets are 97.51%, 97.4%, 94.45%, and 95.9% on the accuracy, recall, precision, and F1-score, respectively.https://ieeexplore.ieee.org/document/9864151/CNN networksensemble modelsreal-world dataweed classificationeconomic growth |
| spellingShingle | Ahmed Husham Al-Badri Nor Azman Ismail Khamael Al-Dulaimi Amjad Rehman Ibrahim Abunadi Saeed Ali Bahaj Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland IEEE Access CNN networks ensemble models real-world data weed classification economic growth |
| title | Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland |
| title_full | Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland |
| title_fullStr | Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland |
| title_full_unstemmed | Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland |
| title_short | Hybrid CNN Model for Classification of Rumex Obtusifolius in Grassland |
| title_sort | hybrid cnn model for classification of rumex obtusifolius in grassland |
| topic | CNN networks ensemble models real-world data weed classification economic growth |
| url | https://ieeexplore.ieee.org/document/9864151/ |
| work_keys_str_mv | AT ahmedhushamalbadri hybridcnnmodelforclassificationofrumexobtusifoliusingrassland AT norazmanismail hybridcnnmodelforclassificationofrumexobtusifoliusingrassland AT khamaelaldulaimi hybridcnnmodelforclassificationofrumexobtusifoliusingrassland AT amjadrehman hybridcnnmodelforclassificationofrumexobtusifoliusingrassland AT ibrahimabunadi hybridcnnmodelforclassificationofrumexobtusifoliusingrassland AT saeedalibahaj hybridcnnmodelforclassificationofrumexobtusifoliusingrassland |