Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning
The disease spots on the grape leaves can be detected by using the image processing and deep learning methods. However, the accuracy and efficiency of the detection are still the challenges. The convolutional substrate information is fuzzy, and the detection results are not satisfactory if the disea...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-06-01
|
| Series: | Frontiers in Plant Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpls.2021.695749/full |
| _version_ | 1818621462223781888 |
|---|---|
| author | Jiajun Zhu Man Cheng Qifan Wang Hongbo Yuan Zhenjiang Cai |
| author_facet | Jiajun Zhu Man Cheng Qifan Wang Hongbo Yuan Zhenjiang Cai |
| author_sort | Jiajun Zhu |
| collection | DOAJ |
| description | The disease spots on the grape leaves can be detected by using the image processing and deep learning methods. However, the accuracy and efficiency of the detection are still the challenges. The convolutional substrate information is fuzzy, and the detection results are not satisfactory if the disease spot is relatively small. In particular, the detection will be difficult if the number of pixels of the spot is <32 × 32 in the image. In order to effectively address this problem, we present a super-resolution image enhancement and convolutional neural network-based algorithm for the detection of black rot on grape leaves. First, the original image is up-sampled and enhanced with local details using the bilinear interpolation. As a result, the number of pixels in the image increase. Then, the enhanced images are fed into the proposed YOLOv3-SPP network for detection. In the proposed network, the IOU (Intersection Over Union, IOU) in the original YOLOv3 network is replaced with GIOU (Generalized Intersection Over Union, GIOU). In addition, we also add the SPP (Spatial Pyramid Pooling, SPP) module to improve the detection performance of the network. Finally, the official pre-trained weights of YOLOv3 are used for fast convergence. The test set test_pv from the Plant Village and the test set test_orchard from the orchard field were used to evaluate the network performance. The results of test_pv show that the grape leaf black rot is detected by the YOLOv3-SPP with 95.79% detection accuracy and 94.52% detector recall, which is a 5.94% greater in terms of accuracy and 10.67% greater in terms of recall as compared to the original YOLOv3. The results of test_orchard show that the method proposed in this paper can be applied in field environment with 86.69% detection precision and 82.27% detector recall, and the accuracy and recall were improved to 94.05 and 93.26% if the images with the simple background. Therefore, the detection method proposed in this work effectively solves the detection task of small targets and improves the detection effectiveness of the grape leaf black rot. |
| first_indexed | 2024-12-16T18:09:39Z |
| format | Article |
| id | doaj.art-7d339f3d102e4544bb257ff0b3daeccd |
| institution | Directory Open Access Journal |
| issn | 1664-462X |
| language | English |
| last_indexed | 2024-12-16T18:09:39Z |
| publishDate | 2021-06-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Plant Science |
| spelling | doaj.art-7d339f3d102e4544bb257ff0b3daeccd2022-12-21T22:21:49ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2021-06-011210.3389/fpls.2021.695749695749Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep LearningJiajun ZhuMan ChengQifan WangHongbo YuanZhenjiang CaiThe disease spots on the grape leaves can be detected by using the image processing and deep learning methods. However, the accuracy and efficiency of the detection are still the challenges. The convolutional substrate information is fuzzy, and the detection results are not satisfactory if the disease spot is relatively small. In particular, the detection will be difficult if the number of pixels of the spot is <32 × 32 in the image. In order to effectively address this problem, we present a super-resolution image enhancement and convolutional neural network-based algorithm for the detection of black rot on grape leaves. First, the original image is up-sampled and enhanced with local details using the bilinear interpolation. As a result, the number of pixels in the image increase. Then, the enhanced images are fed into the proposed YOLOv3-SPP network for detection. In the proposed network, the IOU (Intersection Over Union, IOU) in the original YOLOv3 network is replaced with GIOU (Generalized Intersection Over Union, GIOU). In addition, we also add the SPP (Spatial Pyramid Pooling, SPP) module to improve the detection performance of the network. Finally, the official pre-trained weights of YOLOv3 are used for fast convergence. The test set test_pv from the Plant Village and the test set test_orchard from the orchard field were used to evaluate the network performance. The results of test_pv show that the grape leaf black rot is detected by the YOLOv3-SPP with 95.79% detection accuracy and 94.52% detector recall, which is a 5.94% greater in terms of accuracy and 10.67% greater in terms of recall as compared to the original YOLOv3. The results of test_orchard show that the method proposed in this paper can be applied in field environment with 86.69% detection precision and 82.27% detector recall, and the accuracy and recall were improved to 94.05 and 93.26% if the images with the simple background. Therefore, the detection method proposed in this work effectively solves the detection task of small targets and improves the detection effectiveness of the grape leaf black rot.https://www.frontiersin.org/articles/10.3389/fpls.2021.695749/fullsmall targetsgrape black rotsuper-resolutionconvolutional neural networkdeep-learning |
| spellingShingle | Jiajun Zhu Man Cheng Qifan Wang Hongbo Yuan Zhenjiang Cai Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning Frontiers in Plant Science small targets grape black rot super-resolution convolutional neural network deep-learning |
| title | Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning |
| title_full | Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning |
| title_fullStr | Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning |
| title_full_unstemmed | Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning |
| title_short | Grape Leaf Black Rot Detection Based on Super-Resolution Image Enhancement and Deep Learning |
| title_sort | grape leaf black rot detection based on super resolution image enhancement and deep learning |
| topic | small targets grape black rot super-resolution convolutional neural network deep-learning |
| url | https://www.frontiersin.org/articles/10.3389/fpls.2021.695749/full |
| work_keys_str_mv | AT jiajunzhu grapeleafblackrotdetectionbasedonsuperresolutionimageenhancementanddeeplearning AT mancheng grapeleafblackrotdetectionbasedonsuperresolutionimageenhancementanddeeplearning AT qifanwang grapeleafblackrotdetectionbasedonsuperresolutionimageenhancementanddeeplearning AT hongboyuan grapeleafblackrotdetectionbasedonsuperresolutionimageenhancementanddeeplearning AT zhenjiangcai grapeleafblackrotdetectionbasedonsuperresolutionimageenhancementanddeeplearning |