Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks
Classification of plants based on a multi-organ approach is very challenging. Although additional data provide more information that might help to disambiguate between species, the variability in shape and appearance in plant organs also raises the degree of complexity of the problem. Despite promis...
| Hauptverfasser: | , , |
|---|---|
| Format: | Artikel |
| Veröffentlicht: |
Institute of Electrical and Electronics Engineers
2018
|
| Schlagworte: |
| _version_ | 1825721699112321024 |
|---|---|
| author | Lee, Sue Han Chan, Chee Seng Remagnino, Paolo |
| author_facet | Lee, Sue Han Chan, Chee Seng Remagnino, Paolo |
| author_sort | Lee, Sue Han |
| collection | UM |
| description | Classification of plants based on a multi-organ approach is very challenging. Although additional data provide more information that might help to disambiguate between species, the variability in shape and appearance in plant organs also raises the degree of complexity of the problem. Despite promising solutions built using deep learning enable representative features to be learned for plant images, the existing approaches focus mainly on generic features for species classification, disregarding the features representing plant organs. In fact, plants are complex living organisms sustained by a number of organ systems. In our approach, we introduce a hybrid generic-organ convolutional neural network (HGO-CNN), which takes into account both organ and generic information, combining them using a new feature fusion scheme for species classification. Next, instead of using a CNN-based method to operate on one image with a single organ, we extend our approach. We propose a new framework for plant structural learning using the recurrent neural network-based method. This novel approach supports classification based on a varying number of plant views, capturing one or more organs of a plant, by optimizing the contextual dependencies between them. We also present the qualitative results of our proposed models based on feature visualization techniques and show that the outcomes of visualizations depict our hypothesis and expectation. Finally, we show that by leveraging and combining the aforementioned techniques, our best network outperforms the state of the art on the PlantClef2015 benchmark. The source code and models are available at https://github.com/cs-chan/Deep-Plant. |
| first_indexed | 2024-03-06T05:54:20Z |
| format | Article |
| id | um.eprints-21498 |
| institution | Universiti Malaya |
| last_indexed | 2024-03-06T05:54:20Z |
| publishDate | 2018 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | um.eprints-214982019-06-17T08:46:28Z http://eprints.um.edu.my/21498/ Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks Lee, Sue Han Chan, Chee Seng Remagnino, Paolo QA75 Electronic computers. Computer science Classification of plants based on a multi-organ approach is very challenging. Although additional data provide more information that might help to disambiguate between species, the variability in shape and appearance in plant organs also raises the degree of complexity of the problem. Despite promising solutions built using deep learning enable representative features to be learned for plant images, the existing approaches focus mainly on generic features for species classification, disregarding the features representing plant organs. In fact, plants are complex living organisms sustained by a number of organ systems. In our approach, we introduce a hybrid generic-organ convolutional neural network (HGO-CNN), which takes into account both organ and generic information, combining them using a new feature fusion scheme for species classification. Next, instead of using a CNN-based method to operate on one image with a single organ, we extend our approach. We propose a new framework for plant structural learning using the recurrent neural network-based method. This novel approach supports classification based on a varying number of plant views, capturing one or more organs of a plant, by optimizing the contextual dependencies between them. We also present the qualitative results of our proposed models based on feature visualization techniques and show that the outcomes of visualizations depict our hypothesis and expectation. Finally, we show that by leveraging and combining the aforementioned techniques, our best network outperforms the state of the art on the PlantClef2015 benchmark. The source code and models are available at https://github.com/cs-chan/Deep-Plant. Institute of Electrical and Electronics Engineers 2018 Article PeerReviewed Lee, Sue Han and Chan, Chee Seng and Remagnino, Paolo (2018) Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks. IEEE Transactions on Image Processing, 27 (9). pp. 4287-4301. ISSN 1057-7149, DOI https://doi.org/10.1109/TIP.2018.2836321 <https://doi.org/10.1109/TIP.2018.2836321>. https://doi.org/10.1109/TIP.2018.2836321 doi:10.1109/TIP.2018.2836321 |
| spellingShingle | QA75 Electronic computers. Computer science Lee, Sue Han Chan, Chee Seng Remagnino, Paolo Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks |
| title | Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks |
| title_full | Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks |
| title_fullStr | Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks |
| title_full_unstemmed | Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks |
| title_short | Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks |
| title_sort | multi organ plant classification based on convolutional and recurrent neural networks |
| topic | QA75 Electronic computers. Computer science |
| work_keys_str_mv | AT leesuehan multiorganplantclassificationbasedonconvolutionalandrecurrentneuralnetworks AT chancheeseng multiorganplantclassificationbasedonconvolutionalandrecurrentneuralnetworks AT remagninopaolo multiorganplantclassificationbasedonconvolutionalandrecurrentneuralnetworks |