Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features
Plant species, structural combination, and spatial distribution in different regions should be adapted to local conditions, and the reasonable arrangement can bring the best ecological effect. Therefore, it is essential to understand the classification and distribution of plant species. This paper p...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-12-01
|
| Series: | Forests |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1999-4907/12/12/1695 |
| _version_ | 1797504574718738432 |
|---|---|
| author | Chih-Wei Lin Mengxiang Lin Yu Hong |
| author_facet | Chih-Wei Lin Mengxiang Lin Yu Hong |
| author_sort | Chih-Wei Lin |
| collection | DOAJ |
| description | Plant species, structural combination, and spatial distribution in different regions should be adapted to local conditions, and the reasonable arrangement can bring the best ecological effect. Therefore, it is essential to understand the classification and distribution of plant species. This paper proposed an end-to-end network with Enhancing Nested Downsampling features (END-Net) to solve complex and challenging plant species segmentation tasks. There are two meaningful operations in the proposed network: (1) A compact and complete encoder–decoder structure nests in the down-sampling process; it makes each downsampling block obtain the equal feature size of input and output to get more in-depth plant species information. (2) The downsampling process of the encoder–decoder framework adopts a novel pixel-based enhance module. The enhanced module adaptively enhances each pixel’s features with the designed learnable variable map, which is as large as the corresponding feature map and has <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>n</mi><mo>×</mo><mi>n</mi></mrow></semantics></math></inline-formula> variables; it can capture and enhance each pixel’s information flexibly effectively. In the experiments, our END-Net compared with eleven state-of-the-art semantic segmentation architectures on the self-collected dataset, it has the best PA (Pixel Accuracy) score and FWloU (Frequency Weighted Intersection over Union) accuracy and achieves 84.52% and 74.96%, respectively. END-Net is a lightweight model with excellent performance; it is practical in complex vegetation distribution with aerial and optical images. END-Net has the following merits: (1) The proposed enhancing module utilizes the learnable variable map to enhance features of each pixel adaptively. (2) We nest a tiny encoder–decoder module into the downsampling block to obtain the in-depth plant species features with the same scale in- and out-features. (3) We embed the enhancing module into the nested model to enhance and extract distinct plant species features. (4) We construct a specific plant dataset that collects the optical images-based plant picture captured by drone with sixteen species. |
| first_indexed | 2024-03-10T04:06:29Z |
| format | Article |
| id | doaj.art-a9baf6d6ee6c4cfb9179530bb596252b |
| institution | Directory Open Access Journal |
| issn | 1999-4907 |
| language | English |
| last_indexed | 2024-03-10T04:06:29Z |
| publishDate | 2021-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Forests |
| spelling | doaj.art-a9baf6d6ee6c4cfb9179530bb596252b2023-11-23T08:21:06ZengMDPI AGForests1999-49072021-12-011212169510.3390/f12121695Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling FeaturesChih-Wei Lin0Mengxiang Lin1Yu Hong2College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, ChinaCollege of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, ChinaCollege of Forestry, Fujian Agriculture and Forestry University, Fuzhou 350002, ChinaPlant species, structural combination, and spatial distribution in different regions should be adapted to local conditions, and the reasonable arrangement can bring the best ecological effect. Therefore, it is essential to understand the classification and distribution of plant species. This paper proposed an end-to-end network with Enhancing Nested Downsampling features (END-Net) to solve complex and challenging plant species segmentation tasks. There are two meaningful operations in the proposed network: (1) A compact and complete encoder–decoder structure nests in the down-sampling process; it makes each downsampling block obtain the equal feature size of input and output to get more in-depth plant species information. (2) The downsampling process of the encoder–decoder framework adopts a novel pixel-based enhance module. The enhanced module adaptively enhances each pixel’s features with the designed learnable variable map, which is as large as the corresponding feature map and has <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>n</mi><mo>×</mo><mi>n</mi></mrow></semantics></math></inline-formula> variables; it can capture and enhance each pixel’s information flexibly effectively. In the experiments, our END-Net compared with eleven state-of-the-art semantic segmentation architectures on the self-collected dataset, it has the best PA (Pixel Accuracy) score and FWloU (Frequency Weighted Intersection over Union) accuracy and achieves 84.52% and 74.96%, respectively. END-Net is a lightweight model with excellent performance; it is practical in complex vegetation distribution with aerial and optical images. END-Net has the following merits: (1) The proposed enhancing module utilizes the learnable variable map to enhance features of each pixel adaptively. (2) We nest a tiny encoder–decoder module into the downsampling block to obtain the in-depth plant species features with the same scale in- and out-features. (3) We embed the enhancing module into the nested model to enhance and extract distinct plant species features. (4) We construct a specific plant dataset that collects the optical images-based plant picture captured by drone with sixteen species.https://www.mdpi.com/1999-4907/12/12/1695deep learningplant speciessemantic segmentationfeatures enhancing |
| spellingShingle | Chih-Wei Lin Mengxiang Lin Yu Hong Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features Forests deep learning plant species semantic segmentation features enhancing |
| title | Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features |
| title_full | Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features |
| title_fullStr | Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features |
| title_full_unstemmed | Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features |
| title_short | Aerial and Optical Images-Based Plant Species Segmentation Using Enhancing Nested Downsampling Features |
| title_sort | aerial and optical images based plant species segmentation using enhancing nested downsampling features |
| topic | deep learning plant species semantic segmentation features enhancing |
| url | https://www.mdpi.com/1999-4907/12/12/1695 |
| work_keys_str_mv | AT chihweilin aerialandopticalimagesbasedplantspeciessegmentationusingenhancingnesteddownsamplingfeatures AT mengxianglin aerialandopticalimagesbasedplantspeciessegmentationusingenhancingnesteddownsamplingfeatures AT yuhong aerialandopticalimagesbasedplantspeciessegmentationusingenhancingnesteddownsamplingfeatures |