Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two
In order to count soybean seeds quickly and accurately, improve the speed of seed test and the level of soybean breeding, a method of soybean seed counting based on VGG-Two (VGG-T) was developed in this research. Firstly, in view of the lack of available image dataset in the field of soybean seed co...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Editorial Office of Smart Agriculture
2021-12-01
|
| Series: | 智慧农业 |
| Subjects: | |
| Online Access: | http://www.smartag.net.cn/article/2021/2096-8094/2096-8094-2021-3-4-111.shtml |
| _version_ | 1811306249109635072 |
|---|---|
| author | WANG Ying LI Yue WU Tingting SUN Shi WANG Minjuan |
| author_facet | WANG Ying LI Yue WU Tingting SUN Shi WANG Minjuan |
| author_sort | WANG Ying |
| collection | DOAJ |
| description | In order to count soybean seeds quickly and accurately, improve the speed of seed test and the level of soybean breeding, a method of soybean seed counting based on VGG-Two (VGG-T) was developed in this research. Firstly, in view of the lack of available image dataset in the field of soybean seed counting, a fast target point labeling method of combining pre-annotation based on digital image processing technology with manual correction annotation was proposed to speed up the establishment of publicly available soybean seed image dataset with annotation. Only 197 min were taken to mark 37,563 seeds when using this method, which saved 1592 min than ordinary manual marking and could reduce 96% of manual workload. At the same time, the dataset in this research is the largest annotated data set for soybean seed counting so far. Secondly, a method that combined the density estimation-based and the convolution neural network (CNN) was developed to accurately estimate the seed count from an individual threshed seed image with a single perspective. Thereinto, a CNN architecture consisting of two columns of the same network structure was used to learn the mapping from the original pixel to the density map. Due to the very limited number of training samples and the effect of vanishing gradients on deep neural networks, it is not easy for the network to learn all parameters at the same time. Inspired by the success of pre-training, this research pre-trained the CNN in each column by directly mapping the output of the fourth convolutional layer to the density map. Then these pre-trained CNNs were used to initialize CNNs in these two columns and fine-tune all parameters. Finally, the model was tested, and the effectiveness of the algorithm through three comparative experiments (with and without data enhancement, VGG16 and VGG-T, multiple sets of test set) was verified, which respectively provided 0.6 and 0.2 mean absolute error (MAE) in the original image and patch cases, while mean squared error (MSE) were 0.6 and 0.3. Compared with traditional image morphology operations, ResNet18, ResNet18-T and VGG16, the method proposed improving the accuracy of soybean seed counting. In the testset containing soybean seeds of different densities, the error fluctuation was small, and it still had excellent counting performance. At the same time, compared with manual counting and photoelectric seed counter, it saved about 2.493 h and 0.203 h respectively for counting 11,350 soybean seeds, realizing rapid soybean seeds counting. |
| first_indexed | 2024-04-13T08:41:01Z |
| format | Article |
| id | doaj.art-4e6a91483b3d4ad88f5c51bea0f28b40 |
| institution | Directory Open Access Journal |
| issn | 2096-8094 |
| language | English |
| last_indexed | 2024-04-13T08:41:01Z |
| publishDate | 2021-12-01 |
| publisher | Editorial Office of Smart Agriculture |
| record_format | Article |
| series | 智慧农业 |
| spelling | doaj.art-4e6a91483b3d4ad88f5c51bea0f28b402022-12-22T02:53:54ZengEditorial Office of Smart Agriculture智慧农业2096-80942021-12-013411112210.12133/j.smartag.2021.3.4.202101-SA002202101-SA002Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-TwoWANG Ying0LI Yue1WU Tingting2SUN Shi3WANG Minjuan4Key Laboratory of Modern Precision Agriculture System Integration Research, China Agricultural University, Beijing 100083, ChinaKey Laboratory of Modern Precision Agriculture System Integration Research, China Agricultural University, Beijing 100083, ChinaInstitute of Crop Sciences, Chinese Academy of Agricultural Sciences/Beijing Key Laboratory of Soybean Biology, Ministry of Agriculture and Rural Affairs, Beijing 100081, ChinaInstitute of Crop Sciences, Chinese Academy of Agricultural Sciences/Beijing Key Laboratory of Soybean Biology, Ministry of Agriculture and Rural Affairs, Beijing 100081, ChinaKey Laboratory of Modern Precision Agriculture System Integration Research, China Agricultural University, Beijing 100083, ChinaIn order to count soybean seeds quickly and accurately, improve the speed of seed test and the level of soybean breeding, a method of soybean seed counting based on VGG-Two (VGG-T) was developed in this research. Firstly, in view of the lack of available image dataset in the field of soybean seed counting, a fast target point labeling method of combining pre-annotation based on digital image processing technology with manual correction annotation was proposed to speed up the establishment of publicly available soybean seed image dataset with annotation. Only 197 min were taken to mark 37,563 seeds when using this method, which saved 1592 min than ordinary manual marking and could reduce 96% of manual workload. At the same time, the dataset in this research is the largest annotated data set for soybean seed counting so far. Secondly, a method that combined the density estimation-based and the convolution neural network (CNN) was developed to accurately estimate the seed count from an individual threshed seed image with a single perspective. Thereinto, a CNN architecture consisting of two columns of the same network structure was used to learn the mapping from the original pixel to the density map. Due to the very limited number of training samples and the effect of vanishing gradients on deep neural networks, it is not easy for the network to learn all parameters at the same time. Inspired by the success of pre-training, this research pre-trained the CNN in each column by directly mapping the output of the fourth convolutional layer to the density map. Then these pre-trained CNNs were used to initialize CNNs in these two columns and fine-tune all parameters. Finally, the model was tested, and the effectiveness of the algorithm through three comparative experiments (with and without data enhancement, VGG16 and VGG-T, multiple sets of test set) was verified, which respectively provided 0.6 and 0.2 mean absolute error (MAE) in the original image and patch cases, while mean squared error (MSE) were 0.6 and 0.3. Compared with traditional image morphology operations, ResNet18, ResNet18-T and VGG16, the method proposed improving the accuracy of soybean seed counting. In the testset containing soybean seeds of different densities, the error fluctuation was small, and it still had excellent counting performance. At the same time, compared with manual counting and photoelectric seed counter, it saved about 2.493 h and 0.203 h respectively for counting 11,350 soybean seeds, realizing rapid soybean seeds counting.http://www.smartag.net.cn/article/2021/2096-8094/2096-8094-2021-3-4-111.shtmlconvolutional neural networkseed countingseed imagepoint labelingdensity mapvgg-twobreeding |
| spellingShingle | WANG Ying LI Yue WU Tingting SUN Shi WANG Minjuan Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two 智慧农业 convolutional neural network seed counting seed image point labeling density map vgg-two breeding |
| title | Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two |
| title_full | Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two |
| title_fullStr | Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two |
| title_full_unstemmed | Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two |
| title_short | Fast Counting Method of Soybean Seeds Based on Density Estimation and VGG-Two |
| title_sort | fast counting method of soybean seeds based on density estimation and vgg two |
| topic | convolutional neural network seed counting seed image point labeling density map vgg-two breeding |
| url | http://www.smartag.net.cn/article/2021/2096-8094/2096-8094-2021-3-4-111.shtml |
| work_keys_str_mv | AT wangying fastcountingmethodofsoybeanseedsbasedondensityestimationandvggtwo AT liyue fastcountingmethodofsoybeanseedsbasedondensityestimationandvggtwo AT wutingting fastcountingmethodofsoybeanseedsbasedondensityestimationandvggtwo AT sunshi fastcountingmethodofsoybeanseedsbasedondensityestimationandvggtwo AT wangminjuan fastcountingmethodofsoybeanseedsbasedondensityestimationandvggtwo |