A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++

China is the largest producer and consumer of rice, and the classification of filled/unfilled rice grains is of great significance for rice breeding and genetic analysis. The traditional method for filled/unfilled rice grain identification was generally manual, which had the disadvantages of low eff...

Full description

Bibliographic Details
Main Authors: Shihao Huang, Zhihao Lu, Yuxuan Shi, Jiale Dong, Lin Hu, Wanneng Yang, Chenglong Huang
Format: Article
Language:English
Published: MDPI AG 2023-07-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/14/6331
_version_ 1797587516256157696
author Shihao Huang
Zhihao Lu
Yuxuan Shi
Jiale Dong
Lin Hu
Wanneng Yang
Chenglong Huang
author_facet Shihao Huang
Zhihao Lu
Yuxuan Shi
Jiale Dong
Lin Hu
Wanneng Yang
Chenglong Huang
author_sort Shihao Huang
collection DOAJ
description China is the largest producer and consumer of rice, and the classification of filled/unfilled rice grains is of great significance for rice breeding and genetic analysis. The traditional method for filled/unfilled rice grain identification was generally manual, which had the disadvantages of low efficiency, poor repeatability, and low precision. In this study, we have proposed a novel method for filled/unfilled grain classification based on structured light imaging and Improved PointNet++. Firstly, the 3D point cloud data of rice grains were obtained by structured light imaging. And then the specified processing algorithms were developed for the single grain segmentation, and data enhancement with normal vector. Finally, the PointNet++ network was improved by adding an additional Set Abstraction layer and combining the maximum pooling of normal vectors to realize filled/unfilled rice grain point cloud classification. To verify the model performance, the Improved PointNet++ was compared with six machine learning methods, PointNet and PointConv. The results showed that the optimal machine learning model is XGboost, with a classification accuracy of 91.99%, while the classification accuracy of Improved PointNet++ was 98.50% outperforming the PointNet 93.75% and PointConv 92.25%. In conclusion, this study has demonstrated a novel and effective method for filled/unfilled grain recognition.
first_indexed 2024-03-11T00:41:00Z
format Article
id doaj.art-6151278a194c473aa04f51fb3020e3ae
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-11T00:41:00Z
publishDate 2023-07-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-6151278a194c473aa04f51fb3020e3ae2023-11-18T21:16:14ZengMDPI AGSensors1424-82202023-07-012314633110.3390/s23146331A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++Shihao Huang0Zhihao Lu1Yuxuan Shi2Jiale Dong3Lin Hu4Wanneng Yang5Chenglong Huang6College of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaNational Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research (Wuhan), Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaChina is the largest producer and consumer of rice, and the classification of filled/unfilled rice grains is of great significance for rice breeding and genetic analysis. The traditional method for filled/unfilled rice grain identification was generally manual, which had the disadvantages of low efficiency, poor repeatability, and low precision. In this study, we have proposed a novel method for filled/unfilled grain classification based on structured light imaging and Improved PointNet++. Firstly, the 3D point cloud data of rice grains were obtained by structured light imaging. And then the specified processing algorithms were developed for the single grain segmentation, and data enhancement with normal vector. Finally, the PointNet++ network was improved by adding an additional Set Abstraction layer and combining the maximum pooling of normal vectors to realize filled/unfilled rice grain point cloud classification. To verify the model performance, the Improved PointNet++ was compared with six machine learning methods, PointNet and PointConv. The results showed that the optimal machine learning model is XGboost, with a classification accuracy of 91.99%, while the classification accuracy of Improved PointNet++ was 98.50% outperforming the PointNet 93.75% and PointConv 92.25%. In conclusion, this study has demonstrated a novel and effective method for filled/unfilled grain recognition.https://www.mdpi.com/1424-8220/23/14/63313D structured lightpoint cloud segmentationdata enhancementdeep learningnormal vectorgrain classification
spellingShingle Shihao Huang
Zhihao Lu
Yuxuan Shi
Jiale Dong
Lin Hu
Wanneng Yang
Chenglong Huang
A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++
Sensors
3D structured light
point cloud segmentation
data enhancement
deep learning
normal vector
grain classification
title A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++
title_full A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++
title_fullStr A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++
title_full_unstemmed A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++
title_short A Novel Method for Filled/Unfilled Grain Classification Based on Structured Light Imaging and Improved PointNet++
title_sort novel method for filled unfilled grain classification based on structured light imaging and improved pointnet
topic 3D structured light
point cloud segmentation
data enhancement
deep learning
normal vector
grain classification
url https://www.mdpi.com/1424-8220/23/14/6331
work_keys_str_mv AT shihaohuang anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT zhihaolu anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT yuxuanshi anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT jialedong anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT linhu anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT wannengyang anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT chenglonghuang anovelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT shihaohuang novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT zhihaolu novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT yuxuanshi novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT jialedong novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT linhu novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT wannengyang novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet
AT chenglonghuang novelmethodforfilledunfilledgrainclassificationbasedonstructuredlightimagingandimprovedpointnet