Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera
The three-dimensional reconstruction method using RGB-D camera has a good balance in hardware cost and point cloud quality. However, due to the limitation of inherent structure and imaging principle, the acquired point cloud has problems such as a lot of noise and difficult registration. This paper...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-07-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/14/4628 |
| _version_ | 1797526151058423808 |
|---|---|
| author | Xiaowen Teng Guangsheng Zhou Yuxuan Wu Chenglong Huang Wanjing Dong Shengyong Xu |
| author_facet | Xiaowen Teng Guangsheng Zhou Yuxuan Wu Chenglong Huang Wanjing Dong Shengyong Xu |
| author_sort | Xiaowen Teng |
| collection | DOAJ |
| description | The three-dimensional reconstruction method using RGB-D camera has a good balance in hardware cost and point cloud quality. However, due to the limitation of inherent structure and imaging principle, the acquired point cloud has problems such as a lot of noise and difficult registration. This paper proposes a 3D reconstruction method using Azure Kinect to solve these inherent problems. Shoot color images, depth images and near-infrared images of the target from six perspectives by Azure Kinect sensor with black background. Multiply the binarization result of the 8-bit infrared image with the RGB-D image alignment result provided by Microsoft corporation, which can remove ghosting and most of the background noise. A neighborhood extreme filtering method is proposed to filter out the abrupt points in the depth image, by which the floating noise point and most of the outlier noise will be removed before generating the point cloud, and then using the pass-through filter eliminate rest of the outlier noise. An improved method based on the classic iterative closest point (ICP) algorithm is presented to merge multiple-views point clouds. By continuously reducing both the size of the down-sampling grid and the distance threshold between the corresponding points, the point clouds of each view are continuously registered three times, until get the integral color point cloud. Many experiments on rapeseed plants show that the success rate of cloud registration is 92.5% and the point cloud accuracy obtained by this method is 0.789 mm, the time consuming of a integral scanning is 302 s, and with a good color restoration. Compared with a laser scanner, the proposed method has considerable reconstruction accuracy and a significantly ahead of the reconstruction speed, but the hardware cost is much lower when building a automatic scanning system. This research shows a low-cost, high-precision 3D reconstruction technology, which has the potential to be widely used for non-destructive measurement of rapeseed and other crops phenotype. |
| first_indexed | 2024-03-10T09:25:08Z |
| format | Article |
| id | doaj.art-d9d6c0779f24487486e5769d3be67b0c |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T09:25:08Z |
| publishDate | 2021-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-d9d6c0779f24487486e5769d3be67b0c2023-11-22T04:53:43ZengMDPI AGSensors1424-82202021-07-012114462810.3390/s21144628Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D CameraXiaowen Teng0Guangsheng Zhou1Yuxuan Wu2Chenglong Huang3Wanjing Dong4Shengyong Xu5College of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Plant Science & Technology, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaCollege of Engineering, Huazhong Agricultural University, Wuhan 430070, ChinaThe three-dimensional reconstruction method using RGB-D camera has a good balance in hardware cost and point cloud quality. However, due to the limitation of inherent structure and imaging principle, the acquired point cloud has problems such as a lot of noise and difficult registration. This paper proposes a 3D reconstruction method using Azure Kinect to solve these inherent problems. Shoot color images, depth images and near-infrared images of the target from six perspectives by Azure Kinect sensor with black background. Multiply the binarization result of the 8-bit infrared image with the RGB-D image alignment result provided by Microsoft corporation, which can remove ghosting and most of the background noise. A neighborhood extreme filtering method is proposed to filter out the abrupt points in the depth image, by which the floating noise point and most of the outlier noise will be removed before generating the point cloud, and then using the pass-through filter eliminate rest of the outlier noise. An improved method based on the classic iterative closest point (ICP) algorithm is presented to merge multiple-views point clouds. By continuously reducing both the size of the down-sampling grid and the distance threshold between the corresponding points, the point clouds of each view are continuously registered three times, until get the integral color point cloud. Many experiments on rapeseed plants show that the success rate of cloud registration is 92.5% and the point cloud accuracy obtained by this method is 0.789 mm, the time consuming of a integral scanning is 302 s, and with a good color restoration. Compared with a laser scanner, the proposed method has considerable reconstruction accuracy and a significantly ahead of the reconstruction speed, but the hardware cost is much lower when building a automatic scanning system. This research shows a low-cost, high-precision 3D reconstruction technology, which has the potential to be widely used for non-destructive measurement of rapeseed and other crops phenotype.https://www.mdpi.com/1424-8220/21/14/4628three-dimensional reconstructionICPAzure KinectRGB-D image processingpoint cloud filteringrapeseed |
| spellingShingle | Xiaowen Teng Guangsheng Zhou Yuxuan Wu Chenglong Huang Wanjing Dong Shengyong Xu Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera Sensors three-dimensional reconstruction ICP Azure Kinect RGB-D image processing point cloud filtering rapeseed |
| title | Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera |
| title_full | Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera |
| title_fullStr | Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera |
| title_full_unstemmed | Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera |
| title_short | Three-Dimensional Reconstruction Method of Rapeseed Plants in the Whole Growth Period Using RGB-D Camera |
| title_sort | three dimensional reconstruction method of rapeseed plants in the whole growth period using rgb d camera |
| topic | three-dimensional reconstruction ICP Azure Kinect RGB-D image processing point cloud filtering rapeseed |
| url | https://www.mdpi.com/1424-8220/21/14/4628 |
| work_keys_str_mv | AT xiaowenteng threedimensionalreconstructionmethodofrapeseedplantsinthewholegrowthperiodusingrgbdcamera AT guangshengzhou threedimensionalreconstructionmethodofrapeseedplantsinthewholegrowthperiodusingrgbdcamera AT yuxuanwu threedimensionalreconstructionmethodofrapeseedplantsinthewholegrowthperiodusingrgbdcamera AT chenglonghuang threedimensionalreconstructionmethodofrapeseedplantsinthewholegrowthperiodusingrgbdcamera AT wanjingdong threedimensionalreconstructionmethodofrapeseedplantsinthewholegrowthperiodusingrgbdcamera AT shengyongxu threedimensionalreconstructionmethodofrapeseedplantsinthewholegrowthperiodusingrgbdcamera |