Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
This work focuses on the problem of non-contact measurement for vegetables in agricultural automation. The application of computer vision in assisted agricultural production significantly improves work efficiency due to the rapid development of information technology and artificial intelligence. Bas...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-02-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/22/4/1617 |
_version_ | 1797476694382084096 |
---|---|
author | Bowen Zheng Guiling Sun Zhaonan Meng Ruili Nan |
author_facet | Bowen Zheng Guiling Sun Zhaonan Meng Ruili Nan |
author_sort | Bowen Zheng |
collection | DOAJ |
description | This work focuses on the problem of non-contact measurement for vegetables in agricultural automation. The application of computer vision in assisted agricultural production significantly improves work efficiency due to the rapid development of information technology and artificial intelligence. Based on object detection and stereo cameras, this paper proposes an intelligent method for vegetable recognition and size estimation. The method obtains colorful images and depth maps with a binocular stereo camera. Then detection networks classify four kinds of common vegetables (cucumber, eggplant, tomato and pepper) and locate six points for each object. Finally, the size of vegetables is calculated using the pixel position and depth of keypoints. Experimental results show that the proposed method can classify four kinds of common vegetables within 60 cm and accurately estimate their diameter and length. The work provides an innovative idea for solving the vegetable’s non-contact measurement problems and can promote the application of computer vision in agricultural automation. |
first_indexed | 2024-03-09T21:05:18Z |
format | Article |
id | doaj.art-83b687cfb87748ea83184954a6f89e83 |
institution | Directory Open Access Journal |
issn | 1424-8220 |
language | English |
last_indexed | 2024-03-09T21:05:18Z |
publishDate | 2022-02-01 |
publisher | MDPI AG |
record_format | Article |
series | Sensors |
spelling | doaj.art-83b687cfb87748ea83184954a6f89e832023-11-23T22:02:24ZengMDPI AGSensors1424-82202022-02-01224161710.3390/s22041617Vegetable Size Measurement Based on Stereo Camera and Keypoints DetectionBowen Zheng0Guiling Sun1Zhaonan Meng2Ruili Nan3College of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaCollege of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaCollege of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaCollege of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaThis work focuses on the problem of non-contact measurement for vegetables in agricultural automation. The application of computer vision in assisted agricultural production significantly improves work efficiency due to the rapid development of information technology and artificial intelligence. Based on object detection and stereo cameras, this paper proposes an intelligent method for vegetable recognition and size estimation. The method obtains colorful images and depth maps with a binocular stereo camera. Then detection networks classify four kinds of common vegetables (cucumber, eggplant, tomato and pepper) and locate six points for each object. Finally, the size of vegetables is calculated using the pixel position and depth of keypoints. Experimental results show that the proposed method can classify four kinds of common vegetables within 60 cm and accurately estimate their diameter and length. The work provides an innovative idea for solving the vegetable’s non-contact measurement problems and can promote the application of computer vision in agricultural automation.https://www.mdpi.com/1424-8220/22/4/1617vegetable size measurementcomputer visionstereo camerakeypoints detection |
spellingShingle | Bowen Zheng Guiling Sun Zhaonan Meng Ruili Nan Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection Sensors vegetable size measurement computer vision stereo camera keypoints detection |
title | Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection |
title_full | Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection |
title_fullStr | Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection |
title_full_unstemmed | Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection |
title_short | Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection |
title_sort | vegetable size measurement based on stereo camera and keypoints detection |
topic | vegetable size measurement computer vision stereo camera keypoints detection |
url | https://www.mdpi.com/1424-8220/22/4/1617 |
work_keys_str_mv | AT bowenzheng vegetablesizemeasurementbasedonstereocameraandkeypointsdetection AT guilingsun vegetablesizemeasurementbasedonstereocameraandkeypointsdetection AT zhaonanmeng vegetablesizemeasurementbasedonstereocameraandkeypointsdetection AT ruilinan vegetablesizemeasurementbasedonstereocameraandkeypointsdetection |