Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection

This work focuses on the problem of non-contact measurement for vegetables in agricultural automation. The application of computer vision in assisted agricultural production significantly improves work efficiency due to the rapid development of information technology and artificial intelligence. Bas...

Full description

Bibliographic Details
Main Authors: Bowen Zheng, Guiling Sun, Zhaonan Meng, Ruili Nan
Format: Article
Language:English
Published: MDPI AG 2022-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/4/1617
_version_ 1797476694382084096
author Bowen Zheng
Guiling Sun
Zhaonan Meng
Ruili Nan
author_facet Bowen Zheng
Guiling Sun
Zhaonan Meng
Ruili Nan
author_sort Bowen Zheng
collection DOAJ
description This work focuses on the problem of non-contact measurement for vegetables in agricultural automation. The application of computer vision in assisted agricultural production significantly improves work efficiency due to the rapid development of information technology and artificial intelligence. Based on object detection and stereo cameras, this paper proposes an intelligent method for vegetable recognition and size estimation. The method obtains colorful images and depth maps with a binocular stereo camera. Then detection networks classify four kinds of common vegetables (cucumber, eggplant, tomato and pepper) and locate six points for each object. Finally, the size of vegetables is calculated using the pixel position and depth of keypoints. Experimental results show that the proposed method can classify four kinds of common vegetables within 60 cm and accurately estimate their diameter and length. The work provides an innovative idea for solving the vegetable’s non-contact measurement problems and can promote the application of computer vision in agricultural automation.
first_indexed 2024-03-09T21:05:18Z
format Article
id doaj.art-83b687cfb87748ea83184954a6f89e83
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T21:05:18Z
publishDate 2022-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-83b687cfb87748ea83184954a6f89e832023-11-23T22:02:24ZengMDPI AGSensors1424-82202022-02-01224161710.3390/s22041617Vegetable Size Measurement Based on Stereo Camera and Keypoints DetectionBowen Zheng0Guiling Sun1Zhaonan Meng2Ruili Nan3College of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaCollege of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaCollege of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaCollege of Electronic Information and Optical Engineering, Nankai University, Tianjin 300350, ChinaThis work focuses on the problem of non-contact measurement for vegetables in agricultural automation. The application of computer vision in assisted agricultural production significantly improves work efficiency due to the rapid development of information technology and artificial intelligence. Based on object detection and stereo cameras, this paper proposes an intelligent method for vegetable recognition and size estimation. The method obtains colorful images and depth maps with a binocular stereo camera. Then detection networks classify four kinds of common vegetables (cucumber, eggplant, tomato and pepper) and locate six points for each object. Finally, the size of vegetables is calculated using the pixel position and depth of keypoints. Experimental results show that the proposed method can classify four kinds of common vegetables within 60 cm and accurately estimate their diameter and length. The work provides an innovative idea for solving the vegetable’s non-contact measurement problems and can promote the application of computer vision in agricultural automation.https://www.mdpi.com/1424-8220/22/4/1617vegetable size measurementcomputer visionstereo camerakeypoints detection
spellingShingle Bowen Zheng
Guiling Sun
Zhaonan Meng
Ruili Nan
Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
Sensors
vegetable size measurement
computer vision
stereo camera
keypoints detection
title Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
title_full Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
title_fullStr Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
title_full_unstemmed Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
title_short Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
title_sort vegetable size measurement based on stereo camera and keypoints detection
topic vegetable size measurement
computer vision
stereo camera
keypoints detection
url https://www.mdpi.com/1424-8220/22/4/1617
work_keys_str_mv AT bowenzheng vegetablesizemeasurementbasedonstereocameraandkeypointsdetection
AT guilingsun vegetablesizemeasurementbasedonstereocameraandkeypointsdetection
AT zhaonanmeng vegetablesizemeasurementbasedonstereocameraandkeypointsdetection
AT ruilinan vegetablesizemeasurementbasedonstereocameraandkeypointsdetection