High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device

The fusion of camera and lidar plays an important role in the field of robotic perception. The accurate external parameter calibration is a necessary prerequisite for sensor fusion. Herein, an auxiliary calibration device with distinctive geometric features was designed to address the problems of lo...

Full description

Bibliographic Details
Main Authors: Song Fan, Ying Yu, Maolin Xu, Longhai Zhao
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10049434/
_version_ 1828001903335702528
author Song Fan
Ying Yu
Maolin Xu
Longhai Zhao
author_facet Song Fan
Ying Yu
Maolin Xu
Longhai Zhao
author_sort Song Fan
collection DOAJ
description The fusion of camera and lidar plays an important role in the field of robotic perception. The accurate external parameter calibration is a necessary prerequisite for sensor fusion. Herein, an auxiliary calibration device with distinctive geometric features was designed to address the problems of low accuracy and poor robustness associated with external parameter calibrations of camera and lidar. Moreover, a coarse-to-fine two-stage calibration method was proposed for the external parameters of the camera and lidar. The first stage of the method is the extraction of multiple groups of two-dimensional (2D) and three-dimensional (3D) lines corresponding to the edge of the calibration device from the image and lidar point cloud that yields a unique initial estimation of the external parameters. In the second stage, the 2D–3D center point of the sphere of the calibration device was detected, and the initial external parameters were further optimized using a nonlinear optimization method. The proposed method provides two different features that add stability against noise to the calibration system. Both simulated and actual experiments show that the method can yield high-precision external parameters without an initial value. Compared to state-of-the-art methods, our method has advantages in terms of accuracy. the calibration system has a certain degree of noise resistance and stability under different laser noise and vertical resolution.
first_indexed 2024-04-10T06:35:52Z
format Article
id doaj.art-0a70c8896ae44239a39bfd847f581130
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-10T06:35:52Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-0a70c8896ae44239a39bfd847f5811302023-03-01T00:01:26ZengIEEEIEEE Access2169-35362023-01-0111187501876010.1109/ACCESS.2023.324719510049434High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration DeviceSong Fan0https://orcid.org/0000-0002-9780-2661Ying Yu1https://orcid.org/0000-0002-1189-3663Maolin Xu2Longhai Zhao3School of Geospatial Information, PLA Information Engineering University, Zhengzhou, ChinaSchool of Geospatial Information, PLA Information Engineering University, Zhengzhou, ChinaSchool of Civil Engineering, University of Science and Technology Liaoning, Anshan, China32016 Troops, Lanzhou, ChinaThe fusion of camera and lidar plays an important role in the field of robotic perception. The accurate external parameter calibration is a necessary prerequisite for sensor fusion. Herein, an auxiliary calibration device with distinctive geometric features was designed to address the problems of low accuracy and poor robustness associated with external parameter calibrations of camera and lidar. Moreover, a coarse-to-fine two-stage calibration method was proposed for the external parameters of the camera and lidar. The first stage of the method is the extraction of multiple groups of two-dimensional (2D) and three-dimensional (3D) lines corresponding to the edge of the calibration device from the image and lidar point cloud that yields a unique initial estimation of the external parameters. In the second stage, the 2D–3D center point of the sphere of the calibration device was detected, and the initial external parameters were further optimized using a nonlinear optimization method. The proposed method provides two different features that add stability against noise to the calibration system. Both simulated and actual experiments show that the method can yield high-precision external parameters without an initial value. Compared to state-of-the-art methods, our method has advantages in terms of accuracy. the calibration system has a certain degree of noise resistance and stability under different laser noise and vertical resolution.https://ieeexplore.ieee.org/document/10049434/Calibration devicecamera and lidar fusionexternal parameter calibrationnonlinear optimization
spellingShingle Song Fan
Ying Yu
Maolin Xu
Longhai Zhao
High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device
IEEE Access
Calibration device
camera and lidar fusion
external parameter calibration
nonlinear optimization
title High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device
title_full High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device
title_fullStr High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device
title_full_unstemmed High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device
title_short High-Precision External Parameter Calibration Method for Camera and Lidar Based on a Calibration Device
title_sort high precision external parameter calibration method for camera and lidar based on a calibration device
topic Calibration device
camera and lidar fusion
external parameter calibration
nonlinear optimization
url https://ieeexplore.ieee.org/document/10049434/
work_keys_str_mv AT songfan highprecisionexternalparametercalibrationmethodforcameraandlidarbasedonacalibrationdevice
AT yingyu highprecisionexternalparametercalibrationmethodforcameraandlidarbasedonacalibrationdevice
AT maolinxu highprecisionexternalparametercalibrationmethodforcameraandlidarbasedonacalibrationdevice
AT longhaizhao highprecisionexternalparametercalibrationmethodforcameraandlidarbasedonacalibrationdevice