Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera
This study presents a visual-only odometry technique of a low-profile pallet robot using image feature tracking in ground plane images generated from a fisheye camera. The fisheye camera is commonly used in many robot vision applications because it provides a larger field of view (FoV) around a robo...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/16/9095 |
| _version_ | 1827730533818302464 |
|---|---|
| author | Soon-Yong Park Ung-Gyo Lee Seung-Hae Baek |
| author_facet | Soon-Yong Park Ung-Gyo Lee Seung-Hae Baek |
| author_sort | Soon-Yong Park |
| collection | DOAJ |
| description | This study presents a visual-only odometry technique of a low-profile pallet robot using image feature tracking in ground plane images generated from a fisheye camera. The fisheye camera is commonly used in many robot vision applications because it provides a larger field of view (FoV) around a robot. However, because of the large radial distortion, the fisheye image is generally converted to a pinhole image for visual feature tracking or matching. Although the radial distortion can be eliminated via image undistortion with the lens calibration parameters, it causes several side effects, such as degraded image resolution and a significant reduction in the FoV. In this paper, instead of using the pinhole model, we propose to generate a ground plane image (GPI) from the fisheye image. GPI is a virtual top-view image that only contains the ground plane at the front of the robot. First, the original fisheye image is projected to several virtual pinhole images to generate a cubemap. Second, the front and bottom faces of the cubemap are projected to a GPI. Third, the GPI is homographically transformed again to further reduce image distortion. As a result, an accurate ortho-rectified ground plane image is obtained from the virtual top-view camera. For visual odometry using the ortho-rectified GPI, a number of 2D motion vectors are obtained using feature extraction and tracking between the previous and current frames in the GPI. By calculating a scaled motion vector, which is the measurement of the virtual wheel encoder of the mobile robot, we estimate the velocity and steering angle of the virtual wheel using the motion vector. Finally, we estimate the pose of the mobile robot by applying a kinematic model to the mobile robot. |
| first_indexed | 2024-03-11T00:09:16Z |
| format | Article |
| id | doaj.art-18a5ddd8656f47da8c5fd9884469cda8 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T00:09:16Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-18a5ddd8656f47da8c5fd9884469cda82023-11-19T00:04:13ZengMDPI AGApplied Sciences2076-34172023-08-011316909510.3390/app13169095Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye CameraSoon-Yong Park0Ung-Gyo Lee1Seung-Hae Baek2School of Electronic and Electrical Engineering, Kyungpook National University, 80 Daehak-ro, Puk-gu, Daegu 41566, Republic of KoreaHL Klemove, 224 Harmony-ro, Yeonsu-gu, Incheon 22011, Republic of KoreaKLA Corporation, 830 Dongtansunwhan-daero, Hwaseong-si 18468, Republic of KoreaThis study presents a visual-only odometry technique of a low-profile pallet robot using image feature tracking in ground plane images generated from a fisheye camera. The fisheye camera is commonly used in many robot vision applications because it provides a larger field of view (FoV) around a robot. However, because of the large radial distortion, the fisheye image is generally converted to a pinhole image for visual feature tracking or matching. Although the radial distortion can be eliminated via image undistortion with the lens calibration parameters, it causes several side effects, such as degraded image resolution and a significant reduction in the FoV. In this paper, instead of using the pinhole model, we propose to generate a ground plane image (GPI) from the fisheye image. GPI is a virtual top-view image that only contains the ground plane at the front of the robot. First, the original fisheye image is projected to several virtual pinhole images to generate a cubemap. Second, the front and bottom faces of the cubemap are projected to a GPI. Third, the GPI is homographically transformed again to further reduce image distortion. As a result, an accurate ortho-rectified ground plane image is obtained from the virtual top-view camera. For visual odometry using the ortho-rectified GPI, a number of 2D motion vectors are obtained using feature extraction and tracking between the previous and current frames in the GPI. By calculating a scaled motion vector, which is the measurement of the virtual wheel encoder of the mobile robot, we estimate the velocity and steering angle of the virtual wheel using the motion vector. Finally, we estimate the pose of the mobile robot by applying a kinematic model to the mobile robot.https://www.mdpi.com/2076-3417/13/16/9095fisheye lenscubemapground plane imagepallet mobile robot |
| spellingShingle | Soon-Yong Park Ung-Gyo Lee Seung-Hae Baek Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera Applied Sciences fisheye lens cubemap ground plane image pallet mobile robot |
| title | Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera |
| title_full | Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera |
| title_fullStr | Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera |
| title_full_unstemmed | Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera |
| title_short | Visual Odometry of a Low-Profile Pallet Robot Based on Ortho-Rectified Ground Plane Image from Fisheye Camera |
| title_sort | visual odometry of a low profile pallet robot based on ortho rectified ground plane image from fisheye camera |
| topic | fisheye lens cubemap ground plane image pallet mobile robot |
| url | https://www.mdpi.com/2076-3417/13/16/9095 |
| work_keys_str_mv | AT soonyongpark visualodometryofalowprofilepalletrobotbasedonorthorectifiedgroundplaneimagefromfisheyecamera AT unggyolee visualodometryofalowprofilepalletrobotbasedonorthorectifiedgroundplaneimagefromfisheyecamera AT seunghaebaek visualodometryofalowprofilepalletrobotbasedonorthorectifiedgroundplaneimagefromfisheyecamera |