Point cloud registration using deep learning and its application in odometry estimation

With the continuous improvement of computer graphics and information technology, three-dimensional images have become a hot research topic in recent years, and point cloud registration is the most basic but important step in many applications such as 3D reconstruction. Point cloud registration can c...

Full description

Bibliographic Details
Main Author: Zhou, Yuting
Other Authors: Tay, Wee Peng
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/149721
_version_ 1811676992582451200
author Zhou, Yuting
author2 Tay, Wee Peng
author_facet Tay, Wee Peng
Zhou, Yuting
author_sort Zhou, Yuting
collection NTU
description With the continuous improvement of computer graphics and information technology, three-dimensional images have become a hot research topic in recent years, and point cloud registration is the most basic but important step in many applications such as 3D reconstruction. Point cloud registration can calculate the rotation matrix and translation matrix (rigid transformation) from two different point clouds with different views of same objects or scenes. Among the numerous methods, Iterative Closest Point (ICP) and its variants are the most popular ones, but they have problems such as tracking into local optima or having high computational complexity. The development of deep learning has provided new directions for point cloud registration. This dissertation mainly studies the Deep Closest Point (DCP) algorithm and applies it to the large-scale outdoor dataset KITTI. DCP maps the data into a high dimensional space, extracts the features by Dynamic Graph Convolution Neural Network(DGCNN) as well as the Transformer and finally uses SVD to calculate the rigid transformation. To reduce the computational complexity, a series of data preprocessing operations are performed on the point clouds before feeding them to the DCP model for registration, such as Random Sample Consensus(RANSAC), data clustering and key point extraction. The results of experiments show that the preprocessing steps can improve the accuracy of DCP, but this network is still unsuitable for the panoramic outdoor scenes.
first_indexed 2024-10-01T02:30:17Z
format Thesis-Master by Coursework
id ntu-10356/149721
institution Nanyang Technological University
language English
last_indexed 2024-10-01T02:30:17Z
publishDate 2021
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1497212023-07-04T17:33:40Z Point cloud registration using deep learning and its application in odometry estimation Zhou, Yuting Tay, Wee Peng School of Electrical and Electronic Engineering wptay@ntu.edu.sg Engineering::Electrical and electronic engineering With the continuous improvement of computer graphics and information technology, three-dimensional images have become a hot research topic in recent years, and point cloud registration is the most basic but important step in many applications such as 3D reconstruction. Point cloud registration can calculate the rotation matrix and translation matrix (rigid transformation) from two different point clouds with different views of same objects or scenes. Among the numerous methods, Iterative Closest Point (ICP) and its variants are the most popular ones, but they have problems such as tracking into local optima or having high computational complexity. The development of deep learning has provided new directions for point cloud registration. This dissertation mainly studies the Deep Closest Point (DCP) algorithm and applies it to the large-scale outdoor dataset KITTI. DCP maps the data into a high dimensional space, extracts the features by Dynamic Graph Convolution Neural Network(DGCNN) as well as the Transformer and finally uses SVD to calculate the rigid transformation. To reduce the computational complexity, a series of data preprocessing operations are performed on the point clouds before feeding them to the DCP model for registration, such as Random Sample Consensus(RANSAC), data clustering and key point extraction. The results of experiments show that the preprocessing steps can improve the accuracy of DCP, but this network is still unsuitable for the panoramic outdoor scenes. Master of Science (Computer Control and Automation) 2021-06-08T11:36:34Z 2021-06-08T11:36:34Z 2021 Thesis-Master by Coursework Zhou, Y. (2021). Point cloud registration using deep learning and its application in odometry estimation. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/149721 https://hdl.handle.net/10356/149721 en application/pdf Nanyang Technological University
spellingShingle Engineering::Electrical and electronic engineering
Zhou, Yuting
Point cloud registration using deep learning and its application in odometry estimation
title Point cloud registration using deep learning and its application in odometry estimation
title_full Point cloud registration using deep learning and its application in odometry estimation
title_fullStr Point cloud registration using deep learning and its application in odometry estimation
title_full_unstemmed Point cloud registration using deep learning and its application in odometry estimation
title_short Point cloud registration using deep learning and its application in odometry estimation
title_sort point cloud registration using deep learning and its application in odometry estimation
topic Engineering::Electrical and electronic engineering
url https://hdl.handle.net/10356/149721
work_keys_str_mv AT zhouyuting pointcloudregistrationusingdeeplearninganditsapplicationinodometryestimation