Unsupervised domain adaptation for LiDAR segmentation

Transferring knowledge learned from the labeled source domain to the raw target domain for unsupervised domain adaptation (UDA) is essential to the scalable deployment of an autonomous driving system. State-of-the-art approaches in UDA often employ a key concept: utilize joint supervision signals fr...

Full description

Bibliographic Details
Main Author: Kong, Lingdong
Other Authors: Zhang Hanwang
Format: Thesis-Master by Research
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/158401
_version_ 1826129367939416064
author Kong, Lingdong
author2 Zhang Hanwang
author_facet Zhang Hanwang
Kong, Lingdong
author_sort Kong, Lingdong
collection NTU
description Transferring knowledge learned from the labeled source domain to the raw target domain for unsupervised domain adaptation (UDA) is essential to the scalable deployment of an autonomous driving system. State-of-the-art approaches in UDA often employ a key concept: utilize joint supervision signals from both the source domain (with ground-truth) and the target domain (with pseudo-labels) for self-training. In this work, we improve and extend on this aspect. We present ConDA, a concatenation-based domain adaptation framework for LiDAR semantic segmentation that: (1) constructs an intermediate domain consisting of fine-grained interchange signals from both source and target domains without destabilizing the semantic coherency of objects and background around the ego-vehicle; and (2) utilizes the intermediate domain for self-training. Additionally, to improve both the network training on the source domain and self-training on the intermediate domain, we propose an anti-aliasing regularizer and an entropy aggregator to reduce the detrimental effects of aliasing artifacts and noisy target predictions. We construct the first LiDAR range-view-based UDA benchmark and systematically analyze the potential causes of the domain discrepancies. Through extensive experiments, we demonstrate that ConDA is significantly more effective in mitigating the domain gap compared to the state-of-the-art methods in both adversarial training and self-training.
first_indexed 2024-10-01T07:39:25Z
format Thesis-Master by Research
id ntu-10356/158401
institution Nanyang Technological University
language English
last_indexed 2024-10-01T07:39:25Z
publishDate 2022
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1584012022-06-03T14:25:12Z Unsupervised domain adaptation for LiDAR segmentation Kong, Lingdong Zhang Hanwang School of Computer Science and Engineering hanwangzhang@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Transferring knowledge learned from the labeled source domain to the raw target domain for unsupervised domain adaptation (UDA) is essential to the scalable deployment of an autonomous driving system. State-of-the-art approaches in UDA often employ a key concept: utilize joint supervision signals from both the source domain (with ground-truth) and the target domain (with pseudo-labels) for self-training. In this work, we improve and extend on this aspect. We present ConDA, a concatenation-based domain adaptation framework for LiDAR semantic segmentation that: (1) constructs an intermediate domain consisting of fine-grained interchange signals from both source and target domains without destabilizing the semantic coherency of objects and background around the ego-vehicle; and (2) utilizes the intermediate domain for self-training. Additionally, to improve both the network training on the source domain and self-training on the intermediate domain, we propose an anti-aliasing regularizer and an entropy aggregator to reduce the detrimental effects of aliasing artifacts and noisy target predictions. We construct the first LiDAR range-view-based UDA benchmark and systematically analyze the potential causes of the domain discrepancies. Through extensive experiments, we demonstrate that ConDA is significantly more effective in mitigating the domain gap compared to the state-of-the-art methods in both adversarial training and self-training. Master of Engineering 2022-05-25T02:49:59Z 2022-05-25T02:49:59Z 2022 Thesis-Master by Research Kong, L. (2022). Unsupervised domain adaptation for LiDAR segmentation. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/158401 https://hdl.handle.net/10356/158401 10.32657/10356/158401 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Kong, Lingdong
Unsupervised domain adaptation for LiDAR segmentation
title Unsupervised domain adaptation for LiDAR segmentation
title_full Unsupervised domain adaptation for LiDAR segmentation
title_fullStr Unsupervised domain adaptation for LiDAR segmentation
title_full_unstemmed Unsupervised domain adaptation for LiDAR segmentation
title_short Unsupervised domain adaptation for LiDAR segmentation
title_sort unsupervised domain adaptation for lidar segmentation
topic Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
url https://hdl.handle.net/10356/158401
work_keys_str_mv AT konglingdong unsuperviseddomainadaptationforlidarsegmentation