An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning

Urban trees, as a characteristic element of the urban ecosystem, exert significant influences on climate supervision. Therefore, the extraction of individual trees in urban areas holds significant research value. However, the complexity of features in urban areas poses challenges to existing single...

Full description

Bibliographic Details
Main Authors: Jian Yang, Ruilin Gan, Binhan Luo, Ao Wang, Shuo Shi, Lin Du
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10460110/
_version_ 1827308179206176768
author Jian Yang
Ruilin Gan
Binhan Luo
Ao Wang
Shuo Shi
Lin Du
author_facet Jian Yang
Ruilin Gan
Binhan Luo
Ao Wang
Shuo Shi
Lin Du
author_sort Jian Yang
collection DOAJ
description Urban trees, as a characteristic element of the urban ecosystem, exert significant influences on climate supervision. Therefore, the extraction of individual trees in urban areas holds significant research value. However, the complexity of features in urban areas poses challenges to existing single tree segmentation algorithms, as they may be influenced by other nontree features. In this study, to reduce the influence of nontree categories, enhance the identification of edge features between adjacent tree crowns, and achieve precise delineation results of the single urban tree, an improved multistage method was proposed for tree points extraction and individual tree segmentation in urban scenes using multispectral LiDAR. First, the original three single-channel point clouds were preprocessed by intensity interpolation to generate a three-wavelength multispectral point cloud. Second, the Point Transformer deep learning network was employed for extracting urban tree points. Third, an improved tree mapping algorithm was introduced for individual tree segmentation in urban scenes, utilizing the extracted tree points. Finally, manual individual tree labeling and the high-resolution digital orthophoto map of the region were incorporated to measure the delineation precision of individual trees. It shows that the intersection over union of tree category in urban scene reaches 96.0%. Moreover, the F1-score for overall individual tree segmentation attains 92.8%. However, a comparison with existing algorithms reveals that the proposed method outperforms the traditional raster-based watershed method or point cloud clustering-based layer-stacking approach in the urban scene, improving the overall accuracy of single tree segmentation by 21.9% and 16.0%, respectively. These results highlight the enhanced applicability of the proposed multistage algorithm for urban scenes.
first_indexed 2024-04-24T18:52:52Z
format Article
id doaj.art-755b9d7c7c524a8c84d3bb9652e06f00
institution Directory Open Access Journal
issn 2151-1535
language English
last_indexed 2024-04-24T18:52:52Z
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
spelling doaj.art-755b9d7c7c524a8c84d3bb9652e06f002024-03-26T17:48:03ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352024-01-01176561657610.1109/JSTARS.2024.337339510460110An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep LearningJian Yang0https://orcid.org/0000-0003-3621-4169Ruilin Gan1https://orcid.org/0009-0000-9243-6095Binhan Luo2https://orcid.org/0000-0001-7575-4892Ao Wang3Shuo Shi4https://orcid.org/0000-0003-0008-3443Lin Du5https://orcid.org/0000-0002-4789-6073School of Geography and Information Engineering, China University of Geosciences, Wuhan, ChinaSchool of Geography and Information Engineering, China University of Geosciences, Wuhan, ChinaSchool of Geography and Information Engineering, China University of Geosciences, Wuhan, ChinaSchool of Geography and Information Engineering, China University of Geosciences, Wuhan, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, ChinaSchool of Geography and Information Engineering, China University of Geosciences, Wuhan, ChinaUrban trees, as a characteristic element of the urban ecosystem, exert significant influences on climate supervision. Therefore, the extraction of individual trees in urban areas holds significant research value. However, the complexity of features in urban areas poses challenges to existing single tree segmentation algorithms, as they may be influenced by other nontree features. In this study, to reduce the influence of nontree categories, enhance the identification of edge features between adjacent tree crowns, and achieve precise delineation results of the single urban tree, an improved multistage method was proposed for tree points extraction and individual tree segmentation in urban scenes using multispectral LiDAR. First, the original three single-channel point clouds were preprocessed by intensity interpolation to generate a three-wavelength multispectral point cloud. Second, the Point Transformer deep learning network was employed for extracting urban tree points. Third, an improved tree mapping algorithm was introduced for individual tree segmentation in urban scenes, utilizing the extracted tree points. Finally, manual individual tree labeling and the high-resolution digital orthophoto map of the region were incorporated to measure the delineation precision of individual trees. It shows that the intersection over union of tree category in urban scene reaches 96.0%. Moreover, the F1-score for overall individual tree segmentation attains 92.8%. However, a comparison with existing algorithms reveals that the proposed method outperforms the traditional raster-based watershed method or point cloud clustering-based layer-stacking approach in the urban scene, improving the overall accuracy of single tree segmentation by 21.9% and 16.0%, respectively. These results highlight the enhanced applicability of the proposed multistage algorithm for urban scenes.https://ieeexplore.ieee.org/document/10460110/Individual tree crown (ITC) segmentationmultispectral LiDARpoint cloud deep learningtree points extractionurban scene
spellingShingle Jian Yang
Ruilin Gan
Binhan Luo
Ao Wang
Shuo Shi
Lin Du
An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Individual tree crown (ITC) segmentation
multispectral LiDAR
point cloud deep learning
tree points extraction
urban scene
title An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
title_full An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
title_fullStr An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
title_full_unstemmed An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
title_short An Improved Method for Individual Tree Segmentation in Complex Urban Scenes Based on Using Multispectral LiDAR by Deep Learning
title_sort improved method for individual tree segmentation in complex urban scenes based on using multispectral lidar by deep learning
topic Individual tree crown (ITC) segmentation
multispectral LiDAR
point cloud deep learning
tree points extraction
urban scene
url https://ieeexplore.ieee.org/document/10460110/
work_keys_str_mv AT jianyang animprovedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT ruilingan animprovedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT binhanluo animprovedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT aowang animprovedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT shuoshi animprovedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT lindu animprovedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT jianyang improvedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT ruilingan improvedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT binhanluo improvedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT aowang improvedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT shuoshi improvedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning
AT lindu improvedmethodforindividualtreesegmentationincomplexurbanscenesbasedonusingmultispectrallidarbydeeplearning