Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China

This paper presents a novel approach for semantic segmentation of building roofs in dense urban environments with a Deep Convolution Neural Network (DCNN) using Chinese Very High Resolution (VHR) satellite (i.e., GF2) imagery. To provide an operational end-to-end approach for accurately mapping buil...

Full description

Bibliographic Details
Main Authors: Yuchu Qin, Yunchao Wu, Bin Li, Shuai Gao, Miao Liu, Yulin Zhan
Format: Article
Language:English
Published: MDPI AG 2019-03-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/19/5/1164
_version_ 1811213448708620288
author Yuchu Qin
Yunchao Wu
Bin Li
Shuai Gao
Miao Liu
Yulin Zhan
author_facet Yuchu Qin
Yunchao Wu
Bin Li
Shuai Gao
Miao Liu
Yulin Zhan
author_sort Yuchu Qin
collection DOAJ
description This paper presents a novel approach for semantic segmentation of building roofs in dense urban environments with a Deep Convolution Neural Network (DCNN) using Chinese Very High Resolution (VHR) satellite (i.e., GF2) imagery. To provide an operational end-to-end approach for accurately mapping build roofs with feature extraction and image segmentation, a fully convolutional DCNN with both convolutional and deconvolutional layers is designed to perform building roof segmentation. We selected typical cities with dense and diverse urban environments in different metropolitan regions of China as study areas, and sample images were collected over cities. High performance GPU-mounted workstations are employed to perform the model training and optimization. With the building roof samples collected over different cities, the predictive model with convolution layers is developed for building roof segmentation. The validation shows that the overall accuracy (OA) and the mean Intersection Over Union (mIOU) of DCNN-based semantic segmentation results are 94.67% and 0.85, respectively, and the CRF-refined segmentation results achieved OA of 94.69% and mIOU of 0.83. The results suggest that the proposed approach is a promising solution for building roof mapping with VHR images over large areas in dense urban environments with different building patterns. With the operational acquisition of GF2 VHR imagery, it is expected to develop an automated pipeline of operational built-up area monitoring, and the timely update of building roof map could be applied in urban management and assessment of human settlement-related sustainable development goals over large areas.
first_indexed 2024-04-12T05:45:51Z
format Article
id doaj.art-ed47f859a0f24802a43091b6aab4d076
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-12T05:45:51Z
publishDate 2019-03-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-ed47f859a0f24802a43091b6aab4d0762022-12-22T03:45:27ZengMDPI AGSensors1424-82202019-03-01195116410.3390/s19051164s19051164Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in ChinaYuchu Qin0Yunchao Wu1Bin Li2Shuai Gao3Miao Liu4Yulin Zhan5State Key Lab of Remote Sensing Sciences, Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing 100101, ChinaBeijing Municipal Institute of City Planning & Design, Beijing 100045, ChinaState Key Lab of Remote Sensing Sciences, Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing 100101, ChinaState Key Lab of Remote Sensing Sciences, Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing 100101, ChinaDepartment of Mathematics & Statistics, South Dakota State University, Brookings, 57006 SD, USAState Key Lab of Remote Sensing Sciences, Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing 100101, ChinaThis paper presents a novel approach for semantic segmentation of building roofs in dense urban environments with a Deep Convolution Neural Network (DCNN) using Chinese Very High Resolution (VHR) satellite (i.e., GF2) imagery. To provide an operational end-to-end approach for accurately mapping build roofs with feature extraction and image segmentation, a fully convolutional DCNN with both convolutional and deconvolutional layers is designed to perform building roof segmentation. We selected typical cities with dense and diverse urban environments in different metropolitan regions of China as study areas, and sample images were collected over cities. High performance GPU-mounted workstations are employed to perform the model training and optimization. With the building roof samples collected over different cities, the predictive model with convolution layers is developed for building roof segmentation. The validation shows that the overall accuracy (OA) and the mean Intersection Over Union (mIOU) of DCNN-based semantic segmentation results are 94.67% and 0.85, respectively, and the CRF-refined segmentation results achieved OA of 94.69% and mIOU of 0.83. The results suggest that the proposed approach is a promising solution for building roof mapping with VHR images over large areas in dense urban environments with different building patterns. With the operational acquisition of GF2 VHR imagery, it is expected to develop an automated pipeline of operational built-up area monitoring, and the timely update of building roof map could be applied in urban management and assessment of human settlement-related sustainable development goals over large areas.http://www.mdpi.com/1424-8220/19/5/1164VHR imagebuilding roofsegmentationGF2deep convolution neural network
spellingShingle Yuchu Qin
Yunchao Wu
Bin Li
Shuai Gao
Miao Liu
Yulin Zhan
Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
Sensors
VHR image
building roof
segmentation
GF2
deep convolution neural network
title Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
title_full Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
title_fullStr Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
title_full_unstemmed Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
title_short Semantic Segmentation of Building Roof in Dense Urban Environment with Deep Convolutional Neural Network: A Case Study Using GF2 VHR Imagery in China
title_sort semantic segmentation of building roof in dense urban environment with deep convolutional neural network a case study using gf2 vhr imagery in china
topic VHR image
building roof
segmentation
GF2
deep convolution neural network
url http://www.mdpi.com/1424-8220/19/5/1164
work_keys_str_mv AT yuchuqin semanticsegmentationofbuildingroofindenseurbanenvironmentwithdeepconvolutionalneuralnetworkacasestudyusinggf2vhrimageryinchina
AT yunchaowu semanticsegmentationofbuildingroofindenseurbanenvironmentwithdeepconvolutionalneuralnetworkacasestudyusinggf2vhrimageryinchina
AT binli semanticsegmentationofbuildingroofindenseurbanenvironmentwithdeepconvolutionalneuralnetworkacasestudyusinggf2vhrimageryinchina
AT shuaigao semanticsegmentationofbuildingroofindenseurbanenvironmentwithdeepconvolutionalneuralnetworkacasestudyusinggf2vhrimageryinchina
AT miaoliu semanticsegmentationofbuildingroofindenseurbanenvironmentwithdeepconvolutionalneuralnetworkacasestudyusinggf2vhrimageryinchina
AT yulinzhan semanticsegmentationofbuildingroofindenseurbanenvironmentwithdeepconvolutionalneuralnetworkacasestudyusinggf2vhrimageryinchina