PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION

Recent years have shown a shift from pure geometric 3D city models to data with semantics. This is induced by new applications (e.g. Virtual/Augmented Reality) and also a requirement for concepts like Smart Cities. However, essential urban semantic data like building use categories is often not av...

Full description

Bibliographic Details
Main Authors: P. Tutzauer, N. Haala
Format: Article
Language:English
Published: Copernicus Publications 2017-05-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1-W1/143/2017/isprs-archives-XLII-1-W1-143-2017.pdf
_version_ 1811273961070133248
author P. Tutzauer
N. Haala
author_facet P. Tutzauer
N. Haala
author_sort P. Tutzauer
collection DOAJ
description Recent years have shown a shift from pure geometric 3D city models to data with semantics. This is induced by new applications (e.g. Virtual/Augmented Reality) and also a requirement for concepts like Smart Cities. However, essential urban semantic data like building use categories is often not available. We present a first step in bridging this gap by proposing a pipeline to use crawled urban imagery and link it with ground truth cadastral data as an input for automatic building use classification. We aim to extract this city-relevant semantic information automatically from Street View (SV) imagery. Convolutional Neural Networks (CNNs) proved to be extremely successful for image interpretation, however, require a huge amount of training data. Main contribution of the paper is the automatic provision of such training datasets by linking semantic information as already available from databases provided from national mapping agencies or city administrations to the corresponding façade images extracted from SV. Finally, we present first investigations with a CNN and an alternative classifier as a proof of concept.
first_indexed 2024-04-12T23:09:07Z
format Article
id doaj.art-291ebd35de3e4138b3409a694adf5e82
institution Directory Open Access Journal
issn 1682-1750
2194-9034
language English
last_indexed 2024-04-12T23:09:07Z
publishDate 2017-05-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj.art-291ebd35de3e4138b3409a694adf5e822022-12-22T03:12:50ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342017-05-01XLII-1-W114314910.5194/isprs-archives-XLII-1-W1-143-2017PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATIONP. Tutzauer0N. Haala1Institute for Photogrammetry, University of Stuttgart, GermanyInstitute for Photogrammetry, University of Stuttgart, GermanyRecent years have shown a shift from pure geometric 3D city models to data with semantics. This is induced by new applications (e.g. Virtual/Augmented Reality) and also a requirement for concepts like Smart Cities. However, essential urban semantic data like building use categories is often not available. We present a first step in bridging this gap by proposing a pipeline to use crawled urban imagery and link it with ground truth cadastral data as an input for automatic building use classification. We aim to extract this city-relevant semantic information automatically from Street View (SV) imagery. Convolutional Neural Networks (CNNs) proved to be extremely successful for image interpretation, however, require a huge amount of training data. Main contribution of the paper is the automatic provision of such training datasets by linking semantic information as already available from databases provided from national mapping agencies or city administrations to the corresponding façade images extracted from SV. Finally, we present first investigations with a CNN and an alternative classifier as a proof of concept.http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1-W1/143/2017/isprs-archives-XLII-1-W1-143-2017.pdf
spellingShingle P. Tutzauer
N. Haala
PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION
title_full PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION
title_fullStr PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION
title_full_unstemmed PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION
title_short PROCESSING OF CRAWLED URBAN IMAGERY FOR BUILDING USE CLASSIFICATION
title_sort processing of crawled urban imagery for building use classification
url http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1-W1/143/2017/isprs-archives-XLII-1-W1-143-2017.pdf
work_keys_str_mv AT ptutzauer processingofcrawledurbanimageryforbuildinguseclassification
AT nhaala processingofcrawledurbanimageryforbuildinguseclassification