A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis

Continental and global datasets based on earth observations or computational models challenge the existing map algebra approaches. The available datasets differ in their spatio-temporal extents and their spatio-temporal granularity, which makes it difficult to process them as time series data in map...

Full description

Bibliographic Details
Main Authors: Sören Gebbert, Thomas Leppelt, Edzer Pebesma
Format: Article
Language:English
Published: MDPI AG 2019-06-01
Series:Data
Subjects:
Online Access:https://www.mdpi.com/2306-5729/4/2/86
_version_ 1811185132888915968
author Sören Gebbert
Thomas Leppelt
Edzer Pebesma
author_facet Sören Gebbert
Thomas Leppelt
Edzer Pebesma
author_sort Sören Gebbert
collection DOAJ
description Continental and global datasets based on earth observations or computational models challenge the existing map algebra approaches. The available datasets differ in their spatio-temporal extents and their spatio-temporal granularity, which makes it difficult to process them as time series data in map algebra expressions. To address this issue we introduce a new map algebra approach that is topology based. This topology based map algebra uses spatio-temporal topological operators (STTOP and STTCOP) to specify spatio-temporal operations between topological related map layers of different time-series data. We have implemented several topology based map algebra tools in the open source geoinformation system GRASS GIS and its open source cloud processing engine actinia. We demonstrate the application of our topology based map algebra by solving real world big data problems using a single algebraic expression. This included the massively parallel computation of the NDVI from a series of 100 Sentinel2A scenes organized as earth observation data cubes. The processing was performed and benchmarked on a many core computer setup and in a distributed container environment. The design of our topology based map algebra allows us to deploy it as a standardized service in the EU Horizon 2020 project openEO.
first_indexed 2024-04-11T13:24:14Z
format Article
id doaj.art-14a2bd2c4bb94c698da270bb033ed8d6
institution Directory Open Access Journal
issn 2306-5729
language English
last_indexed 2024-04-11T13:24:14Z
publishDate 2019-06-01
publisher MDPI AG
record_format Article
series Data
spelling doaj.art-14a2bd2c4bb94c698da270bb033ed8d62022-12-22T04:22:06ZengMDPI AGData2306-57292019-06-01428610.3390/data4020086data4020086A Topology Based Spatio-Temporal Map Algebra for Big Data AnalysisSören Gebbert0Thomas Leppelt1Edzer Pebesma2Institute for Geoinformatics, University of Münster, Heisenbergstraße 2, 48149 Münster, GermanyDeutscher Wetterdienst, Frankfurter Straße 135, 63067 Offenbach am Main, GermanyInstitute for Geoinformatics, University of Münster, Heisenbergstraße 2, 48149 Münster, GermanyContinental and global datasets based on earth observations or computational models challenge the existing map algebra approaches. The available datasets differ in their spatio-temporal extents and their spatio-temporal granularity, which makes it difficult to process them as time series data in map algebra expressions. To address this issue we introduce a new map algebra approach that is topology based. This topology based map algebra uses spatio-temporal topological operators (STTOP and STTCOP) to specify spatio-temporal operations between topological related map layers of different time-series data. We have implemented several topology based map algebra tools in the open source geoinformation system GRASS GIS and its open source cloud processing engine actinia. We demonstrate the application of our topology based map algebra by solving real world big data problems using a single algebraic expression. This included the massively parallel computation of the NDVI from a series of 100 Sentinel2A scenes organized as earth observation data cubes. The processing was performed and benchmarked on a many core computer setup and in a distributed container environment. The design of our topology based map algebra allows us to deploy it as a standardized service in the EU Horizon 2020 project openEO.https://www.mdpi.com/2306-5729/4/2/86topology based map algebradata cubesbig datamap algebraearth oberservationGRASS GIS
spellingShingle Sören Gebbert
Thomas Leppelt
Edzer Pebesma
A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis
Data
topology based map algebra
data cubes
big data
map algebra
earth oberservation
GRASS GIS
title A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis
title_full A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis
title_fullStr A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis
title_full_unstemmed A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis
title_short A Topology Based Spatio-Temporal Map Algebra for Big Data Analysis
title_sort topology based spatio temporal map algebra for big data analysis
topic topology based map algebra
data cubes
big data
map algebra
earth oberservation
GRASS GIS
url https://www.mdpi.com/2306-5729/4/2/86
work_keys_str_mv AT sorengebbert atopologybasedspatiotemporalmapalgebraforbigdataanalysis
AT thomasleppelt atopologybasedspatiotemporalmapalgebraforbigdataanalysis
AT edzerpebesma atopologybasedspatiotemporalmapalgebraforbigdataanalysis
AT sorengebbert topologybasedspatiotemporalmapalgebraforbigdataanalysis
AT thomasleppelt topologybasedspatiotemporalmapalgebraforbigdataanalysis
AT edzerpebesma topologybasedspatiotemporalmapalgebraforbigdataanalysis