Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs

Deep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-...

Full description

Bibliographic Details
Main Authors: Bashir Kazimi, Monika Sester
Format: Article
Language:English
Published: Ubiquity Press 2023-11-01
Series:Journal of Computer Applications in Archaeology
Subjects:
Online Access:https://account.journal.caa-international.org/index.php/up-j-jcaa/article/view/110
_version_ 1827576374397763584
author Bashir Kazimi
Monika Sester
author_facet Bashir Kazimi
Monika Sester
author_sort Bashir Kazimi
collection DOAJ
description Deep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-tunes it with a small labeled dataset (downstream task). We use unlabeled DTMs and Relief Visualizations (RVs) to train an encoder-decoder and a Generative Adversarial Network (GAN) in the pretext task and an annotated DTM dataset to fine-tune a semantic segmentation model in the downstream task. Experiments indicate that this approach produces better results than training from scratch or using models pretrained on image data like ImageNet. The code and pretrained weights for the encoder-decoder and the GAN models are made available on Github.1
first_indexed 2024-03-08T21:10:16Z
format Article
id doaj.art-4935ba563f7d443e9e0d9137499809d3
institution Directory Open Access Journal
issn 2514-8362
language English
last_indexed 2024-03-08T21:10:16Z
publishDate 2023-11-01
publisher Ubiquity Press
record_format Article
series Journal of Computer Applications in Archaeology
spelling doaj.art-4935ba563f7d443e9e0d9137499809d32023-12-22T06:35:31ZengUbiquity PressJournal of Computer Applications in Archaeology2514-83622023-11-0161155–173155–17310.5334/jcaa.11032Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMsBashir Kazimi0https://orcid.org/0000-0003-1802-7511Monika Sester1https://orcid.org/0000-0002-6656-8809Leibniz University Hannover Institute of Cartography and Geoinformatics Appelstr. 9a, 30167 HannoverLeibniz University Hannover Institute of Cartography and Geoinformatics Appelstr. 9a, 30167 HannoverDeep learning models need a lot of labeled data to work well. In this study, we use a Self-Supervised Learning (SSL) method for semantic segmentation of archaeological monuments in Digital Terrain Models (DTMs). This method first uses unlabeled data to pretrain a model (pretext task), and then fine-tunes it with a small labeled dataset (downstream task). We use unlabeled DTMs and Relief Visualizations (RVs) to train an encoder-decoder and a Generative Adversarial Network (GAN) in the pretext task and an annotated DTM dataset to fine-tune a semantic segmentation model in the downstream task. Experiments indicate that this approach produces better results than training from scratch or using models pretrained on image data like ImageNet. The code and pretrained weights for the encoder-decoder and the GAN models are made available on Github.1https://account.journal.caa-international.org/index.php/up-j-jcaa/article/view/110self-supervised learningdigital terrain modelsdeep learningarchaeologyconvolutional neural networksgenerative adversarial networksrelief visualization
spellingShingle Bashir Kazimi
Monika Sester
Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs
Journal of Computer Applications in Archaeology
self-supervised learning
digital terrain models
deep learning
archaeology
convolutional neural networks
generative adversarial networks
relief visualization
title Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs
title_full Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs
title_fullStr Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs
title_full_unstemmed Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs
title_short Self-Supervised Learning for Semantic Segmentation of Archaeological Monuments in DTMs
title_sort self supervised learning for semantic segmentation of archaeological monuments in dtms
topic self-supervised learning
digital terrain models
deep learning
archaeology
convolutional neural networks
generative adversarial networks
relief visualization
url https://account.journal.caa-international.org/index.php/up-j-jcaa/article/view/110
work_keys_str_mv AT bashirkazimi selfsupervisedlearningforsemanticsegmentationofarchaeologicalmonumentsindtms
AT monikasester selfsupervisedlearningforsemanticsegmentationofarchaeologicalmonumentsindtms