Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation

Abstract In a previous article, we modelled the spectral and temporal dimensions of the photodegradation behaviour of pigments in the painting “A Japanese Lantern” by Oda Krohg. In particular, we extracted the endmembers and spectral fading rate of pigments by applying tensor decomposition on a time...

Full description

Bibliographic Details
Main Authors: Irina M. Ciortan, Tina G. Poulsson, Sony George, Jon Y. Hardeberg
Format: Article
Language:English
Published: SpringerOpen 2023-04-01
Series:Heritage Science
Subjects:
Online Access:https://doi.org/10.1186/s40494-023-00913-8
_version_ 1797836324895457280
author Irina M. Ciortan
Tina G. Poulsson
Sony George
Jon Y. Hardeberg
author_facet Irina M. Ciortan
Tina G. Poulsson
Sony George
Jon Y. Hardeberg
author_sort Irina M. Ciortan
collection DOAJ
description Abstract In a previous article, we modelled the spectral and temporal dimensions of the photodegradation behaviour of pigments in the painting “A Japanese Lantern” by Oda Krohg. In particular, we extracted the endmembers and spectral fading rate of pigments by applying tensor decomposition on a time-series of spectroscopic point measurements. Now, we capture the same painting with a hyperspectral imaging setup and propose an approach to render the fading effects as 2D images. More precisely, from the hyperspectral image, we compute the concentration maps of each previously identified endmember with a least-squares unmixing method. Subsequently, by using tensor algebra, we multiply the concentration maps with the endmembers and their corresponding fading rate and obtain a 4D tensor where each pixel in the image is described by a spectrum and a fading function. This way, we generate past and future spatio-temporal simulations of the painting’s appearance by reversing and elevating light exposure, respectively.
first_indexed 2024-04-09T15:06:59Z
format Article
id doaj.art-06d7c9ec299f4fec84c6d034e66b16f6
institution Directory Open Access Journal
issn 2050-7445
language English
last_indexed 2024-04-09T15:06:59Z
publishDate 2023-04-01
publisher SpringerOpen
record_format Article
series Heritage Science
spelling doaj.art-06d7c9ec299f4fec84c6d034e66b16f62023-04-30T11:23:47ZengSpringerOpenHeritage Science2050-74452023-04-0111111210.1186/s40494-023-00913-8Tensor decomposition for painting analysis. Part 2: spatio-temporal simulationIrina M. Ciortan0Tina G. Poulsson1Sony George2Jon Y. Hardeberg3Department of Computer Science, NTNU - Norwegian University of Science and TechnologyCollection Management, National MuseumDepartment of Computer Science, NTNU - Norwegian University of Science and TechnologyDepartment of Computer Science, NTNU - Norwegian University of Science and TechnologyAbstract In a previous article, we modelled the spectral and temporal dimensions of the photodegradation behaviour of pigments in the painting “A Japanese Lantern” by Oda Krohg. In particular, we extracted the endmembers and spectral fading rate of pigments by applying tensor decomposition on a time-series of spectroscopic point measurements. Now, we capture the same painting with a hyperspectral imaging setup and propose an approach to render the fading effects as 2D images. More precisely, from the hyperspectral image, we compute the concentration maps of each previously identified endmember with a least-squares unmixing method. Subsequently, by using tensor algebra, we multiply the concentration maps with the endmembers and their corresponding fading rate and obtain a 4D tensor where each pixel in the image is described by a spectrum and a fading function. This way, we generate past and future spatio-temporal simulations of the painting’s appearance by reversing and elevating light exposure, respectively.https://doi.org/10.1186/s40494-023-00913-8Spatio-temporal simulationTensor algebraMicrofadingSpectral photodegradation
spellingShingle Irina M. Ciortan
Tina G. Poulsson
Sony George
Jon Y. Hardeberg
Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation
Heritage Science
Spatio-temporal simulation
Tensor algebra
Microfading
Spectral photodegradation
title Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation
title_full Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation
title_fullStr Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation
title_full_unstemmed Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation
title_short Tensor decomposition for painting analysis. Part 2: spatio-temporal simulation
title_sort tensor decomposition for painting analysis part 2 spatio temporal simulation
topic Spatio-temporal simulation
Tensor algebra
Microfading
Spectral photodegradation
url https://doi.org/10.1186/s40494-023-00913-8
work_keys_str_mv AT irinamciortan tensordecompositionforpaintinganalysispart2spatiotemporalsimulation
AT tinagpoulsson tensordecompositionforpaintinganalysispart2spatiotemporalsimulation
AT sonygeorge tensordecompositionforpaintinganalysispart2spatiotemporalsimulation
AT jonyhardeberg tensordecompositionforpaintinganalysispart2spatiotemporalsimulation