Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images

Registration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images...

Full description

Bibliographic Details
Main Authors: Alper Koz, Ufuk Efe
Format: Article
Language:English
Published: MDPI AG 2021-06-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/13/2465
_version_ 1827688844765429760
author Alper Koz
Ufuk Efe
author_facet Alper Koz
Ufuk Efe
author_sort Alper Koz
collection DOAJ
description Registration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images is investigated to enhance applications of LWIR images such as change detection, temperature and emissivity separation, and target detection. The proposed approach first searches for the best features of hyperspectral image pixels for extraction and matching in the LWIR range and then performs a global registration over two-dimensional maps of three-dimensional hyperspectral cubes. The performances of temperature and emissivity features in the thermal domain along with the average energy and principal components of spectral radiance are investigated. The global registration performed over whole 2D maps is further improved by blockwise local refinements. Among the two proposed approaches, the geometric refinement seeks the best keypoint combination in the neighborhood of each block to estimate the transformation for that block. The alternative optimization-based refinement iteratively finds the best transformation by maximizing the similarity of the reference and transformed blocks. The possible blocking artifacts due to blockwise mapping are finally eliminated by pixelwise refinement. The experiments are evaluated with respect to the (i) utilized similarity metrics in the LWIR range between transformed and reference blocks, (ii) proposed geometric- and optimization-based methods, and (iii) image pairs captured on the same and different days. The better performance of the proposed approach compared to manual, GPU-IMU-based, and state-of-the-art image registration methods is verified.
first_indexed 2024-03-10T10:05:22Z
format Article
id doaj.art-34f5048ce6114840839382bdea89ab92
institution Directory Open Access Journal
issn 2072-4292
language English
last_indexed 2024-03-10T10:05:22Z
publishDate 2021-06-01
publisher MDPI AG
record_format Article
series Remote Sensing
spelling doaj.art-34f5048ce6114840839382bdea89ab922023-11-22T01:33:27ZengMDPI AGRemote Sensing2072-42922021-06-011313246510.3390/rs13132465Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral ImagesAlper Koz0Ufuk Efe1Center for Image Analysis (OGAM), Middle East Technical University, 06800 Ankara, TurkeyCenter for Image Analysis (OGAM), Middle East Technical University, 06800 Ankara, TurkeyRegistration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images is investigated to enhance applications of LWIR images such as change detection, temperature and emissivity separation, and target detection. The proposed approach first searches for the best features of hyperspectral image pixels for extraction and matching in the LWIR range and then performs a global registration over two-dimensional maps of three-dimensional hyperspectral cubes. The performances of temperature and emissivity features in the thermal domain along with the average energy and principal components of spectral radiance are investigated. The global registration performed over whole 2D maps is further improved by blockwise local refinements. Among the two proposed approaches, the geometric refinement seeks the best keypoint combination in the neighborhood of each block to estimate the transformation for that block. The alternative optimization-based refinement iteratively finds the best transformation by maximizing the similarity of the reference and transformed blocks. The possible blocking artifacts due to blockwise mapping are finally eliminated by pixelwise refinement. The experiments are evaluated with respect to the (i) utilized similarity metrics in the LWIR range between transformed and reference blocks, (ii) proposed geometric- and optimization-based methods, and (iii) image pairs captured on the same and different days. The better performance of the proposed approach compared to manual, GPU-IMU-based, and state-of-the-art image registration methods is verified.https://www.mdpi.com/2072-4292/13/13/2465long-wave infraredhyperspectral image registrationtemperatureemissivitykeypointsoptimization
spellingShingle Alper Koz
Ufuk Efe
Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
Remote Sensing
long-wave infrared
hyperspectral image registration
temperature
emissivity
keypoints
optimization
title Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
title_full Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
title_fullStr Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
title_full_unstemmed Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
title_short Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
title_sort geometric and optimization based registration methods for long wave infrared hyperspectral images
topic long-wave infrared
hyperspectral image registration
temperature
emissivity
keypoints
optimization
url https://www.mdpi.com/2072-4292/13/13/2465
work_keys_str_mv AT alperkoz geometricandoptimizationbasedregistrationmethodsforlongwaveinfraredhyperspectralimages
AT ufukefe geometricandoptimizationbasedregistrationmethodsforlongwaveinfraredhyperspectralimages