Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images
Registration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-06-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | https://www.mdpi.com/2072-4292/13/13/2465 |
_version_ | 1827688844765429760 |
---|---|
author | Alper Koz Ufuk Efe |
author_facet | Alper Koz Ufuk Efe |
author_sort | Alper Koz |
collection | DOAJ |
description | Registration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images is investigated to enhance applications of LWIR images such as change detection, temperature and emissivity separation, and target detection. The proposed approach first searches for the best features of hyperspectral image pixels for extraction and matching in the LWIR range and then performs a global registration over two-dimensional maps of three-dimensional hyperspectral cubes. The performances of temperature and emissivity features in the thermal domain along with the average energy and principal components of spectral radiance are investigated. The global registration performed over whole 2D maps is further improved by blockwise local refinements. Among the two proposed approaches, the geometric refinement seeks the best keypoint combination in the neighborhood of each block to estimate the transformation for that block. The alternative optimization-based refinement iteratively finds the best transformation by maximizing the similarity of the reference and transformed blocks. The possible blocking artifacts due to blockwise mapping are finally eliminated by pixelwise refinement. The experiments are evaluated with respect to the (i) utilized similarity metrics in the LWIR range between transformed and reference blocks, (ii) proposed geometric- and optimization-based methods, and (iii) image pairs captured on the same and different days. The better performance of the proposed approach compared to manual, GPU-IMU-based, and state-of-the-art image registration methods is verified. |
first_indexed | 2024-03-10T10:05:22Z |
format | Article |
id | doaj.art-34f5048ce6114840839382bdea89ab92 |
institution | Directory Open Access Journal |
issn | 2072-4292 |
language | English |
last_indexed | 2024-03-10T10:05:22Z |
publishDate | 2021-06-01 |
publisher | MDPI AG |
record_format | Article |
series | Remote Sensing |
spelling | doaj.art-34f5048ce6114840839382bdea89ab922023-11-22T01:33:27ZengMDPI AGRemote Sensing2072-42922021-06-011313246510.3390/rs13132465Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral ImagesAlper Koz0Ufuk Efe1Center for Image Analysis (OGAM), Middle East Technical University, 06800 Ankara, TurkeyCenter for Image Analysis (OGAM), Middle East Technical University, 06800 Ankara, TurkeyRegistration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images is investigated to enhance applications of LWIR images such as change detection, temperature and emissivity separation, and target detection. The proposed approach first searches for the best features of hyperspectral image pixels for extraction and matching in the LWIR range and then performs a global registration over two-dimensional maps of three-dimensional hyperspectral cubes. The performances of temperature and emissivity features in the thermal domain along with the average energy and principal components of spectral radiance are investigated. The global registration performed over whole 2D maps is further improved by blockwise local refinements. Among the two proposed approaches, the geometric refinement seeks the best keypoint combination in the neighborhood of each block to estimate the transformation for that block. The alternative optimization-based refinement iteratively finds the best transformation by maximizing the similarity of the reference and transformed blocks. The possible blocking artifacts due to blockwise mapping are finally eliminated by pixelwise refinement. The experiments are evaluated with respect to the (i) utilized similarity metrics in the LWIR range between transformed and reference blocks, (ii) proposed geometric- and optimization-based methods, and (iii) image pairs captured on the same and different days. The better performance of the proposed approach compared to manual, GPU-IMU-based, and state-of-the-art image registration methods is verified.https://www.mdpi.com/2072-4292/13/13/2465long-wave infraredhyperspectral image registrationtemperatureemissivitykeypointsoptimization |
spellingShingle | Alper Koz Ufuk Efe Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images Remote Sensing long-wave infrared hyperspectral image registration temperature emissivity keypoints optimization |
title | Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images |
title_full | Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images |
title_fullStr | Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images |
title_full_unstemmed | Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images |
title_short | Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images |
title_sort | geometric and optimization based registration methods for long wave infrared hyperspectral images |
topic | long-wave infrared hyperspectral image registration temperature emissivity keypoints optimization |
url | https://www.mdpi.com/2072-4292/13/13/2465 |
work_keys_str_mv | AT alperkoz geometricandoptimizationbasedregistrationmethodsforlongwaveinfraredhyperspectralimages AT ufukefe geometricandoptimizationbasedregistrationmethodsforlongwaveinfraredhyperspectralimages |