Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors

Spectral imaging systems capture spectral and spatial information from a scene to produce a spectral data cube. Technical progress has allowed developing multispectral filter array (MSFA)-based sensors in order to expand the reconstruction of more bands than RGB cameras. However, reconstructing the...

Full description

Bibliographic Details
Main Authors: Yuri Hercilia Mejía-Melgarejo, Ofelia Patricia Villarreal-Dulcey, Henry Arguello-Fuentes
Format: Article
Language:English
Published: Universidad de Antioquia 2016-03-01
Series:Revista Facultad de Ingeniería Universidad de Antioquia
Subjects:
Online Access:https://revistas.udea.edu.co/index.php/ingenieria/article/view/23178
_version_ 1797861774079295488
author Yuri Hercilia Mejía-Melgarejo
Ofelia Patricia Villarreal-Dulcey
Henry Arguello-Fuentes
author_facet Yuri Hercilia Mejía-Melgarejo
Ofelia Patricia Villarreal-Dulcey
Henry Arguello-Fuentes
author_sort Yuri Hercilia Mejía-Melgarejo
collection DOAJ
description Spectral imaging systems capture spectral and spatial information from a scene to produce a spectral data cube. Technical progress has allowed developing multispectral filter array (MSFA)-based sensors in order to expand the reconstruction of more bands than RGB cameras. However, reconstructing the spectral image with traditional methods following a least squares or demosaicing approach is unfeasible. Some works in the literature implement multispectral demosaicing for reconstructing images with specific spatio-spectral resolution depending on the number of pixels in the detector and the filter mosaic. Recently, compressive sensing technique has been developed that allows reconstructing signals with fewer measurements than the traditional methods by using the sparse representation of a signal. The selection of neighborhoods pixels in the MSFA-based sensor to calculate the spectral response of a single pixel in the reconstructed spectral images could improve the reconstruction, based on exploiting the sparse representation of the spectral images. This paper proposes two models for spectral images reconstruction from the selection of MSFA-based sensor measurements neighborhoods using the principle of compressive sensing. The spatial resolution of the reconstructed spectral images is adjusted depending the size of the neighborhood. To verify the effectiveness of the reconstruction models simulated measurements for synthetic spectral images and real spectral images based on MSFA are used. Ensembles of random dichroic and random band pass filters are used. The two approaches with traditional scheme reconstructions of mosaic filters are compared. The proposed methods improve the quality (PSNR) of the image reconstruction up 7 dB for real spectral images.
first_indexed 2024-04-09T22:09:48Z
format Article
id doaj.art-9dfe200a348c40c4809d7886e874138a
institution Directory Open Access Journal
issn 0120-6230
2422-2844
language English
last_indexed 2024-04-09T22:09:48Z
publishDate 2016-03-01
publisher Universidad de Antioquia
record_format Article
series Revista Facultad de Ingeniería Universidad de Antioquia
spelling doaj.art-9dfe200a348c40c4809d7886e874138a2023-03-23T12:30:30ZengUniversidad de AntioquiaRevista Facultad de Ingeniería Universidad de Antioquia0120-62302422-28442016-03-017810.17533/udea.redin.n78a12Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensorsYuri Hercilia Mejía-Melgarejo0Ofelia Patricia Villarreal-Dulcey1Henry Arguello-Fuentes2Industrial University of SantanderIndustrial University of SantanderUniversidad Industrial de Santander Spectral imaging systems capture spectral and spatial information from a scene to produce a spectral data cube. Technical progress has allowed developing multispectral filter array (MSFA)-based sensors in order to expand the reconstruction of more bands than RGB cameras. However, reconstructing the spectral image with traditional methods following a least squares or demosaicing approach is unfeasible. Some works in the literature implement multispectral demosaicing for reconstructing images with specific spatio-spectral resolution depending on the number of pixels in the detector and the filter mosaic. Recently, compressive sensing technique has been developed that allows reconstructing signals with fewer measurements than the traditional methods by using the sparse representation of a signal. The selection of neighborhoods pixels in the MSFA-based sensor to calculate the spectral response of a single pixel in the reconstructed spectral images could improve the reconstruction, based on exploiting the sparse representation of the spectral images. This paper proposes two models for spectral images reconstruction from the selection of MSFA-based sensor measurements neighborhoods using the principle of compressive sensing. The spatial resolution of the reconstructed spectral images is adjusted depending the size of the neighborhood. To verify the effectiveness of the reconstruction models simulated measurements for synthetic spectral images and real spectral images based on MSFA are used. Ensembles of random dichroic and random band pass filters are used. The two approaches with traditional scheme reconstructions of mosaic filters are compared. The proposed methods improve the quality (PSNR) of the image reconstruction up 7 dB for real spectral images. https://revistas.udea.edu.co/index.php/ingenieria/article/view/23178multispectral filter array-based sensorscompressive sensingspectral images
spellingShingle Yuri Hercilia Mejía-Melgarejo
Ofelia Patricia Villarreal-Dulcey
Henry Arguello-Fuentes
Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
Revista Facultad de Ingeniería Universidad de Antioquia
multispectral filter array-based sensors
compressive sensing
spectral images
title Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
title_full Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
title_fullStr Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
title_full_unstemmed Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
title_short Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
title_sort adjustable spatial resolution of compressive spectral images sensed by multispectral filter array based sensors
topic multispectral filter array-based sensors
compressive sensing
spectral images
url https://revistas.udea.edu.co/index.php/ingenieria/article/view/23178
work_keys_str_mv AT yuriherciliamejiamelgarejo adjustablespatialresolutionofcompressivespectralimagessensedbymultispectralfilterarraybasedsensors
AT ofeliapatriciavillarrealdulcey adjustablespatialresolutionofcompressivespectralimagessensedbymultispectralfilterarraybasedsensors
AT henryarguellofuentes adjustablespatialresolutionofcompressivespectralimagessensedbymultispectralfilterarraybasedsensors