Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
In this paper, we introduce an in-depth application of high-resolution disparity map estimation using stereo images from Mars Curiosity rover’s Mastcams, which have two imagers with different resolutions. The left Mastcam has three times lower resolution as that of the right. The left Mast...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-08-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/19/16/3526 |
_version_ | 1798003405554188288 |
---|---|
author | Bulent Ayhan Chiman Kwan |
author_facet | Bulent Ayhan Chiman Kwan |
author_sort | Bulent Ayhan |
collection | DOAJ |
description | In this paper, we introduce an in-depth application of high-resolution disparity map estimation using stereo images from Mars Curiosity rover’s Mastcams, which have two imagers with different resolutions. The left Mastcam has three times lower resolution as that of the right. The left Mastcam image’s resolution is first enhanced with three methods: Bicubic interpolation, pansharpening-based method, and a deep learning super resolution method. The enhanced left camera image and the right camera image are then used to estimate the disparity map. The impact of the left camera image enhancement is examined. The comparative performance analyses showed that the left camera enhancement results in getting more accurate disparity maps in comparison to using the original left Mastcam images for disparity map estimation. The deep learning-based method provided the best performance among the three for both image enhancement and disparity map estimation accuracy. A high-resolution disparity map, which is the result of the left camera image enhancement, is anticipated to improve the conducted science products in the Mastcam imagery such as 3D scene reconstructions, depth maps, and anaglyph images. |
first_indexed | 2024-04-11T12:07:04Z |
format | Article |
id | doaj.art-24c1f36189d54f87ad0ebb3b3563e925 |
institution | Directory Open Access Journal |
issn | 1424-8220 |
language | English |
last_indexed | 2024-04-11T12:07:04Z |
publishDate | 2019-08-01 |
publisher | MDPI AG |
record_format | Article |
series | Sensors |
spelling | doaj.art-24c1f36189d54f87ad0ebb3b3563e9252022-12-22T04:24:41ZengMDPI AGSensors1424-82202019-08-011916352610.3390/s19163526s19163526Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different ResolutionsBulent Ayhan0Chiman Kwan1Applied Research, LLC, Rockville, MD 20850, USAApplied Research, LLC, Rockville, MD 20850, USAIn this paper, we introduce an in-depth application of high-resolution disparity map estimation using stereo images from Mars Curiosity rover’s Mastcams, which have two imagers with different resolutions. The left Mastcam has three times lower resolution as that of the right. The left Mastcam image’s resolution is first enhanced with three methods: Bicubic interpolation, pansharpening-based method, and a deep learning super resolution method. The enhanced left camera image and the right camera image are then used to estimate the disparity map. The impact of the left camera image enhancement is examined. The comparative performance analyses showed that the left camera enhancement results in getting more accurate disparity maps in comparison to using the original left Mastcam images for disparity map estimation. The deep learning-based method provided the best performance among the three for both image enhancement and disparity map estimation accuracy. A high-resolution disparity map, which is the result of the left camera image enhancement, is anticipated to improve the conducted science products in the Mastcam imagery such as 3D scene reconstructions, depth maps, and anaglyph images.https://www.mdpi.com/1424-8220/19/16/3526image resolutionimage enhancementMastcamdisparity mapdepth map |
spellingShingle | Bulent Ayhan Chiman Kwan Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions Sensors image resolution image enhancement Mastcam disparity map depth map |
title | Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions |
title_full | Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions |
title_fullStr | Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions |
title_full_unstemmed | Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions |
title_short | Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions |
title_sort | mastcam image resolution enhancement with application to disparity map generation for stereo images with different resolutions |
topic | image resolution image enhancement Mastcam disparity map depth map |
url | https://www.mdpi.com/1424-8220/19/16/3526 |
work_keys_str_mv | AT bulentayhan mastcamimageresolutionenhancementwithapplicationtodisparitymapgenerationforstereoimageswithdifferentresolutions AT chimankwan mastcamimageresolutionenhancementwithapplicationtodisparitymapgenerationforstereoimageswithdifferentresolutions |