Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions

In this paper, we introduce an in-depth application of high-resolution disparity map estimation using stereo images from Mars Curiosity rover’s Mastcams, which have two imagers with different resolutions. The left Mastcam has three times lower resolution as that of the right. The left Mast...

Full description

Bibliographic Details
Main Authors: Bulent Ayhan, Chiman Kwan
Format: Article
Language:English
Published: MDPI AG 2019-08-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/19/16/3526
_version_ 1798003405554188288
author Bulent Ayhan
Chiman Kwan
author_facet Bulent Ayhan
Chiman Kwan
author_sort Bulent Ayhan
collection DOAJ
description In this paper, we introduce an in-depth application of high-resolution disparity map estimation using stereo images from Mars Curiosity rover’s Mastcams, which have two imagers with different resolutions. The left Mastcam has three times lower resolution as that of the right. The left Mastcam image’s resolution is first enhanced with three methods: Bicubic interpolation, pansharpening-based method, and a deep learning super resolution method. The enhanced left camera image and the right camera image are then used to estimate the disparity map. The impact of the left camera image enhancement is examined. The comparative performance analyses showed that the left camera enhancement results in getting more accurate disparity maps in comparison to using the original left Mastcam images for disparity map estimation. The deep learning-based method provided the best performance among the three for both image enhancement and disparity map estimation accuracy. A high-resolution disparity map, which is the result of the left camera image enhancement, is anticipated to improve the conducted science products in the Mastcam imagery such as 3D scene reconstructions, depth maps, and anaglyph images.
first_indexed 2024-04-11T12:07:04Z
format Article
id doaj.art-24c1f36189d54f87ad0ebb3b3563e925
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-11T12:07:04Z
publishDate 2019-08-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-24c1f36189d54f87ad0ebb3b3563e9252022-12-22T04:24:41ZengMDPI AGSensors1424-82202019-08-011916352610.3390/s19163526s19163526Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different ResolutionsBulent Ayhan0Chiman Kwan1Applied Research, LLC, Rockville, MD 20850, USAApplied Research, LLC, Rockville, MD 20850, USAIn this paper, we introduce an in-depth application of high-resolution disparity map estimation using stereo images from Mars Curiosity rover’s Mastcams, which have two imagers with different resolutions. The left Mastcam has three times lower resolution as that of the right. The left Mastcam image’s resolution is first enhanced with three methods: Bicubic interpolation, pansharpening-based method, and a deep learning super resolution method. The enhanced left camera image and the right camera image are then used to estimate the disparity map. The impact of the left camera image enhancement is examined. The comparative performance analyses showed that the left camera enhancement results in getting more accurate disparity maps in comparison to using the original left Mastcam images for disparity map estimation. The deep learning-based method provided the best performance among the three for both image enhancement and disparity map estimation accuracy. A high-resolution disparity map, which is the result of the left camera image enhancement, is anticipated to improve the conducted science products in the Mastcam imagery such as 3D scene reconstructions, depth maps, and anaglyph images.https://www.mdpi.com/1424-8220/19/16/3526image resolutionimage enhancementMastcamdisparity mapdepth map
spellingShingle Bulent Ayhan
Chiman Kwan
Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
Sensors
image resolution
image enhancement
Mastcam
disparity map
depth map
title Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
title_full Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
title_fullStr Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
title_full_unstemmed Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
title_short Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions
title_sort mastcam image resolution enhancement with application to disparity map generation for stereo images with different resolutions
topic image resolution
image enhancement
Mastcam
disparity map
depth map
url https://www.mdpi.com/1424-8220/19/16/3526
work_keys_str_mv AT bulentayhan mastcamimageresolutionenhancementwithapplicationtodisparitymapgenerationforstereoimageswithdifferentresolutions
AT chimankwan mastcamimageresolutionenhancementwithapplicationtodisparitymapgenerationforstereoimageswithdifferentresolutions