Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences
Abstract The Mars 2020 Mastcam‐Z stereo camera investigation enables the generation of three dimension (3D) data products needed to visualize and analyze rocks, outcrops, and other geological and aeolian features. The Planetary Robotics Vision Processing framework “PRoViP” as well as the Instrument...
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Geophysical Union (AGU)
2023-03-01
|
| Series: | Earth and Space Science |
| Subjects: | |
| Online Access: | https://doi.org/10.1029/2022EA002532 |
| _version_ | 1827976850801950720 |
|---|---|
| author | Gerhard Paar Thomas Ortner Christian Tate Robert G. Deen Parker Abercrombie Marsette Vona Jon Proton Andreas Bechtold Fred Calef Robert Barnes Christian Koeberl Ken Herkenhoff Elisabeth M. Hausrath Christoph Traxler Piluca Caballo Andrew M. Annex Sanjeev Gupta James F. Bell III Justin Maki |
| author_facet | Gerhard Paar Thomas Ortner Christian Tate Robert G. Deen Parker Abercrombie Marsette Vona Jon Proton Andreas Bechtold Fred Calef Robert Barnes Christian Koeberl Ken Herkenhoff Elisabeth M. Hausrath Christoph Traxler Piluca Caballo Andrew M. Annex Sanjeev Gupta James F. Bell III Justin Maki |
| author_sort | Gerhard Paar |
| collection | DOAJ |
| description | Abstract The Mars 2020 Mastcam‐Z stereo camera investigation enables the generation of three dimension (3D) data products needed to visualize and analyze rocks, outcrops, and other geological and aeolian features. The Planetary Robotics Vision Processing framework “PRoViP” as well as the Instrument Data System on a tactical—sol‐by‐sol—timeframe generate 3D vision products, such as panoramas, distance maps, and textured meshes. Structure‐from‐motion used by the Advanced Science Targeting Toolkit for Robotic Operations (ASTTRO) “Landform” tool and long baseline stereo pipelines add to the 3D vision products' suite on various scales. Data fusion with textured meshes from satellite imagery and 3D data analysis and interpretation of the resulting large 3D data sets is realized by visualization assets like the Planetary Robotics Vision 3D Viewer PRo3D, the 3D Geographical Information System GIS CAMP (Campaign Analysis Mapping and Planning tool), the ASTTRO 3D data presentation and targeting tool, and the Mastcam‐Z planning tool Viewpoint. The pipelines' workflows and the user‐oriented features of the visualization assets, shared across the Mars 2020 mission, are reported. The individual role and interplay, complements and synergies of the individual frameworks are explained. Emphasis is laid on publicly available 3D vision data products and tools. A representative set of scientific use cases from planetary geology, aeolian activity, soil analysis and impact science illustrates the scientific workflow, and public data deployment modes are briefly outlined, demonstrating that 3D vision processing and visualization is an essential mission‐wide asset to solve important planetary science questions such as prevailing wind direction, soil composition, or geologic origin. |
| first_indexed | 2024-04-09T20:56:09Z |
| format | Article |
| id | doaj.art-2d3d60ea5f0443c6ba945779714d3018 |
| institution | Directory Open Access Journal |
| issn | 2333-5084 |
| language | English |
| last_indexed | 2024-04-09T20:56:09Z |
| publishDate | 2023-03-01 |
| publisher | American Geophysical Union (AGU) |
| record_format | Article |
| series | Earth and Space Science |
| spelling | doaj.art-2d3d60ea5f0443c6ba945779714d30182023-03-29T19:08:35ZengAmerican Geophysical Union (AGU)Earth and Space Science2333-50842023-03-01103n/an/a10.1029/2022EA002532Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image SequencesGerhard Paar0Thomas Ortner1Christian Tate2Robert G. Deen3Parker Abercrombie4Marsette Vona5Jon Proton6Andreas Bechtold7Fred Calef8Robert Barnes9Christian Koeberl10Ken Herkenhoff11Elisabeth M. Hausrath12Christoph Traxler13Piluca Caballo14Andrew M. Annex15Sanjeev Gupta16James F. Bell III17Justin Maki18JOANNEUM RESEARCH Forschungsgesellschaft mbH Institute for Information and Communication Technology Graz AustriaVRVis Zentrum für Virtual Reality und Visualisierung Forschungs‐GmbH Vienna AustriaDepartment of Astronomy Cornell University Ithaca NY USANASA Jet Propulsion Laboratory (JPL) California Institute of Technology Pasadena CA USANASA Jet Propulsion Laboratory (JPL) California Institute of Technology Pasadena CA USANASA Jet Propulsion Laboratory (JPL) California Institute of Technology Pasadena CA USAOpscode LLC San Diego CA USAAustrian Academy of Sciences Vienna AustriaNASA Jet Propulsion Laboratory (JPL) California Institute of Technology Pasadena CA USADepartment of Earth Science & Engineering Imperial College London UKAustrian Academy of Sciences Vienna AustriaU. S. Geological Survey Astrogeology Science Center Flagstaff AZ USADepartment of Geoscience University of Nevada Las Vegas NV USAVRVis Zentrum für Virtual Reality und Visualisierung Forschungs‐GmbH Vienna AustriaJOANNEUM RESEARCH Forschungsgesellschaft mbH Institute for Information and Communication Technology Graz AustriaDivision of Geological and Planetary Sciences California Institute of Technology Pasadena CA USADepartment of Earth Science & Engineering Imperial College London UKSchool of Earth and Space Exploration Arizona State University Tempe AZ USANASA Jet Propulsion Laboratory (JPL) California Institute of Technology Pasadena CA USAAbstract The Mars 2020 Mastcam‐Z stereo camera investigation enables the generation of three dimension (3D) data products needed to visualize and analyze rocks, outcrops, and other geological and aeolian features. The Planetary Robotics Vision Processing framework “PRoViP” as well as the Instrument Data System on a tactical—sol‐by‐sol—timeframe generate 3D vision products, such as panoramas, distance maps, and textured meshes. Structure‐from‐motion used by the Advanced Science Targeting Toolkit for Robotic Operations (ASTTRO) “Landform” tool and long baseline stereo pipelines add to the 3D vision products' suite on various scales. Data fusion with textured meshes from satellite imagery and 3D data analysis and interpretation of the resulting large 3D data sets is realized by visualization assets like the Planetary Robotics Vision 3D Viewer PRo3D, the 3D Geographical Information System GIS CAMP (Campaign Analysis Mapping and Planning tool), the ASTTRO 3D data presentation and targeting tool, and the Mastcam‐Z planning tool Viewpoint. The pipelines' workflows and the user‐oriented features of the visualization assets, shared across the Mars 2020 mission, are reported. The individual role and interplay, complements and synergies of the individual frameworks are explained. Emphasis is laid on publicly available 3D vision data products and tools. A representative set of scientific use cases from planetary geology, aeolian activity, soil analysis and impact science illustrates the scientific workflow, and public data deployment modes are briefly outlined, demonstrating that 3D vision processing and visualization is an essential mission‐wide asset to solve important planetary science questions such as prevailing wind direction, soil composition, or geologic origin.https://doi.org/10.1029/2022EA002532Mars explorationvisualizationMars 2020Mastcam‐Z |
| spellingShingle | Gerhard Paar Thomas Ortner Christian Tate Robert G. Deen Parker Abercrombie Marsette Vona Jon Proton Andreas Bechtold Fred Calef Robert Barnes Christian Koeberl Ken Herkenhoff Elisabeth M. Hausrath Christoph Traxler Piluca Caballo Andrew M. Annex Sanjeev Gupta James F. Bell III Justin Maki Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences Earth and Space Science Mars exploration visualization Mars 2020 Mastcam‐Z |
| title | Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences |
| title_full | Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences |
| title_fullStr | Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences |
| title_full_unstemmed | Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences |
| title_short | Three‐Dimensional Data Preparation and Immersive Mission‐Spanning Visualization and Analysis of Mars 2020 Mastcam‐Z Stereo Image Sequences |
| title_sort | three dimensional data preparation and immersive mission spanning visualization and analysis of mars 2020 mastcam z stereo image sequences |
| topic | Mars exploration visualization Mars 2020 Mastcam‐Z |
| url | https://doi.org/10.1029/2022EA002532 |
| work_keys_str_mv | AT gerhardpaar threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT thomasortner threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT christiantate threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT robertgdeen threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT parkerabercrombie threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT marsettevona threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT jonproton threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT andreasbechtold threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT fredcalef threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT robertbarnes threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT christiankoeberl threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT kenherkenhoff threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT elisabethmhausrath threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT christophtraxler threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT pilucacaballo threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT andrewmannex threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT sanjeevgupta threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT jamesfbelliii threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences AT justinmaki threedimensionaldatapreparationandimmersivemissionspanningvisualizationandanalysisofmars2020mastcamzstereoimagesequences |