Computer Vision Techniques for Drill Bit Identification and Mechanical Wear Detection

Developments of computer vision techniques in the past decade have rapidly accumulated and enabled the application of vision systems to use cases that were once out of reach. In conjunction with standard image processing techniques, deep learning models for vision tasks have received increasing atte...

Full description

Bibliographic Details
Main Author: Darby, Brady J.
Other Authors: Frey, Daniel
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/156827
Description
Summary:Developments of computer vision techniques in the past decade have rapidly accumulated and enabled the application of vision systems to use cases that were once out of reach. In conjunction with standard image processing techniques, deep learning models for vision tasks have received increasing attention, and they both see considerable utility in space exploration. Specifically, real-time obstacle detection and motion planning require advanced vision logic. However, retroactive data analysis is an area with less emphasis but promising application for computer vision. This thesis project explores how both image processing and deep learning-based computer vision methods can be leveraged to analyze drill bits on board the Mars 2020 Perseverance Rover, a Jet Propulsion Laboratory (JPL) mission. The effectiveness of thresholding and segmentation on two critical tasks, drill bit identification and mechanical wear detection, is demonstrated. Then, transfer learning of convolutional neural networks (CNNs) is applied to the same tasks, allowing comparison of results. This thesis also explores a means of presenting processed image outputs to non-technical operators in order to assist manual analysis of drill bit wear state.