Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal

Foreign object debris (FOD) is any undesired and unintended object placed or found in the specific vicinity of an aircraft (runway/ taxiway) that can cause damage to aircraft or harm personnel on board such as twisted metal strips, screws, nuts, and bolts, depleted concrete runway pieces, stones, pe...

Full description

Bibliographic Details
Main Authors: Syeda Mahrukh Zainab, Khurram Khan, Adnan Fazil, Muhammad Zakwan
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10024955/
_version_ 1811169673032499200
author Syeda Mahrukh Zainab
Khurram Khan
Adnan Fazil
Muhammad Zakwan
author_facet Syeda Mahrukh Zainab
Khurram Khan
Adnan Fazil
Muhammad Zakwan
author_sort Syeda Mahrukh Zainab
collection DOAJ
description Foreign object debris (FOD) is any undesired and unintended object placed or found in the specific vicinity of an aircraft (runway/ taxiway) that can cause damage to aircraft or harm personnel on board such as twisted metal strips, screws, nuts, and bolts, depleted concrete runway pieces, stones, pebbles and stationery items. To avoid FOD damages, all airport/ aviation organizations have deployed some sort of FOD prevention procedure. However, automatic FOD detection systems are still scarce owing to the inevitable reliance on human experts that lead to unavoidable human errors. Around 60% of FOD consists of metal which is the most deteriorating for an aircraft. Therefore, the implementation of material recognition techniques for FOD classification through Deep Convolutional Neural Networks (DCNN) is more important than FOD object detection as FOD could be of any shape, size or color. This paper developed a DCNN algorithm for FOD material classification with high accuracy for all included material classes (i.e., metal, concrete, plastic) in general and metal in particular. For this, a new dataset is introduced that consists of 2481 images taken on an operational airport runway in varying illumination and weather conditions. Through extensive testing, it was found that InceptionV3 is the best performing model with 18% improvement in metal recognition, and 11% improvement in average accuracy for all included classes.
first_indexed 2024-04-10T16:46:07Z
format Article
id doaj.art-084a0889b6e64336a3a9e642c239b184
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-10T16:46:07Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-084a0889b6e64336a3a9e642c239b1842023-02-08T00:00:51ZengIEEEIEEE Access2169-35362023-01-0111109251093410.1109/ACCESS.2023.323942410024955Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on MetalSyeda Mahrukh Zainab0Khurram Khan1https://orcid.org/0000-0001-8572-5497Adnan Fazil2Muhammad Zakwan3https://orcid.org/0000-0003-2069-0232Department of Avionics Engineering, IAA, Air University, Islamabad, PakistanDepartment of Avionics Engineering, IAA, Air University, Islamabad, PakistanDepartment of Avionics Engineering, IAA, Air University, Islamabad, PakistanDepartment of Avionics Engineering, IAA, Air University, Islamabad, PakistanForeign object debris (FOD) is any undesired and unintended object placed or found in the specific vicinity of an aircraft (runway/ taxiway) that can cause damage to aircraft or harm personnel on board such as twisted metal strips, screws, nuts, and bolts, depleted concrete runway pieces, stones, pebbles and stationery items. To avoid FOD damages, all airport/ aviation organizations have deployed some sort of FOD prevention procedure. However, automatic FOD detection systems are still scarce owing to the inevitable reliance on human experts that lead to unavoidable human errors. Around 60% of FOD consists of metal which is the most deteriorating for an aircraft. Therefore, the implementation of material recognition techniques for FOD classification through Deep Convolutional Neural Networks (DCNN) is more important than FOD object detection as FOD could be of any shape, size or color. This paper developed a DCNN algorithm for FOD material classification with high accuracy for all included material classes (i.e., metal, concrete, plastic) in general and metal in particular. For this, a new dataset is introduced that consists of 2481 images taken on an operational airport runway in varying illumination and weather conditions. Through extensive testing, it was found that InceptionV3 is the best performing model with 18% improvement in metal recognition, and 11% improvement in average accuracy for all included classes.https://ieeexplore.ieee.org/document/10024955/Deep convolutional neural network (DCNN)FODmaterial classification
spellingShingle Syeda Mahrukh Zainab
Khurram Khan
Adnan Fazil
Muhammad Zakwan
Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal
IEEE Access
Deep convolutional neural network (DCNN)
FOD
material classification
title Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal
title_full Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal
title_fullStr Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal
title_full_unstemmed Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal
title_short Foreign Object Debris (FOD) Classification Through Material Recognition Using Deep Convolutional Neural Network With Focus on Metal
title_sort foreign object debris fod classification through material recognition using deep convolutional neural network with focus on metal
topic Deep convolutional neural network (DCNN)
FOD
material classification
url https://ieeexplore.ieee.org/document/10024955/
work_keys_str_mv AT syedamahrukhzainab foreignobjectdebrisfodclassificationthroughmaterialrecognitionusingdeepconvolutionalneuralnetworkwithfocusonmetal
AT khurramkhan foreignobjectdebrisfodclassificationthroughmaterialrecognitionusingdeepconvolutionalneuralnetworkwithfocusonmetal
AT adnanfazil foreignobjectdebrisfodclassificationthroughmaterialrecognitionusingdeepconvolutionalneuralnetworkwithfocusonmetal
AT muhammadzakwan foreignobjectdebrisfodclassificationthroughmaterialrecognitionusingdeepconvolutionalneuralnetworkwithfocusonmetal