Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks

Automatic detection of steel surface defects is very important for product quality control in the steel industry. However, the traditional method cannot be well applied in the production line, because of its low accuracy and slow running speed. The current, popular algorithm (based on deep learning)...

Full description

Bibliographic Details
Main Authors: Shuai Wang, Xiaojun Xia, Lanqing Ye, Binbin Yang
Format: Article
Language:English
Published: MDPI AG 2021-02-01
Series:Metals
Subjects:
Online Access:https://www.mdpi.com/2075-4701/11/3/388
_version_ 1797395062105047040
author Shuai Wang
Xiaojun Xia
Lanqing Ye
Binbin Yang
author_facet Shuai Wang
Xiaojun Xia
Lanqing Ye
Binbin Yang
author_sort Shuai Wang
collection DOAJ
description Automatic detection of steel surface defects is very important for product quality control in the steel industry. However, the traditional method cannot be well applied in the production line, because of its low accuracy and slow running speed. The current, popular algorithm (based on deep learning) also has the problem of low accuracy, and there is still a lot of room for improvement. This paper proposes a method combining improved ResNet50 and enhanced faster region convolutional neural networks (faster R-CNN) to reduce the average running time and improve the accuracy. Firstly, the image input into the improved ResNet50 model, which add the deformable revolution network (DCN) and improved cutout to classify the sample with defects and without defects. If the probability of having a defect is less than 0.3, the algorithm directly outputs the sample without defects. Otherwise, the samples are further input into the improved faster R-CNN, which adds spatial pyramid pooling (SPP), enhanced feature pyramid networks (FPN), and matrix NMS. The final output is the location and classification of the defect in the sample or without defect in the sample. By analyzing the data set obtained in the real factory environment, the accuracy of this method can reach 98.2%. At the same time, the average running time is faster than other models.
first_indexed 2024-03-09T00:28:57Z
format Article
id doaj.art-f76b18b4c2f94c188615e35e345a317e
institution Directory Open Access Journal
issn 2075-4701
language English
last_indexed 2024-03-09T00:28:57Z
publishDate 2021-02-01
publisher MDPI AG
record_format Article
series Metals
spelling doaj.art-f76b18b4c2f94c188615e35e345a317e2023-12-11T18:40:32ZengMDPI AGMetals2075-47012021-02-0111338810.3390/met11030388Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural NetworksShuai Wang0Xiaojun Xia1Lanqing Ye2Binbin Yang3School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, ChinaSchool of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, ChinaSchool of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, ChinaSchool of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, ChinaAutomatic detection of steel surface defects is very important for product quality control in the steel industry. However, the traditional method cannot be well applied in the production line, because of its low accuracy and slow running speed. The current, popular algorithm (based on deep learning) also has the problem of low accuracy, and there is still a lot of room for improvement. This paper proposes a method combining improved ResNet50 and enhanced faster region convolutional neural networks (faster R-CNN) to reduce the average running time and improve the accuracy. Firstly, the image input into the improved ResNet50 model, which add the deformable revolution network (DCN) and improved cutout to classify the sample with defects and without defects. If the probability of having a defect is less than 0.3, the algorithm directly outputs the sample without defects. Otherwise, the samples are further input into the improved faster R-CNN, which adds spatial pyramid pooling (SPP), enhanced feature pyramid networks (FPN), and matrix NMS. The final output is the location and classification of the defect in the sample or without defect in the sample. By analyzing the data set obtained in the real factory environment, the accuracy of this method can reach 98.2%. At the same time, the average running time is faster than other models.https://www.mdpi.com/2075-4701/11/3/388steel surface defect detectionimproved ResNet50improved faster R-CNNspatial pyramid pooling (SPP)feature pyramid networks (FPN)
spellingShingle Shuai Wang
Xiaojun Xia
Lanqing Ye
Binbin Yang
Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
Metals
steel surface defect detection
improved ResNet50
improved faster R-CNN
spatial pyramid pooling (SPP)
feature pyramid networks (FPN)
title Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
title_full Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
title_fullStr Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
title_full_unstemmed Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
title_short Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
title_sort automatic detection and classification of steel surface defect using deep convolutional neural networks
topic steel surface defect detection
improved ResNet50
improved faster R-CNN
spatial pyramid pooling (SPP)
feature pyramid networks (FPN)
url https://www.mdpi.com/2075-4701/11/3/388
work_keys_str_mv AT shuaiwang automaticdetectionandclassificationofsteelsurfacedefectusingdeepconvolutionalneuralnetworks
AT xiaojunxia automaticdetectionandclassificationofsteelsurfacedefectusingdeepconvolutionalneuralnetworks
AT lanqingye automaticdetectionandclassificationofsteelsurfacedefectusingdeepconvolutionalneuralnetworks
AT binbinyang automaticdetectionandclassificationofsteelsurfacedefectusingdeepconvolutionalneuralnetworks