Optical character recognition on engineering drawings to achieve automation in production quality control

Introduction: Digitization is a crucial step towards achieving automation in production quality control for mechanical products. Engineering drawings are essential carriers of information for production, but their complexity poses a challenge for computer vision. To enable automated quality control,...

Full description

Bibliographic Details
Main Authors: Javier Villena Toro, Anton Wiberg, Mehdi Tarkian
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-03-01
Series:Frontiers in Manufacturing Technology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fmtec.2023.1154132/full
_version_ 1797867223537156096
author Javier Villena Toro
Anton Wiberg
Mehdi Tarkian
author_facet Javier Villena Toro
Anton Wiberg
Mehdi Tarkian
author_sort Javier Villena Toro
collection DOAJ
description Introduction: Digitization is a crucial step towards achieving automation in production quality control for mechanical products. Engineering drawings are essential carriers of information for production, but their complexity poses a challenge for computer vision. To enable automated quality control, seamless data transfer between analog drawings and CAD/CAM software is necessary.Methods: This paper focuses on autonomous text detection and recognition in engineering drawings. The methodology is divided into five stages. First, image processing techniques are used to classify and identify key elements in the drawing. The output is divided into three elements: information blocks and tables, feature control frames, and the rest of the image. For each element, an OCR pipeline is proposed. The last stage is output generation of the information in table format.Results: The proposed tool, called eDOCr, achieved a precision and recall of 90% in detection, an F1-score of 94% in recognition, and a character error rate of 8%. The tool enables seamless integration between engineering drawings and quality control.Discussion: Most OCR algorithms have limitations when applied to mechanical drawings due to their inherent complexity, including measurements, orientation, tolerances, and special symbols such as geometric dimensioning and tolerancing (GD&T). The eDOCr tool overcomes these limitations and provides a solution for automated quality control.Conclusion: The eDOCr tool provides an effective solution for automated text detection and recognition in engineering drawings. The tool's success demonstrates that automated quality control for mechanical products can be achieved through digitization. The tool is shared with the research community through Github.
first_indexed 2024-04-09T23:36:56Z
format Article
id doaj.art-114ba41bc34148bcb2f317774f9c3c39
institution Directory Open Access Journal
issn 2813-0359
language English
last_indexed 2024-04-09T23:36:56Z
publishDate 2023-03-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Manufacturing Technology
spelling doaj.art-114ba41bc34148bcb2f317774f9c3c392023-03-20T04:48:11ZengFrontiers Media S.A.Frontiers in Manufacturing Technology2813-03592023-03-01310.3389/fmtec.2023.11541321154132Optical character recognition on engineering drawings to achieve automation in production quality controlJavier Villena ToroAnton WibergMehdi TarkianIntroduction: Digitization is a crucial step towards achieving automation in production quality control for mechanical products. Engineering drawings are essential carriers of information for production, but their complexity poses a challenge for computer vision. To enable automated quality control, seamless data transfer between analog drawings and CAD/CAM software is necessary.Methods: This paper focuses on autonomous text detection and recognition in engineering drawings. The methodology is divided into five stages. First, image processing techniques are used to classify and identify key elements in the drawing. The output is divided into three elements: information blocks and tables, feature control frames, and the rest of the image. For each element, an OCR pipeline is proposed. The last stage is output generation of the information in table format.Results: The proposed tool, called eDOCr, achieved a precision and recall of 90% in detection, an F1-score of 94% in recognition, and a character error rate of 8%. The tool enables seamless integration between engineering drawings and quality control.Discussion: Most OCR algorithms have limitations when applied to mechanical drawings due to their inherent complexity, including measurements, orientation, tolerances, and special symbols such as geometric dimensioning and tolerancing (GD&T). The eDOCr tool overcomes these limitations and provides a solution for automated quality control.Conclusion: The eDOCr tool provides an effective solution for automated text detection and recognition in engineering drawings. The tool's success demonstrates that automated quality control for mechanical products can be achieved through digitization. The tool is shared with the research community through Github.https://www.frontiersin.org/articles/10.3389/fmtec.2023.1154132/fulloptical character recognitionimage segmentationobject detectionengineering drawingsquality controlkeras-ocr
spellingShingle Javier Villena Toro
Anton Wiberg
Mehdi Tarkian
Optical character recognition on engineering drawings to achieve automation in production quality control
Frontiers in Manufacturing Technology
optical character recognition
image segmentation
object detection
engineering drawings
quality control
keras-ocr
title Optical character recognition on engineering drawings to achieve automation in production quality control
title_full Optical character recognition on engineering drawings to achieve automation in production quality control
title_fullStr Optical character recognition on engineering drawings to achieve automation in production quality control
title_full_unstemmed Optical character recognition on engineering drawings to achieve automation in production quality control
title_short Optical character recognition on engineering drawings to achieve automation in production quality control
title_sort optical character recognition on engineering drawings to achieve automation in production quality control
topic optical character recognition
image segmentation
object detection
engineering drawings
quality control
keras-ocr
url https://www.frontiersin.org/articles/10.3389/fmtec.2023.1154132/full
work_keys_str_mv AT javiervillenatoro opticalcharacterrecognitiononengineeringdrawingstoachieveautomationinproductionqualitycontrol
AT antonwiberg opticalcharacterrecognitiononengineeringdrawingstoachieveautomationinproductionqualitycontrol
AT mehditarkian opticalcharacterrecognitiononengineeringdrawingstoachieveautomationinproductionqualitycontrol