Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing

In the past few years, object detection has attracted a lot of attention in the context of human–robot collaboration and Industry 5.0 due to enormous quality improvements in deep learning technologies. In many applications, object detection models have to be able to quickly adapt to a changing envir...

Full description

Bibliographic Details
Main Authors: Manuela Geiß, Raphael Wagner, Martin Baresch, Josef Steiner, Michael Zwick
Format: Article
Language:English
Published: MDPI AG 2023-02-01
Series:Micromachines
Subjects:
Online Access:https://www.mdpi.com/2072-666X/14/2/442
_version_ 1797619222997630976
author Manuela Geiß
Raphael Wagner
Martin Baresch
Josef Steiner
Michael Zwick
author_facet Manuela Geiß
Raphael Wagner
Martin Baresch
Josef Steiner
Michael Zwick
author_sort Manuela Geiß
collection DOAJ
description In the past few years, object detection has attracted a lot of attention in the context of human–robot collaboration and Industry 5.0 due to enormous quality improvements in deep learning technologies. In many applications, object detection models have to be able to quickly adapt to a changing environment, i.e., to learn new objects. A crucial but challenging prerequisite for this is the automatic generation of new training data which currently still limits the broad application of object detection methods in industrial manufacturing. In this work, we discuss how to adapt state-of-the-art object detection methods for the task of automatic bounding box annotation in a use case where the background is homogeneous and the object’s label is provided by a human. We compare an adapted version of Faster R-CNN and the Scaled-YOLOv4-p5 architecture and show that both can be trained to distinguish unknown objects from a complex but homogeneous background using only a small amount of training data. In contrast to most other state-of-the-art methods for bounding box labeling, our proposed method neither requires human verification, a predefined set of classes, nor a very large manually annotated dataset. Our method outperforms the state-of-the-art, transformer-based object discovery method <i>LOST</i> on our simple fruits dataset by large margins.
first_indexed 2024-03-11T08:23:58Z
format Article
id doaj.art-3bdaacb894654f15b73652f092a7e343
institution Directory Open Access Journal
issn 2072-666X
language English
last_indexed 2024-03-11T08:23:58Z
publishDate 2023-02-01
publisher MDPI AG
record_format Article
series Micromachines
spelling doaj.art-3bdaacb894654f15b73652f092a7e3432023-11-16T22:12:18ZengMDPI AGMicromachines2072-666X2023-02-0114244210.3390/mi14020442Automatic Bounding Box Annotation with Small Training Datasets for Industrial ManufacturingManuela Geiß0Raphael Wagner1Martin Baresch2Josef Steiner3Michael Zwick4Software Competence Center Hagenberg GmbH, Softwarepark 32a, 4232 Hagenberg, AustriaSoftware Competence Center Hagenberg GmbH, Softwarepark 32a, 4232 Hagenberg, AustriaKEBA Group AG, Reindlstraße 51, 4040 Linz, AustriaKEBA Group AG, Reindlstraße 51, 4040 Linz, AustriaSoftware Competence Center Hagenberg GmbH, Softwarepark 32a, 4232 Hagenberg, AustriaIn the past few years, object detection has attracted a lot of attention in the context of human–robot collaboration and Industry 5.0 due to enormous quality improvements in deep learning technologies. In many applications, object detection models have to be able to quickly adapt to a changing environment, i.e., to learn new objects. A crucial but challenging prerequisite for this is the automatic generation of new training data which currently still limits the broad application of object detection methods in industrial manufacturing. In this work, we discuss how to adapt state-of-the-art object detection methods for the task of automatic bounding box annotation in a use case where the background is homogeneous and the object’s label is provided by a human. We compare an adapted version of Faster R-CNN and the Scaled-YOLOv4-p5 architecture and show that both can be trained to distinguish unknown objects from a complex but homogeneous background using only a small amount of training data. In contrast to most other state-of-the-art methods for bounding box labeling, our proposed method neither requires human verification, a predefined set of classes, nor a very large manually annotated dataset. Our method outperforms the state-of-the-art, transformer-based object discovery method <i>LOST</i> on our simple fruits dataset by large margins.https://www.mdpi.com/2072-666X/14/2/442automatic object annotationimage annotationobject detectionAutoMLdeep learningIndustry 5.0
spellingShingle Manuela Geiß
Raphael Wagner
Martin Baresch
Josef Steiner
Michael Zwick
Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing
Micromachines
automatic object annotation
image annotation
object detection
AutoML
deep learning
Industry 5.0
title Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing
title_full Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing
title_fullStr Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing
title_full_unstemmed Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing
title_short Automatic Bounding Box Annotation with Small Training Datasets for Industrial Manufacturing
title_sort automatic bounding box annotation with small training datasets for industrial manufacturing
topic automatic object annotation
image annotation
object detection
AutoML
deep learning
Industry 5.0
url https://www.mdpi.com/2072-666X/14/2/442
work_keys_str_mv AT manuelageiß automaticboundingboxannotationwithsmalltrainingdatasetsforindustrialmanufacturing
AT raphaelwagner automaticboundingboxannotationwithsmalltrainingdatasetsforindustrialmanufacturing
AT martinbaresch automaticboundingboxannotationwithsmalltrainingdatasetsforindustrialmanufacturing
AT josefsteiner automaticboundingboxannotationwithsmalltrainingdatasetsforindustrialmanufacturing
AT michaelzwick automaticboundingboxannotationwithsmalltrainingdatasetsforindustrialmanufacturing