A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks

Graphical Search Engines are conceptually used in many development areas surrounding information retrieval systems that aim to provide a visual representation of results, typically associated with retrieving images relevant to one or more input images. Since the 1990s, efforts have been made to impr...

Full description

Bibliographic Details
Main Authors: Sandra Jardim, João António, Carlos Mora, Artur Almeida
Format: Article
Language:English
Published: MDPI AG 2022-09-01
Series:Journal of Imaging
Subjects:
Online Access:https://www.mdpi.com/2313-433X/8/9/238
_version_ 1797486463593480192
author Sandra Jardim
João António
Carlos Mora
Artur Almeida
author_facet Sandra Jardim
João António
Carlos Mora
Artur Almeida
author_sort Sandra Jardim
collection DOAJ
description Graphical Search Engines are conceptually used in many development areas surrounding information retrieval systems that aim to provide a visual representation of results, typically associated with retrieving images relevant to one or more input images. Since the 1990s, efforts have been made to improve the result quality, be it through improved processing speeds or more efficient graphical processing techniques that generate accurate representations of images for comparison. While many systems achieve timely results by combining high-level features, they still struggle when dealing with large datasets and abstract images. Image datasets regarding industrial property are an example of an hurdle for typical image retrieval systems where the dimensions and characteristics of images make adequate comparison a difficult task. In this paper, we introduce an image retrieval system based on a multi-phase implementation of different deep learning and image processing techniques, designed to deliver highly accurate results regardless of dataset complexity and size. The proposed approach uses image signatures to provide a near exact representation of an image, with abstraction levels that allow the comparison with other signatures as a means to achieve a fully capable image comparison process. To overcome performance disadvantages related to multiple image searches due to the high complexity of image signatures, the proposed system incorporates a parallel processing block responsible for dealing with multi-image search scenarios. The system achieves the image retrieval through the use of a new similarity compound formula that accounts for all components of an image signature. The results shows that the developed approach performs image retrieval with high accuracy, showing that combining multiple image assets allows for more accurate comparisons across a broad spectrum of image typologies. The use of deep convolutional networks for feature extraction as a means of semantically describing more commonly encountered objects allows for the system to perform research with a degree of abstraction.
first_indexed 2024-03-09T23:34:33Z
format Article
id doaj.art-e45573e541c548ce84a6ce78e3f69343
institution Directory Open Access Journal
issn 2313-433X
language English
last_indexed 2024-03-09T23:34:33Z
publishDate 2022-09-01
publisher MDPI AG
record_format Article
series Journal of Imaging
spelling doaj.art-e45573e541c548ce84a6ce78e3f693432023-11-23T17:04:35ZengMDPI AGJournal of Imaging2313-433X2022-09-018923810.3390/jimaging8090238A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep NetworksSandra Jardim0João António1Carlos Mora2Artur Almeida3Smart Cities Research Center, Polytechnic Institute of Tomar, 2300-313 Tomar, PortugalTechframe-Information Systems, SA, 2785-338 São Domingos de Rana, PortugalSmart Cities Research Center, Polytechnic Institute of Tomar, 2300-313 Tomar, PortugalTechframe-Information Systems, SA, 2785-338 São Domingos de Rana, PortugalGraphical Search Engines are conceptually used in many development areas surrounding information retrieval systems that aim to provide a visual representation of results, typically associated with retrieving images relevant to one or more input images. Since the 1990s, efforts have been made to improve the result quality, be it through improved processing speeds or more efficient graphical processing techniques that generate accurate representations of images for comparison. While many systems achieve timely results by combining high-level features, they still struggle when dealing with large datasets and abstract images. Image datasets regarding industrial property are an example of an hurdle for typical image retrieval systems where the dimensions and characteristics of images make adequate comparison a difficult task. In this paper, we introduce an image retrieval system based on a multi-phase implementation of different deep learning and image processing techniques, designed to deliver highly accurate results regardless of dataset complexity and size. The proposed approach uses image signatures to provide a near exact representation of an image, with abstraction levels that allow the comparison with other signatures as a means to achieve a fully capable image comparison process. To overcome performance disadvantages related to multiple image searches due to the high complexity of image signatures, the proposed system incorporates a parallel processing block responsible for dealing with multi-image search scenarios. The system achieves the image retrieval through the use of a new similarity compound formula that accounts for all components of an image signature. The results shows that the developed approach performs image retrieval with high accuracy, showing that combining multiple image assets allows for more accurate comparisons across a broad spectrum of image typologies. The use of deep convolutional networks for feature extraction as a means of semantically describing more commonly encountered objects allows for the system to perform research with a degree of abstraction.https://www.mdpi.com/2313-433X/8/9/238image retrievalcontent-based image retrieval (CBIR)deep convolutional neural networks (DCNN)trademarkcombined multiple features
spellingShingle Sandra Jardim
João António
Carlos Mora
Artur Almeida
A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks
Journal of Imaging
image retrieval
content-based image retrieval (CBIR)
deep convolutional neural networks (DCNN)
trademark
combined multiple features
title A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks
title_full A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks
title_fullStr A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks
title_full_unstemmed A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks
title_short A Novel Trademark Image Retrieval System Based on Multi-Feature Extraction and Deep Networks
title_sort novel trademark image retrieval system based on multi feature extraction and deep networks
topic image retrieval
content-based image retrieval (CBIR)
deep convolutional neural networks (DCNN)
trademark
combined multiple features
url https://www.mdpi.com/2313-433X/8/9/238
work_keys_str_mv AT sandrajardim anoveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT joaoantonio anoveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT carlosmora anoveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT arturalmeida anoveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT sandrajardim noveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT joaoantonio noveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT carlosmora noveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks
AT arturalmeida noveltrademarkimageretrievalsystembasedonmultifeatureextractionanddeepnetworks