Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies

The template matching technique is one of the most applied methods to find patterns in images, in which a reduced-size image, called a target, is searched within another image that represents the overall environment. In this work, template matching is used via a co-design system. A hardware coproces...

Full description

Bibliographic Details
Main Authors: Nadia Nedjah, Alexandre V. Cardoso, Yuri M. Tavares, Luiza de Macedo Mourelle, Brij Booshan Gupta, Varsha Arya
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/13/5881
_version_ 1797590829100957696
author Nadia Nedjah
Alexandre V. Cardoso
Yuri M. Tavares
Luiza de Macedo Mourelle
Brij Booshan Gupta
Varsha Arya
author_facet Nadia Nedjah
Alexandre V. Cardoso
Yuri M. Tavares
Luiza de Macedo Mourelle
Brij Booshan Gupta
Varsha Arya
author_sort Nadia Nedjah
collection DOAJ
description The template matching technique is one of the most applied methods to find patterns in images, in which a reduced-size image, called a target, is searched within another image that represents the overall environment. In this work, template matching is used via a co-design system. A hardware coprocessor is designed for the computationally demanding step of template matching, which is the calculation of the normalized cross-correlation coefficient. This computation allows invariance in the global brightness changes in the images, but it is computationally more expensive when using images of larger dimensions, or even sets of images. Furthermore, we investigate the performance of six different swarm intelligence techniques aiming to accelerate the target search process. To evaluate the proposed design, the processing time, the number of iterations, and the success rate were compared. The results show that it is possible to obtain approaches capable of processing video images at 30 frames per second with an acceptable average success rate for detecting the tracked target. The search strategies based on PSO, ABC, FFA, and CS are able to meet the processing time of 30 frame/s, yielding average accuracy rates above 80% for the pipelined co-design implementation. However, FWA, EHO, and BFOA could not achieve the required timing restriction, and they achieved an acceptance rate around 60%. Among all the investigated search strategies, the PSO provides the best performance, yielding an average processing time of 16.22 ms coupled with a 95% success rate.
first_indexed 2024-03-11T01:29:00Z
format Article
id doaj.art-0cdc953cce9c461eaaba0f980247d946
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-11T01:29:00Z
publishDate 2023-06-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-0cdc953cce9c461eaaba0f980247d9462023-11-18T17:28:08ZengMDPI AGSensors1424-82202023-06-012313588110.3390/s23135881Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search StrategiesNadia Nedjah0Alexandre V. Cardoso1Yuri M. Tavares2Luiza de Macedo Mourelle3Brij Booshan Gupta4Varsha Arya5Department of Electronics Engineering and Telecommunications, State University of Rio de Janeiro, Rio de Janeiro 20.550-900, BrazilDepartment of Electronics Engineering and Telecommunications, State University of Rio de Janeiro, Rio de Janeiro 20.550-900, BrazilDepartment of Electronics Engineering and Telecommunications, State University of Rio de Janeiro, Rio de Janeiro 20.550-900, BrazilDepartment of Systems Engineering and Computation, State University of Rio de Janeiro, Rio de Janeiro 20.550-900, BrazilDepartment of Computer Science and Information Engineering, Asia University, Taichung 41354, TaiwanDepartment of Business Administration, Asia University, Taichung 41354, TaiwanThe template matching technique is one of the most applied methods to find patterns in images, in which a reduced-size image, called a target, is searched within another image that represents the overall environment. In this work, template matching is used via a co-design system. A hardware coprocessor is designed for the computationally demanding step of template matching, which is the calculation of the normalized cross-correlation coefficient. This computation allows invariance in the global brightness changes in the images, but it is computationally more expensive when using images of larger dimensions, or even sets of images. Furthermore, we investigate the performance of six different swarm intelligence techniques aiming to accelerate the target search process. To evaluate the proposed design, the processing time, the number of iterations, and the success rate were compared. The results show that it is possible to obtain approaches capable of processing video images at 30 frames per second with an acceptable average success rate for detecting the tracked target. The search strategies based on PSO, ABC, FFA, and CS are able to meet the processing time of 30 frame/s, yielding average accuracy rates above 80% for the pipelined co-design implementation. However, FWA, EHO, and BFOA could not achieve the required timing restriction, and they achieved an acceptance rate around 60%. Among all the investigated search strategies, the PSO provides the best performance, yielding an average processing time of 16.22 ms coupled with a 95% success rate.https://www.mdpi.com/1424-8220/23/13/5881object trackingtemplate matchingswarm intelligenceimage cross-correlation
spellingShingle Nadia Nedjah
Alexandre V. Cardoso
Yuri M. Tavares
Luiza de Macedo Mourelle
Brij Booshan Gupta
Varsha Arya
Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies
Sensors
object tracking
template matching
swarm intelligence
image cross-correlation
title Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies
title_full Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies
title_fullStr Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies
title_full_unstemmed Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies
title_short Co-Design Dedicated System for Efficient Object Tracking Using Swarm Intelligence-Oriented Search Strategies
title_sort co design dedicated system for efficient object tracking using swarm intelligence oriented search strategies
topic object tracking
template matching
swarm intelligence
image cross-correlation
url https://www.mdpi.com/1424-8220/23/13/5881
work_keys_str_mv AT nadianedjah codesigndedicatedsystemforefficientobjecttrackingusingswarmintelligenceorientedsearchstrategies
AT alexandrevcardoso codesigndedicatedsystemforefficientobjecttrackingusingswarmintelligenceorientedsearchstrategies
AT yurimtavares codesigndedicatedsystemforefficientobjecttrackingusingswarmintelligenceorientedsearchstrategies
AT luizademacedomourelle codesigndedicatedsystemforefficientobjecttrackingusingswarmintelligenceorientedsearchstrategies
AT brijbooshangupta codesigndedicatedsystemforefficientobjecttrackingusingswarmintelligenceorientedsearchstrategies
AT varshaarya codesigndedicatedsystemforefficientobjecttrackingusingswarmintelligenceorientedsearchstrategies