A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints

Background: The most significant motivations for designing multi-biometric systems are high-accuracy recognition, high-security assurances as well as overcoming the limitations like non-universality, noisy sensor data, and large intra-user variations. Therefore, choosing data for fusion is of high s...

Full description

Bibliographic Details
Main Authors: Mohammad H Safavipour, Mohammad A Doostari, Hamed Sadjedi
Format: Article
Language:English
Published: Wolters Kluwer Medknow Publications 2022-01-01
Series:Journal of Medical Signals and Sensors
Subjects:
Online Access:http://www.jmssjournal.net/article.asp?issn=2228-7477;year=2022;volume=12;issue=3;spage=177;epage=191;aulast=Safavipour
_version_ 1798038517774811136
author Mohammad H Safavipour
Mohammad A Doostari
Hamed Sadjedi
author_facet Mohammad H Safavipour
Mohammad A Doostari
Hamed Sadjedi
author_sort Mohammad H Safavipour
collection DOAJ
description Background: The most significant motivations for designing multi-biometric systems are high-accuracy recognition, high-security assurances as well as overcoming the limitations like non-universality, noisy sensor data, and large intra-user variations. Therefore, choosing data for fusion is of high significance for the design of a multimodal biometric system. The feature vectors contain richer information than the scores, decisions and even raw data, thereby making feature-level fusion more effective than other levels. Method: In the proposed method, kernel is used for fusion in feature space. First, the face features are extracted using kernel-based methods, the features of both right and left irises are extracted using Hough Transform and Daugman algorithm methods, and the features of both thumb prints are extracted using the Gabor filter bank. Second, after normalization operations, we use kernel methods to map the feature vectors to a kernel Hilbert space where non-linear relations are shown as linear for the purpose of compatibility of feature spaces. Then, dimensionality reduction algorithms are used to the fusion of the feature vectors extracted from fingerprints, irises and the face. since the proposed system uses face, both right 7and left irises and right and left thumbprints, it is hybrid multi-biometric system. We c8arried out the tests on seven databases. Results: Our results show that the hybrid multimodal template, while being secure against spoof attacks and making the system robust, can use the dimensionality of only 15 features to increase the accuracy of a hybrid multimodal biometric system to 100%, which shows a significant improvement compared with uni-biometric and other multimodal systems. Conclusion: The proposed method can be used to search large databases. Consequently, a large database of a secure multimodal template could be correctly differentiated based on the corresponding class of a test sample without any consistency error.
first_indexed 2024-04-11T21:41:17Z
format Article
id doaj.art-a3f4632fdc57461a82c723a8d86d49aa
institution Directory Open Access Journal
issn 2228-7477
language English
last_indexed 2024-04-11T21:41:17Z
publishDate 2022-01-01
publisher Wolters Kluwer Medknow Publications
record_format Article
series Journal of Medical Signals and Sensors
spelling doaj.art-a3f4632fdc57461a82c723a8d86d49aa2022-12-22T04:01:35ZengWolters Kluwer Medknow PublicationsJournal of Medical Signals and Sensors2228-74772022-01-0112317719110.4103/jmss.jmss_103_21A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprintsMohammad H SafavipourMohammad A DoostariHamed SadjediBackground: The most significant motivations for designing multi-biometric systems are high-accuracy recognition, high-security assurances as well as overcoming the limitations like non-universality, noisy sensor data, and large intra-user variations. Therefore, choosing data for fusion is of high significance for the design of a multimodal biometric system. The feature vectors contain richer information than the scores, decisions and even raw data, thereby making feature-level fusion more effective than other levels. Method: In the proposed method, kernel is used for fusion in feature space. First, the face features are extracted using kernel-based methods, the features of both right and left irises are extracted using Hough Transform and Daugman algorithm methods, and the features of both thumb prints are extracted using the Gabor filter bank. Second, after normalization operations, we use kernel methods to map the feature vectors to a kernel Hilbert space where non-linear relations are shown as linear for the purpose of compatibility of feature spaces. Then, dimensionality reduction algorithms are used to the fusion of the feature vectors extracted from fingerprints, irises and the face. since the proposed system uses face, both right 7and left irises and right and left thumbprints, it is hybrid multi-biometric system. We c8arried out the tests on seven databases. Results: Our results show that the hybrid multimodal template, while being secure against spoof attacks and making the system robust, can use the dimensionality of only 15 features to increase the accuracy of a hybrid multimodal biometric system to 100%, which shows a significant improvement compared with uni-biometric and other multimodal systems. Conclusion: The proposed method can be used to search large databases. Consequently, a large database of a secure multimodal template could be correctly differentiated based on the corresponding class of a test sample without any consistency error.http://www.jmssjournal.net/article.asp?issn=2228-7477;year=2022;volume=12;issue=3;spage=177;epage=191;aulast=Safavipourfeature-level fusionhybridkernelmultimodal biometric
spellingShingle Mohammad H Safavipour
Mohammad A Doostari
Hamed Sadjedi
A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints
Journal of Medical Signals and Sensors
feature-level fusion
hybrid
kernel
multimodal biometric
title A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints
title_full A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints
title_fullStr A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints
title_full_unstemmed A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints
title_short A hybrid approach to multimodal biometric recognition based on feature-level fusion of face, two irises, and both thumbprints
title_sort hybrid approach to multimodal biometric recognition based on feature level fusion of face two irises and both thumbprints
topic feature-level fusion
hybrid
kernel
multimodal biometric
url http://www.jmssjournal.net/article.asp?issn=2228-7477;year=2022;volume=12;issue=3;spage=177;epage=191;aulast=Safavipour
work_keys_str_mv AT mohammadhsafavipour ahybridapproachtomultimodalbiometricrecognitionbasedonfeaturelevelfusionoffacetwoirisesandboththumbprints
AT mohammadadoostari ahybridapproachtomultimodalbiometricrecognitionbasedonfeaturelevelfusionoffacetwoirisesandboththumbprints
AT hamedsadjedi ahybridapproachtomultimodalbiometricrecognitionbasedonfeaturelevelfusionoffacetwoirisesandboththumbprints
AT mohammadhsafavipour hybridapproachtomultimodalbiometricrecognitionbasedonfeaturelevelfusionoffacetwoirisesandboththumbprints
AT mohammadadoostari hybridapproachtomultimodalbiometricrecognitionbasedonfeaturelevelfusionoffacetwoirisesandboththumbprints
AT hamedsadjedi hybridapproachtomultimodalbiometricrecognitionbasedonfeaturelevelfusionoffacetwoirisesandboththumbprints