Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images

In recent years, the need for security of personal data is becoming progressively important. In this regard, the identification system based on fusion of multibiometric is most recommended for significantly improving and achieving the high performance accuracy. The main purpose of this paper is to p...

Full description

Bibliographic Details
Main Authors: El mehdi Cherrat, Rachid Alaoui, Hassane Bouzahir
Format: Article
Language:English
Published: PeerJ Inc. 2020-01-01
Series:PeerJ Computer Science
Subjects:
Online Access:https://peerj.com/articles/cs-248.pdf
_version_ 1817997603007102976
author El mehdi Cherrat
Rachid Alaoui
Hassane Bouzahir
author_facet El mehdi Cherrat
Rachid Alaoui
Hassane Bouzahir
author_sort El mehdi Cherrat
collection DOAJ
description In recent years, the need for security of personal data is becoming progressively important. In this regard, the identification system based on fusion of multibiometric is most recommended for significantly improving and achieving the high performance accuracy. The main purpose of this paper is to propose a hybrid system of combining the effect of tree efficient models: Convolutional neural network (CNN), Softmax and Random forest (RF) classifier based on multi-biometric fingerprint, finger-vein and face identification system. In conventional fingerprint system, image pre-processed is applied to separate the foreground and background region based on K-means and DBSCAN algorithm. Furthermore, the features are extracted using CNNs and dropout approach, after that, the Softmax performs as a recognizer. In conventional fingervein system, the region of interest image contrast enhancement using exposure fusion framework is input into the CNNs model. Moreover, the RF classifier is proposed for classification. In conventional face system, the CNNs architecture and Softmax are required to generate face feature vectors and classify personal recognition. The score provided by these systems is combined for improving Human identification. The proposed algorithm is evaluated on publicly available SDUMLA-HMT real multimodal biometric database using a GPU based implementation. Experimental results on the datasets has shown significant capability for identification biometric system. The proposed work can offer an accurate and efficient matching compared with other system based on unimodal, bimodal, multimodal characteristics.
first_indexed 2024-04-14T02:40:51Z
format Article
id doaj.art-0abeb6919a1c44ad9250415688fdb1c2
institution Directory Open Access Journal
issn 2376-5992
language English
last_indexed 2024-04-14T02:40:51Z
publishDate 2020-01-01
publisher PeerJ Inc.
record_format Article
series PeerJ Computer Science
spelling doaj.art-0abeb6919a1c44ad9250415688fdb1c22022-12-22T02:17:07ZengPeerJ Inc.PeerJ Computer Science2376-59922020-01-016e24810.7717/peerj-cs.248Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face imagesEl mehdi Cherrat0Rachid Alaoui1Hassane Bouzahir2Laboratory of Systems Engineering and Information Technology, National School of Applied Sciences, Ibn Zohr University, Agadir, MoroccoLaboratory of Computer Science and Telecommunications Research, Faculty of Sciences, Mohammed V University, Rabat, MoroccoLaboratory of Systems Engineering and Information Technology, National School of Applied Sciences, Ibn Zohr University, Agadir, MoroccoIn recent years, the need for security of personal data is becoming progressively important. In this regard, the identification system based on fusion of multibiometric is most recommended for significantly improving and achieving the high performance accuracy. The main purpose of this paper is to propose a hybrid system of combining the effect of tree efficient models: Convolutional neural network (CNN), Softmax and Random forest (RF) classifier based on multi-biometric fingerprint, finger-vein and face identification system. In conventional fingerprint system, image pre-processed is applied to separate the foreground and background region based on K-means and DBSCAN algorithm. Furthermore, the features are extracted using CNNs and dropout approach, after that, the Softmax performs as a recognizer. In conventional fingervein system, the region of interest image contrast enhancement using exposure fusion framework is input into the CNNs model. Moreover, the RF classifier is proposed for classification. In conventional face system, the CNNs architecture and Softmax are required to generate face feature vectors and classify personal recognition. The score provided by these systems is combined for improving Human identification. The proposed algorithm is evaluated on publicly available SDUMLA-HMT real multimodal biometric database using a GPU based implementation. Experimental results on the datasets has shown significant capability for identification biometric system. The proposed work can offer an accurate and efficient matching compared with other system based on unimodal, bimodal, multimodal characteristics.https://peerj.com/articles/cs-248.pdfCNNMultimodal biometricsFingerprint recognitionFinger-vein recognitionFace recognitionFusion
spellingShingle El mehdi Cherrat
Rachid Alaoui
Hassane Bouzahir
Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
PeerJ Computer Science
CNN
Multimodal biometrics
Fingerprint recognition
Finger-vein recognition
Face recognition
Fusion
title Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
title_full Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
title_fullStr Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
title_full_unstemmed Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
title_short Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
title_sort convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint finger vein and face images
topic CNN
Multimodal biometrics
Fingerprint recognition
Finger-vein recognition
Face recognition
Fusion
url https://peerj.com/articles/cs-248.pdf
work_keys_str_mv AT elmehdicherrat convolutionalneuralnetworksapproachformultimodalbiometricidentificationsystemusingthefusionoffingerprintfingerveinandfaceimages
AT rachidalaoui convolutionalneuralnetworksapproachformultimodalbiometricidentificationsystemusingthefusionoffingerprintfingerveinandfaceimages
AT hassanebouzahir convolutionalneuralnetworksapproachformultimodalbiometricidentificationsystemusingthefusionoffingerprintfingerveinandfaceimages