A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image

Face recognition has many challenges especially in real life detection, whereby to maintain consistency in getting an accurate recognition is almost impossible. Even for well-established state-of-the-art algorithms or methods will produce low accuracy in recognition if it was conducted under poor or...

Full description

Bibliographic Details
Main Authors: Rayner Pailus, Rayner Alfred
Format: Article
Language:English
Published: The Mattingley Publishing Co., Inc. 2020
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/25597/1/A%20robust%20illumination-invariant%20face%20recognition%20based%20on%20fusion%20of%20thermal%20IR%2C%20maximum%20filter%20and%20visible%20image.pdf
_version_ 1825713902004994048
author Rayner Pailus
Rayner Alfred
author_facet Rayner Pailus
Rayner Alfred
author_sort Rayner Pailus
collection UMS
description Face recognition has many challenges especially in real life detection, whereby to maintain consistency in getting an accurate recognition is almost impossible. Even for well-established state-of-the-art algorithms or methods will produce low accuracy in recognition if it was conducted under poor or bad lighting. To create a more robust face recognition with illumination invariant, this paper proposed an algorithm using a triple fusion approach. We are also implementing a hybrid method that combines the active approach by implementing thermal infrared imaging and also the passive approach of Maximum Filter and visual image. These approaches allow us to improve the image pre-processing as well as feature extraction and face detection, even if we capture a person’s face image in total darkness. In our experiment, Extended Yale B database are tested with Maximum Filter and compared against other state-of-the-filters. We have conduct-ed several experiments on mid-wave and long-wave thermal Infrared performance during pre-processing and saw that it is capable to improve recognition beyond what meets the eye. In our experiment, we found out that PCA eigenface cannot be produced in a poor or bad illumination. Mid-wave thermal creates the heat signature in the body and the Maximum Filter maintains the fine edges that are easily used by any classifiers such as SVM, OpenCV or even kNN together with Euclidian distance to perform face recognition. These configurations have been assembled for a face recognition portable robust system and the result showed that creating fusion between these processed image illumination invariants during preprocessing show far better results than just using visible image, thermal image or maximum filtered image separately.
first_indexed 2024-03-06T03:03:46Z
format Article
id ums.eprints-25597
institution Universiti Malaysia Sabah
language English
last_indexed 2024-03-06T03:03:46Z
publishDate 2020
publisher The Mattingley Publishing Co., Inc.
record_format dspace
spelling ums.eprints-255972020-07-10T06:51:01Z https://eprints.ums.edu.my/id/eprint/25597/ A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image Rayner Pailus Rayner Alfred TJ Mechanical engineering and machinery Face recognition has many challenges especially in real life detection, whereby to maintain consistency in getting an accurate recognition is almost impossible. Even for well-established state-of-the-art algorithms or methods will produce low accuracy in recognition if it was conducted under poor or bad lighting. To create a more robust face recognition with illumination invariant, this paper proposed an algorithm using a triple fusion approach. We are also implementing a hybrid method that combines the active approach by implementing thermal infrared imaging and also the passive approach of Maximum Filter and visual image. These approaches allow us to improve the image pre-processing as well as feature extraction and face detection, even if we capture a person’s face image in total darkness. In our experiment, Extended Yale B database are tested with Maximum Filter and compared against other state-of-the-filters. We have conduct-ed several experiments on mid-wave and long-wave thermal Infrared performance during pre-processing and saw that it is capable to improve recognition beyond what meets the eye. In our experiment, we found out that PCA eigenface cannot be produced in a poor or bad illumination. Mid-wave thermal creates the heat signature in the body and the Maximum Filter maintains the fine edges that are easily used by any classifiers such as SVM, OpenCV or even kNN together with Euclidian distance to perform face recognition. These configurations have been assembled for a face recognition portable robust system and the result showed that creating fusion between these processed image illumination invariants during preprocessing show far better results than just using visible image, thermal image or maximum filtered image separately. The Mattingley Publishing Co., Inc. 2020 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/25597/1/A%20robust%20illumination-invariant%20face%20recognition%20based%20on%20fusion%20of%20thermal%20IR%2C%20maximum%20filter%20and%20visible%20image.pdf Rayner Pailus and Rayner Alfred (2020) A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image. TEST: Engineering and Management, 83. pp. 5294-5302. ISSN 0193 - 4120
spellingShingle TJ Mechanical engineering and machinery
Rayner Pailus
Rayner Alfred
A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image
title A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image
title_full A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image
title_fullStr A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image
title_full_unstemmed A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image
title_short A robust illumination-invariant face recognition based on fusion of thermal IR, maximum filter and visible image
title_sort robust illumination invariant face recognition based on fusion of thermal ir maximum filter and visible image
topic TJ Mechanical engineering and machinery
url https://eprints.ums.edu.my/id/eprint/25597/1/A%20robust%20illumination-invariant%20face%20recognition%20based%20on%20fusion%20of%20thermal%20IR%2C%20maximum%20filter%20and%20visible%20image.pdf
work_keys_str_mv AT raynerpailus arobustilluminationinvariantfacerecognitionbasedonfusionofthermalirmaximumfilterandvisibleimage
AT rayneralfred arobustilluminationinvariantfacerecognitionbasedonfusionofthermalirmaximumfilterandvisibleimage
AT raynerpailus robustilluminationinvariantfacerecognitionbasedonfusionofthermalirmaximumfilterandvisibleimage
AT rayneralfred robustilluminationinvariantfacerecognitionbasedonfusionofthermalirmaximumfilterandvisibleimage