System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia

Face recognition is a natural skill that a child performs from the first days of life; unfortunately, there are people with visual or neurological problems that prevent the individual from performing the process visually. This work describes a system that integrates Artificial Intelligence which lea...

Full description

Bibliographic Details
Main Authors: Moisés Márquez-Olivera, Antonio-Gustavo Juárez-Gracia, Viridiana Hernández-Herrera, Amadeo-José Argüelles-Cruz, Itzamá López-Yáñez
Format: Article
Language:English
Published: MDPI AG 2019-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/19/3/578
_version_ 1828150650025803776
author Moisés Márquez-Olivera
Antonio-Gustavo Juárez-Gracia
Viridiana Hernández-Herrera
Amadeo-José Argüelles-Cruz
Itzamá López-Yáñez
author_facet Moisés Márquez-Olivera
Antonio-Gustavo Juárez-Gracia
Viridiana Hernández-Herrera
Amadeo-José Argüelles-Cruz
Itzamá López-Yáñez
author_sort Moisés Márquez-Olivera
collection DOAJ
description Face recognition is a natural skill that a child performs from the first days of life; unfortunately, there are people with visual or neurological problems that prevent the individual from performing the process visually. This work describes a system that integrates Artificial Intelligence which learns the face of the people with whom the user interacts daily. During the study we propose a new hybrid model of Alpha-Beta Associative memories (Amαβ) with Correlation Matrix (CM) and K-Nearest Neighbors (KNN), where the Amαβ-CMKNN was trained with characteristic biometric vectors generated from images of faces from people who present different facial expressions such as happiness, surprise, anger and sadness. To test the performance of the hybrid model, two experiments that differ in the selection of parameters that characterize the face are conducted. The performance of the proposed model was tested in the databases CK+, CAS-PEAL-R1 and Face-MECS (own), which test the Amαβ-CMKNN with faces of subjects of both sexes, different races, facial expressions, poses and environmental conditions. The hybrid model was able to remember 100% of all the faces learned during their training, while in the test in which faces are presented that have variations with respect to those learned the results range from 95.05% in controlled environments and 86.48% in real environments using the proposed integrated system.
first_indexed 2024-04-11T21:46:17Z
format Article
id doaj.art-e5c4db22ab2c434885bad10e5ec50e23
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-11T21:46:17Z
publishDate 2019-01-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-e5c4db22ab2c434885bad10e5ec50e232022-12-22T04:01:24ZengMDPI AGSensors1424-82202019-01-0119357810.3390/s19030578s19030578System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or ProsopagnosiaMoisés Márquez-Olivera0Antonio-Gustavo Juárez-Gracia1Viridiana Hernández-Herrera2Amadeo-José Argüelles-Cruz3Itzamá López-Yáñez4CICATA Unidad Legaria, Instituto Politécnico Nacional, Av. Legaria No. 694 Col. Irrigación, CDMX 11500 Mexico City, MéxicoCICATA Unidad Legaria, Instituto Politécnico Nacional, Av. Legaria No. 694 Col. Irrigación, CDMX 11500 Mexico City, MéxicoCIITEC, Instituto Politécnico Nacional, Cerrada Cecati s/n Col. Sta. Catarina, Azc., CDMX 02250 Mexico City, MéxicoCIC, Instituto Politécnico Nacional, Av. Juan de Dios Bátiz, Esq. Miguel Othón de Mendizábal, Col. Nueva Industrial Vallejo, CDMX 07738 Mexico City, MéxicoCIDETEC, Instituto Politécnico Nacional, Av. Juan de Dios Bátiz, Esq. Miguel Othón de Mendizábal, Col. Nueva Industrial Vallejo, CDMX 07700 Mexico City, MéxicoFace recognition is a natural skill that a child performs from the first days of life; unfortunately, there are people with visual or neurological problems that prevent the individual from performing the process visually. This work describes a system that integrates Artificial Intelligence which learns the face of the people with whom the user interacts daily. During the study we propose a new hybrid model of Alpha-Beta Associative memories (Amαβ) with Correlation Matrix (CM) and K-Nearest Neighbors (KNN), where the Amαβ-CMKNN was trained with characteristic biometric vectors generated from images of faces from people who present different facial expressions such as happiness, surprise, anger and sadness. To test the performance of the hybrid model, two experiments that differ in the selection of parameters that characterize the face are conducted. The performance of the proposed model was tested in the databases CK+, CAS-PEAL-R1 and Face-MECS (own), which test the Amαβ-CMKNN with faces of subjects of both sexes, different races, facial expressions, poses and environmental conditions. The hybrid model was able to remember 100% of all the faces learned during their training, while in the test in which faces are presented that have variations with respect to those learned the results range from 95.05% in controlled environments and 86.48% in real environments using the proposed integrated system.https://www.mdpi.com/1424-8220/19/3/578face recognitionassistive technologiesfacial expressionsimpaired visionalpha-beta associative memoriescorrelation matrixk-nearest neighbors (KNN)associative memory
spellingShingle Moisés Márquez-Olivera
Antonio-Gustavo Juárez-Gracia
Viridiana Hernández-Herrera
Amadeo-José Argüelles-Cruz
Itzamá López-Yáñez
System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia
Sensors
face recognition
assistive technologies
facial expressions
impaired vision
alpha-beta associative memories
correlation matrix
k-nearest neighbors (KNN)
associative memory
title System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia
title_full System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia
title_fullStr System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia
title_full_unstemmed System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia
title_short System for Face Recognition under Different Facial Expressions Using a New Associative Hybrid Model Amαβ-KNN for People with Visual Impairment or Prosopagnosia
title_sort system for face recognition under different facial expressions using a new associative hybrid model amαβ knn for people with visual impairment or prosopagnosia
topic face recognition
assistive technologies
facial expressions
impaired vision
alpha-beta associative memories
correlation matrix
k-nearest neighbors (KNN)
associative memory
url https://www.mdpi.com/1424-8220/19/3/578
work_keys_str_mv AT moisesmarquezolivera systemforfacerecognitionunderdifferentfacialexpressionsusinganewassociativehybridmodelamabknnforpeoplewithvisualimpairmentorprosopagnosia
AT antoniogustavojuarezgracia systemforfacerecognitionunderdifferentfacialexpressionsusinganewassociativehybridmodelamabknnforpeoplewithvisualimpairmentorprosopagnosia
AT viridianahernandezherrera systemforfacerecognitionunderdifferentfacialexpressionsusinganewassociativehybridmodelamabknnforpeoplewithvisualimpairmentorprosopagnosia
AT amadeojosearguellescruz systemforfacerecognitionunderdifferentfacialexpressionsusinganewassociativehybridmodelamabknnforpeoplewithvisualimpairmentorprosopagnosia
AT itzamalopezyanez systemforfacerecognitionunderdifferentfacialexpressionsusinganewassociativehybridmodelamabknnforpeoplewithvisualimpairmentorprosopagnosia