Extended evaluation of the effect of real and simulated masks on face recognition performance
Abstract Face recognition is an essential technology in our daily lives as a contactless and convenient method of accurate identity verification. Processes such as secure login to electronic devices or identity verification at automatic border control gates are increasingly dependent on such technol...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Hindawi-IET
2021-09-01
|
| Series: | IET Biometrics |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/bme2.12044 |
| _version_ | 1827008694692347904 |
|---|---|
| author | Naser Damer Fadi Boutros Marius Süßmilch Florian Kirchbuchner Arjan Kuijper |
| author_facet | Naser Damer Fadi Boutros Marius Süßmilch Florian Kirchbuchner Arjan Kuijper |
| author_sort | Naser Damer |
| collection | DOAJ |
| description | Abstract Face recognition is an essential technology in our daily lives as a contactless and convenient method of accurate identity verification. Processes such as secure login to electronic devices or identity verification at automatic border control gates are increasingly dependent on such technologies. The recent COVID‐19 pandemic has increased the focus on hygienic and contactless identity verification methods. The pandemic has led to the wide use of face masks, essential to keep the pandemic under control. The effect of mask‐wearing on face recognition in a collaborative environment is currently a sensitive yet understudied issue. Recent reports have tackled this by using face images with synthetic mask‐like face occlusions without exclusively assessing how representative they are of real face masks. These issues are addressed by presenting a specifically collected database containing three sessions, each with three different capture instructions, to simulate real use cases. The data are augmented to include previously used synthetic mask occlusions. Further studied is the effect of masked face probes on the behaviour of four face recognition systems—three academic and one commercial. This study evaluates both masked‐to‐non‐masked and masked‐to‐masked face comparisons. In addition, real masks in the database are compared with simulated masks to determine their comparative effects on face recognition performance. |
| first_indexed | 2024-03-09T07:36:47Z |
| format | Article |
| id | doaj.art-f1ceb08654734e8fa48aaa9846f6961b |
| institution | Directory Open Access Journal |
| issn | 2047-4938 2047-4946 |
| language | English |
| last_indexed | 2025-02-18T12:37:49Z |
| publishDate | 2021-09-01 |
| publisher | Hindawi-IET |
| record_format | Article |
| series | IET Biometrics |
| spelling | doaj.art-f1ceb08654734e8fa48aaa9846f6961b2024-11-02T04:13:30ZengHindawi-IETIET Biometrics2047-49382047-49462021-09-0110554856110.1049/bme2.12044Extended evaluation of the effect of real and simulated masks on face recognition performanceNaser Damer0Fadi Boutros1Marius Süßmilch2Florian Kirchbuchner3Arjan Kuijper4Fraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyFraunhofer Institute for Computer Graphics Research IGD Darmstadt GermanyAbstract Face recognition is an essential technology in our daily lives as a contactless and convenient method of accurate identity verification. Processes such as secure login to electronic devices or identity verification at automatic border control gates are increasingly dependent on such technologies. The recent COVID‐19 pandemic has increased the focus on hygienic and contactless identity verification methods. The pandemic has led to the wide use of face masks, essential to keep the pandemic under control. The effect of mask‐wearing on face recognition in a collaborative environment is currently a sensitive yet understudied issue. Recent reports have tackled this by using face images with synthetic mask‐like face occlusions without exclusively assessing how representative they are of real face masks. These issues are addressed by presenting a specifically collected database containing three sessions, each with three different capture instructions, to simulate real use cases. The data are augmented to include previously used synthetic mask occlusions. Further studied is the effect of masked face probes on the behaviour of four face recognition systems—three academic and one commercial. This study evaluates both masked‐to‐non‐masked and masked‐to‐masked face comparisons. In addition, real masks in the database are compared with simulated masks to determine their comparative effects on face recognition performance.https://doi.org/10.1049/bme2.12044biometrics (access control)data analysisdiseasesface recognitionepidemics |
| spellingShingle | Naser Damer Fadi Boutros Marius Süßmilch Florian Kirchbuchner Arjan Kuijper Extended evaluation of the effect of real and simulated masks on face recognition performance IET Biometrics biometrics (access control) data analysis diseases face recognition epidemics |
| title | Extended evaluation of the effect of real and simulated masks on face recognition performance |
| title_full | Extended evaluation of the effect of real and simulated masks on face recognition performance |
| title_fullStr | Extended evaluation of the effect of real and simulated masks on face recognition performance |
| title_full_unstemmed | Extended evaluation of the effect of real and simulated masks on face recognition performance |
| title_short | Extended evaluation of the effect of real and simulated masks on face recognition performance |
| title_sort | extended evaluation of the effect of real and simulated masks on face recognition performance |
| topic | biometrics (access control) data analysis diseases face recognition epidemics |
| url | https://doi.org/10.1049/bme2.12044 |
| work_keys_str_mv | AT naserdamer extendedevaluationoftheeffectofrealandsimulatedmasksonfacerecognitionperformance AT fadiboutros extendedevaluationoftheeffectofrealandsimulatedmasksonfacerecognitionperformance AT mariussußmilch extendedevaluationoftheeffectofrealandsimulatedmasksonfacerecognitionperformance AT floriankirchbuchner extendedevaluationoftheeffectofrealandsimulatedmasksonfacerecognitionperformance AT arjankuijper extendedevaluationoftheeffectofrealandsimulatedmasksonfacerecognitionperformance |