How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability
Large Language Models (LLMs) such as GPT developed by OpenAI, have already shown astonishing results, introducing quick changes in our society. This has been intensified by the release of ChatGPT which allows anyone to interact in a simple conversational way with LLMs, without any experience in the...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10445251/ |
| _version_ | 1827308186846101504 |
|---|---|
| author | Ivan Deandres-Tame Ruben Tolosana Ruben Vera-Rodriguez Aythami Morales Julian Fierrez Javier Ortega-Garcia |
| author_facet | Ivan Deandres-Tame Ruben Tolosana Ruben Vera-Rodriguez Aythami Morales Julian Fierrez Javier Ortega-Garcia |
| author_sort | Ivan Deandres-Tame |
| collection | DOAJ |
| description | Large Language Models (LLMs) such as GPT developed by OpenAI, have already shown astonishing results, introducing quick changes in our society. This has been intensified by the release of ChatGPT which allows anyone to interact in a simple conversational way with LLMs, without any experience in the field needed. As a result, ChatGPT has been rapidly applied to many different tasks such as code- and song-writer, education, virtual assistants, etc., showing impressive results for tasks for which it was not trained (zero-shot learning). The present study aims to explore the ability of ChatGPT, based on the recent GPT-4 multimodal LLM, for the task of face biometrics. In particular, we analyze the ability of ChatGPT to perform tasks such as face verification, soft-biometrics estimation, and explainability of the results. ChatGPT could be very valuable to further increase the explainability and transparency of automatic decisions in human scenarios. Experiments are carried out in order to evaluate the performance and robustness of ChatGPT, using popular public benchmarks and comparing the results with state-of-the-art methods in the field. The results achieved in this study show the potential of LLMs such as ChatGPT for face biometrics, especially to enhance explainability. For reproducibility reasons, we release all the code in GitHub. |
| first_indexed | 2024-04-24T18:54:07Z |
| format | Article |
| id | doaj.art-96e7d1b9d8a54df9a21c3eaf09134dca |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-24T18:54:07Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-96e7d1b9d8a54df9a21c3eaf09134dca2024-03-26T17:46:39ZengIEEEIEEE Access2169-35362024-01-0112343903440110.1109/ACCESS.2024.337043710445251How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and ExplainabilityIvan Deandres-Tame0https://orcid.org/0009-0008-5402-1153Ruben Tolosana1https://orcid.org/0000-0002-9393-3066Ruben Vera-Rodriguez2https://orcid.org/0000-0002-6338-8511Aythami Morales3https://orcid.org/0000-0002-7268-4785Julian Fierrez4https://orcid.org/0000-0002-6343-5656Javier Ortega-Garcia5https://orcid.org/0000-0003-0557-1948Biometrics and Data Pattern Analytics Laboratory—BiDA Laboratory, Universidad Autónoma de Madrid, Madrid, SpainBiometrics and Data Pattern Analytics Laboratory—BiDA Laboratory, Universidad Autónoma de Madrid, Madrid, SpainBiometrics and Data Pattern Analytics Laboratory—BiDA Laboratory, Universidad Autónoma de Madrid, Madrid, SpainBiometrics and Data Pattern Analytics Laboratory—BiDA Laboratory, Universidad Autónoma de Madrid, Madrid, SpainBiometrics and Data Pattern Analytics Laboratory—BiDA Laboratory, Universidad Autónoma de Madrid, Madrid, SpainBiometrics and Data Pattern Analytics Laboratory—BiDA Laboratory, Universidad Autónoma de Madrid, Madrid, SpainLarge Language Models (LLMs) such as GPT developed by OpenAI, have already shown astonishing results, introducing quick changes in our society. This has been intensified by the release of ChatGPT which allows anyone to interact in a simple conversational way with LLMs, without any experience in the field needed. As a result, ChatGPT has been rapidly applied to many different tasks such as code- and song-writer, education, virtual assistants, etc., showing impressive results for tasks for which it was not trained (zero-shot learning). The present study aims to explore the ability of ChatGPT, based on the recent GPT-4 multimodal LLM, for the task of face biometrics. In particular, we analyze the ability of ChatGPT to perform tasks such as face verification, soft-biometrics estimation, and explainability of the results. ChatGPT could be very valuable to further increase the explainability and transparency of automatic decisions in human scenarios. Experiments are carried out in order to evaluate the performance and robustness of ChatGPT, using popular public benchmarks and comparing the results with state-of-the-art methods in the field. The results achieved in this study show the potential of LLMs such as ChatGPT for face biometrics, especially to enhance explainability. For reproducibility reasons, we release all the code in GitHub.https://ieeexplore.ieee.org/document/10445251/Large language modelsChatGPTface recognitionsoft biometricsexplainability |
| spellingShingle | Ivan Deandres-Tame Ruben Tolosana Ruben Vera-Rodriguez Aythami Morales Julian Fierrez Javier Ortega-Garcia How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability IEEE Access Large language models ChatGPT face recognition soft biometrics explainability |
| title | How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability |
| title_full | How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability |
| title_fullStr | How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability |
| title_full_unstemmed | How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability |
| title_short | How Good Is ChatGPT at Face Biometrics? A First Look Into Recognition, Soft Biometrics, and Explainability |
| title_sort | how good is chatgpt at face biometrics a first look into recognition soft biometrics and explainability |
| topic | Large language models ChatGPT face recognition soft biometrics explainability |
| url | https://ieeexplore.ieee.org/document/10445251/ |
| work_keys_str_mv | AT ivandeandrestame howgoodischatgptatfacebiometricsafirstlookintorecognitionsoftbiometricsandexplainability AT rubentolosana howgoodischatgptatfacebiometricsafirstlookintorecognitionsoftbiometricsandexplainability AT rubenverarodriguez howgoodischatgptatfacebiometricsafirstlookintorecognitionsoftbiometricsandexplainability AT aythamimorales howgoodischatgptatfacebiometricsafirstlookintorecognitionsoftbiometricsandexplainability AT julianfierrez howgoodischatgptatfacebiometricsafirstlookintorecognitionsoftbiometricsandexplainability AT javierortegagarcia howgoodischatgptatfacebiometricsafirstlookintorecognitionsoftbiometricsandexplainability |