SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk

In credit risk estimation, the most important element is obtaining a probability of default as close as possible to the effective risk. This effort quickly prompted new, powerful algorithms that reach a far higher accuracy, but at the cost of losing intelligibility, such as Gradient Boosting or ense...

Full description

Bibliographic Details
Main Authors: Alex Gramegna, Paolo Giudici
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-09-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2021.752558/full
_version_ 1818722272730415104
author Alex Gramegna
Paolo Giudici
author_facet Alex Gramegna
Paolo Giudici
author_sort Alex Gramegna
collection DOAJ
description In credit risk estimation, the most important element is obtaining a probability of default as close as possible to the effective risk. This effort quickly prompted new, powerful algorithms that reach a far higher accuracy, but at the cost of losing intelligibility, such as Gradient Boosting or ensemble methods. These models are usually referred to as “black-boxes”, implying that you know the inputs and the output, but there is little way to understand what is going on under the hood. As a response to that, we have seen several different Explainable AI models flourish in recent years, with the aim of letting the user see why the black-box gave a certain output. In this context, we evaluate two very popular eXplainable AI (XAI) models in their ability to discriminate observations into groups, through the application of both unsupervised and predictive modeling to the weights these XAI models assign to features locally. The evaluation is carried out on real Small and Medium Enterprises data, obtained from official italian repositories, and may form the basis for the employment of such XAI models for post-processing features extraction.
first_indexed 2024-12-17T20:52:00Z
format Article
id doaj.art-48d1ddd8c98f478db6baafb5bf1c3538
institution Directory Open Access Journal
issn 2624-8212
language English
last_indexed 2024-12-17T20:52:00Z
publishDate 2021-09-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Artificial Intelligence
spelling doaj.art-48d1ddd8c98f478db6baafb5bf1c35382022-12-21T21:32:59ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122021-09-01410.3389/frai.2021.752558752558SHAP and LIME: An Evaluation of Discriminative Power in Credit RiskAlex GramegnaPaolo GiudiciIn credit risk estimation, the most important element is obtaining a probability of default as close as possible to the effective risk. This effort quickly prompted new, powerful algorithms that reach a far higher accuracy, but at the cost of losing intelligibility, such as Gradient Boosting or ensemble methods. These models are usually referred to as “black-boxes”, implying that you know the inputs and the output, but there is little way to understand what is going on under the hood. As a response to that, we have seen several different Explainable AI models flourish in recent years, with the aim of letting the user see why the black-box gave a certain output. In this context, we evaluate two very popular eXplainable AI (XAI) models in their ability to discriminate observations into groups, through the application of both unsupervised and predictive modeling to the weights these XAI models assign to features locally. The evaluation is carried out on real Small and Medium Enterprises data, obtained from official italian repositories, and may form the basis for the employment of such XAI models for post-processing features extraction.https://www.frontiersin.org/articles/10.3389/frai.2021.752558/fullSHAP (shapley additive exPlanations)credit riskdefaultclusteringexplainable artificial intelligence (XAI)
spellingShingle Alex Gramegna
Paolo Giudici
SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
Frontiers in Artificial Intelligence
SHAP (shapley additive exPlanations)
credit risk
default
clustering
explainable artificial intelligence (XAI)
title SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
title_full SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
title_fullStr SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
title_full_unstemmed SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
title_short SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
title_sort shap and lime an evaluation of discriminative power in credit risk
topic SHAP (shapley additive exPlanations)
credit risk
default
clustering
explainable artificial intelligence (XAI)
url https://www.frontiersin.org/articles/10.3389/frai.2021.752558/full
work_keys_str_mv AT alexgramegna shapandlimeanevaluationofdiscriminativepowerincreditrisk
AT paologiudici shapandlimeanevaluationofdiscriminativepowerincreditrisk