Learning with privileged and sensitive information: a gradient-boosting approach

We consider the problem of learning with sensitive features under the privileged information setting where the goal is to learn a classifier that uses features not available (or too sensitive to collect) at test/deployment time to learn a better model at training time. We focus on tree-based learner...

Full description

Bibliographic Details
Main Authors: Siwen Yan, Phillip Odom, Rahul Pasunuri, Kristian Kersting, Sriraam Natarajan
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-11-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2023.1260583/full
Description
Summary:We consider the problem of learning with sensitive features under the privileged information setting where the goal is to learn a classifier that uses features not available (or too sensitive to collect) at test/deployment time to learn a better model at training time. We focus on tree-based learners, specifically gradient-boosted decision trees for learning with privileged information. Our methods use privileged features as knowledge to guide the algorithm when learning from fully observed (usable) features. We derive the theory, empirically validate the effectiveness of our algorithms, and verify them on standard fairness metrics.
ISSN:2624-8212