Aligning Faithful Interpretations with their Social Attribution
AbstractWe find that the requirement of model interpretations to be faithful is vague and incomplete. With interpretation by textual highlights as a case study, we present several failure cases. Borrowing concepts from social science, we identify that the problem is a misalignment be...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The MIT Press
2021-01-01
|
| Series: | Transactions of the Association for Computational Linguistics |
| Online Access: | https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00367/98620/Aligning-Faithful-Interpretations-with-their |
| _version_ | 1811234742922641408 |
|---|---|
| author | Alon Jacovi Yoav Goldberg |
| author_facet | Alon Jacovi Yoav Goldberg |
| author_sort | Alon Jacovi |
| collection | DOAJ |
| description |
AbstractWe find that the requirement of model interpretations to be faithful is vague and incomplete. With interpretation by textual highlights as a case study, we present several failure cases. Borrowing concepts from social science, we identify that the problem is a misalignment between the causal chain of decisions (causal attribution) and the attribution of human behavior to the interpretation (social attribution). We reformulate faithfulness as an accurate attribution of causality to the model, and introduce the concept of aligned faithfulness: faithful causal chains that are aligned with their expected social behavior. The two steps of causal attribution and social attribution together complete the process of explaining behavior. With this formalization, we characterize various failures of misaligned faithful highlight interpretations, and propose an alternative causal chain to remedy the issues. Finally, we implement highlight explanations of the proposed causal format using contrastive explanations. |
| first_indexed | 2024-04-12T11:40:54Z |
| format | Article |
| id | doaj.art-83791b8f70c549c9be83f595a4058e75 |
| institution | Directory Open Access Journal |
| issn | 2307-387X |
| language | English |
| last_indexed | 2024-04-12T11:40:54Z |
| publishDate | 2021-01-01 |
| publisher | The MIT Press |
| record_format | Article |
| series | Transactions of the Association for Computational Linguistics |
| spelling | doaj.art-83791b8f70c549c9be83f595a4058e752022-12-22T03:34:37ZengThe MIT PressTransactions of the Association for Computational Linguistics2307-387X2021-01-01929431010.1162/tacl_a_00367Aligning Faithful Interpretations with their Social AttributionAlon Jacovi0Yoav Goldberg1Bar Ilan University, Israel. alonjacovi@gmail.comBar Ilan University and, Allen Institute for AI, Israel. yoav.goldberg@gmail.com AbstractWe find that the requirement of model interpretations to be faithful is vague and incomplete. With interpretation by textual highlights as a case study, we present several failure cases. Borrowing concepts from social science, we identify that the problem is a misalignment between the causal chain of decisions (causal attribution) and the attribution of human behavior to the interpretation (social attribution). We reformulate faithfulness as an accurate attribution of causality to the model, and introduce the concept of aligned faithfulness: faithful causal chains that are aligned with their expected social behavior. The two steps of causal attribution and social attribution together complete the process of explaining behavior. With this formalization, we characterize various failures of misaligned faithful highlight interpretations, and propose an alternative causal chain to remedy the issues. Finally, we implement highlight explanations of the proposed causal format using contrastive explanations.https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00367/98620/Aligning-Faithful-Interpretations-with-their |
| spellingShingle | Alon Jacovi Yoav Goldberg Aligning Faithful Interpretations with their Social Attribution Transactions of the Association for Computational Linguistics |
| title | Aligning Faithful Interpretations with their Social Attribution |
| title_full | Aligning Faithful Interpretations with their Social Attribution |
| title_fullStr | Aligning Faithful Interpretations with their Social Attribution |
| title_full_unstemmed | Aligning Faithful Interpretations with their Social Attribution |
| title_short | Aligning Faithful Interpretations with their Social Attribution |
| title_sort | aligning faithful interpretations with their social attribution |
| url | https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00367/98620/Aligning-Faithful-Interpretations-with-their |
| work_keys_str_mv | AT alonjacovi aligningfaithfulinterpretationswiththeirsocialattribution AT yoavgoldberg aligningfaithfulinterpretationswiththeirsocialattribution |