Relational graph convolutional networks do not learn sound rules
Graph neural networks (GNNs) are frequently used to predict missing facts in knowledge graphs (KGs). Motivated by the lack of explainability for the outputs of these models, recent work has aimed to explain their predictions using Datalog, a widely used logic-based formalism. However, such work has...
| Main Authors: | , , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
Principles of Knowledge Representation and Reasoning
2024
|
| _version_ | 1817931374110179328 |
|---|---|
| author | Morris, M Tena Cucala, DJ Cuenca Grau, B Horrocks, I |
| author_facet | Morris, M Tena Cucala, DJ Cuenca Grau, B Horrocks, I |
| author_sort | Morris, M |
| collection | OXFORD |
| description | Graph neural networks (GNNs) are frequently used to predict missing facts in knowledge graphs (KGs). Motivated by the lack of explainability for the outputs of these models, recent work has aimed to explain their predictions using Datalog, a widely used logic-based formalism. However, such work has been restricted to certain subclasses of GNNs. In this paper, we consider one of the most popular GNN architectures for KGs, R-GCN, and we provide two methods to extract rules that explain its predictions and are sound, in the sense that each fact derived by the rules is also predicted by the GNN, for any input dataset. Furthermore, we provide a method that can verify that certain classes of Datalog rules are not sound for the R-GCN. In our experiments, we train R-GCNs on KG completion benchmarks, and we are able to verify that no Datalog rule is sound for these models, even though the models often obtain high to near-perfect accuracy. This raises some concerns about the ability of R-GCN models to generalise and about the explainability of their predictions. We further provide two variations to the training paradigm of R-GCN that encourage it to learn sound rules and find a trade-off between model accuracy and the number of learned sound rules. |
| first_indexed | 2024-09-25T04:31:07Z |
| format | Conference item |
| id | oxford-uuid:fbf86710-5225-4053-83a3-0d124f47aa88 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-12-09T03:21:00Z |
| publishDate | 2024 |
| publisher | Principles of Knowledge Representation and Reasoning |
| record_format | dspace |
| spelling | oxford-uuid:fbf86710-5225-4053-83a3-0d124f47aa882024-11-08T09:26:02ZRelational graph convolutional networks do not learn sound rulesConference itemhttp://purl.org/coar/resource_type/c_5794uuid:fbf86710-5225-4053-83a3-0d124f47aa88EnglishSymplectic ElementsPrinciples of Knowledge Representation and Reasoning2024Morris, MTena Cucala, DJCuenca Grau, BHorrocks, IGraph neural networks (GNNs) are frequently used to predict missing facts in knowledge graphs (KGs). Motivated by the lack of explainability for the outputs of these models, recent work has aimed to explain their predictions using Datalog, a widely used logic-based formalism. However, such work has been restricted to certain subclasses of GNNs. In this paper, we consider one of the most popular GNN architectures for KGs, R-GCN, and we provide two methods to extract rules that explain its predictions and are sound, in the sense that each fact derived by the rules is also predicted by the GNN, for any input dataset. Furthermore, we provide a method that can verify that certain classes of Datalog rules are not sound for the R-GCN. In our experiments, we train R-GCNs on KG completion benchmarks, and we are able to verify that no Datalog rule is sound for these models, even though the models often obtain high to near-perfect accuracy. This raises some concerns about the ability of R-GCN models to generalise and about the explainability of their predictions. We further provide two variations to the training paradigm of R-GCN that encourage it to learn sound rules and find a trade-off between model accuracy and the number of learned sound rules. |
| spellingShingle | Morris, M Tena Cucala, DJ Cuenca Grau, B Horrocks, I Relational graph convolutional networks do not learn sound rules |
| title | Relational graph convolutional networks do not learn sound rules |
| title_full | Relational graph convolutional networks do not learn sound rules |
| title_fullStr | Relational graph convolutional networks do not learn sound rules |
| title_full_unstemmed | Relational graph convolutional networks do not learn sound rules |
| title_short | Relational graph convolutional networks do not learn sound rules |
| title_sort | relational graph convolutional networks do not learn sound rules |
| work_keys_str_mv | AT morrism relationalgraphconvolutionalnetworksdonotlearnsoundrules AT tenacucaladj relationalgraphconvolutionalnetworksdonotlearnsoundrules AT cuencagraub relationalgraphconvolutionalnetworksdonotlearnsoundrules AT horrocksi relationalgraphconvolutionalnetworksdonotlearnsoundrules |