Enhancing Attention’s Explanation Using Interpretable Tsetlin Machine

Enhancing Attention’s Explanation Using Interpretable Tsetlin Machine

Explainability is one of the key factors in Natural Language Processing (NLP) specially for legal documents, medical diagnosis, and clinical text. Attention mechanism has been a popular choice for such explainability recently by estimating the relative importance of input units. Recent research has...

Full description

Bibliographic Details
Main Authors:	Rohan Kumar Yadav, Dragoş Constantin Nicolae
Format:	Article
Language:	English
Published:	MDPI AG 2022-04-01
Series:	Algorithms
Subjects:	NLP interpretability explainability Tsetlin Machine Bi-GRUs attention
Online Access:	https://www.mdpi.com/1999-4893/15/5/143

Similar Items

Tsetlin Machine for Sentiment Analysis and Spam Review Detection in Chinese
by: Xuanyu Zhang, et al.
Published: (2023-02-01)

Low-Power Audio Keyword Spotting Using Tsetlin Machines
by: Jie Lei, et al.
Published: (2021-04-01)

From explainable to interpretable deep learning for natural language processing in healthcare: How far from reality?
by: Guangming Huang, et al.
Published: (2024-12-01)

Habitat use, preference, and utilization distribution of two crane species (Genus: Grus) in Huize National Nature Reserve, Yunnan–Guizhou Plateau, China
by: Dejun Kong, et al.
Published: (2018-07-01)

Memory-Based Deep Neural Attention (mDNA) for Cognitive Multi-Turn Response Retrieval in Task-Oriented Chatbots
by: Jenhui Chen, et al.
Published: (2020-08-01)

Exploring Evaluation Methods for Interpretable Machine Learning: A Survey
by: Nourah Alangari, et al.
Published: (2023-08-01)

A Lite Romanian BERT: ALR-BERT
by: Dragoş Constantin Nicolae, et al.
Published: (2022-04-01)

Integrating Explanations into CNNs by Adopting Spiking Attention Block for Skin Cancer Detection
by: Inzamam Mashood Nasir, et al.
Published: (2024-12-01)

Long-term monitoring data reveal effects of age, population density, and environmental aspects on hatching success of Common Cranes (Grus grus)
by: Isabel Barwisch, et al.
Published: (2022-01-01)

An Empirical Comparison of Interpretable Models to Post-Hoc Explanations
by: Parisa Mahya, et al.
Published: (2023-05-01)

Comparative analysis of the gut bacteria and fungi in migratory demoiselle cranes (Grus virgo) and common cranes (Grus grus) in the Yellow River Wetland, China
by: Ziteng Li, et al.
Published: (2024-03-01)

Attention Map-Guided Visual Explanations for Deep Neural Networks
by: Junkang An, et al.
Published: (2022-04-01)

Interpreting Arabic Transformer Models: A Study on XAI Interpretability for Quranic Semantic Search Models
by: Ahmad M. Mustafa, et al.
Published: (2024-04-01)

Diet Drives Gut Bacterial Diversity of Wild and Semi-Captive Common Cranes (<i>Grus grus</i>)
by: Hong Wu, et al.
Published: (2024-05-01)

Unboxing the Black Box of Attention Mechanisms in Remote Sensing Big Data Using XAI
by: Erfan Hasanpour Zaryabi, et al.
Published: (2022-12-01)

Explanations for Neural Networks by Neural Networks
by: Sascha Marton, et al.
Published: (2022-01-01)

A Framework for Interpretability in Machine Learning for Medical Imaging
by: Alan Q. Wang, et al.
Published: (2024-01-01)

Making Sense of Machine Learning: A Review of Interpretation Techniques and Their Applications
by: Ainura Tursunalieva, et al.
Published: (2024-01-01)

Beyond Importance Scores: Interpreting Tabular ML by Visualizing Feature Semantics
by: Amirata Ghorbani, et al.
Published: (2021-12-01)

Interpretable molecular encodings and representations for machine learning tasks
by: Moritz Weckbecker, et al.
Published: (2024-12-01)

T-TAME: Trainable Attention Mechanism for Explaining Convolutional Networks and Vision Transformers
by: Mariano V. Ntrougkas, et al.
Published: (2024-01-01)

Explainable AI: A Review of Machine Learning Interpretability Methods
by: Pantelis Linardatos, et al.
Published: (2020-12-01)

Providing Post-Hoc Explanation for Node Representation Learning Models Through Inductive Conformal Predictions
by: Hogun Park
Published: (2023-01-01)

Benchmarking the influence of pre-training on explanation performance in MR image classification
by: Marta Oliveira, et al.
Published: (2024-02-01)

Strong call to safeguard traditional agriculture as habitat for threatened crane species
by: Karoline Hemminger, et al.
Published: (2023-06-01)

Explaining the solutions of the unit commitment with interpretable machine learning
by: Sara Lumbreras, et al.
Published: (2024-09-01)

Specific-Input LIME Explanations for Tabular Data Based on Deep Learning Models
by: Junkang An, et al.
Published: (2023-07-01)

Distributional Prototypical Methods for Reliable Explanation Space Construction
by: Hyungjun Joo, et al.
Published: (2023-01-01)

Explainability and Interpretability in Electric Load Forecasting Using Machine Learning Techniques – A Review
by: Lukas Baur, et al.
Published: (2024-05-01)

Opening the Black-Box: Extracting Medical Reasoning from Machine Learning Predictions
by: Marius FERSIGAN, et al.
Published: (2021-09-01)

Towards interpreting machine learning models for predicting soil moisture droughts
by: Feini Huang, et al.
Published: (2023-01-01)

Effects of Class Imbalance Countermeasures on Interpretability
by: David Cemernek, et al.
Published: (2024-01-01)

Intrinsically Interpretable Gaussian Mixture Model
by: Nourah Alangari, et al.
Published: (2023-03-01)

Recursive Visual Explanations Mediation Scheme Based on DropAttention Model With Multiple Episodes Pool
by: Minsu Jeon, et al.
Published: (2023-01-01)

Illuminating the Neural Landscape of Pilot Mental States: A Convolutional Neural Network Approach with Shapley Additive Explanations Interpretability
by: Ibrahim Alreshidi, et al.
Published: (2023-11-01)

Exact Shapley values for local and model-true explanations of decision tree ensembles
by: Thomas W. Campbell, et al.
Published: (2022-09-01)

Deterministic Local Interpretable Model-Agnostic Explanations for Stable Explainability
by: Muhammad Rehman Zafar, et al.
Published: (2021-06-01)

Toward Practical Usage of the Attention Mechanism as a Tool for Interpretability
by: Martin Tutek, et al.
Published: (2022-01-01)

RB_BG_MHA: A RoBERTa-Based Model with Bi-GRU and Multi-Head Attention for Chinese Offensive Language Detection in Social Media
by: Meijia Xu, et al.
Published: (2023-10-01)

Actionable Explainable AI (AxAI): A Practical Example with Aggregation Functions for Adaptive Classification and Textual Explanations for Interpretable Machine Learning
by: Anna Saranti, et al.
Published: (2022-10-01)