Explanation-by-Example Based on Item Response Theory

by   Lucas F. F. Cardoso, et al.

Intelligent systems that use Machine Learning classification algorithms are increasingly common in everyday society. However, many systems use black-box models that do not have characteristics that allow for self-explanation of their predictions. This situation leads researchers in the field and society to the following question: How can I trust the prediction of a model I cannot understand? In this sense, XAI emerges as a field of AI that aims to create techniques capable of explaining the decisions of the classifier to the end-user. As a result, several techniques have emerged, such as Explanation-by-Example, which has a few initiatives consolidated by the community currently working with XAI. This research explores the Item Response Theory (IRT) as a tool to explaining the models and measuring the level of reliability of the Explanation-by-Example approach. To this end, four datasets with different levels of complexity were used, and the Random Forest model was used as a hypothesis test. From the test set, 83.8 instances in which the IRT points out the model as unreliable.


page 1

page 2

page 3

page 4


Global Explanation of Tree-Ensembles Models Based on Item Response Theory

Explainable Artificial Intelligence - XAI is aimed at studying and devel...

SurvLIME-Inf: A simplified modification of SurvLIME for explanation of machine learning survival models

A new modification of the explanation method SurvLIME called SurvLIME-In...

A Model Explanation System: Latest Updates and Extensions

We propose a general model explanation system (MES) for "explaining" the...

Declarative Reasoning on Explanations Using Constraint Logic Programming

Explaining opaque Machine Learning (ML) models is an increasingly releva...

Which is the least complex explanation? Abduction and complexity

It may happen that for a certain abductive problem there are several pos...

Saliency Learning: Teaching the Model Where to Pay Attention

Deep learning has emerged as a compelling solution to many NLP tasks wit...

Please sign up or login with your details

Forgot password? Click here to reset