Understanding Relations Between Perception of Fairness and Trust in Algorithmic Decision Making

by   Jianlong Zhou, et al.

Algorithmic processes are increasingly employed to perform managerial decision making, especially after the tremendous success in Artificial Intelligence (AI). This paradigm shift is occurring because these sophisticated AI techniques are guaranteeing the optimality of performance metrics. However, this adoption is currently under scrutiny due to various concerns such as fairness, and how does the fairness of an AI algorithm affects user's trust is much legitimate to pursue. In this regard, we aim to understand the relationship between induced algorithmic fairness and its perception in humans. In particular, we are interested in whether these two are positively correlated and reflect substantive fairness. Furthermore, we also study how does induced algorithmic fairness affects user trust in algorithmic decision making. To understand this, we perform a user study to simulate candidate shortlisting by introduced (manipulating mathematical) fairness in a human resource recruitment setting. Our experimental results demonstrate that different levels of introduced fairness are positively related to human perception of fairness, and simultaneously it is also positively related to user trust in algorithmic decision making. Interestingly, we also found that users are more sensitive to the higher levels of introduced fairness than the lower levels of introduced fairness. Besides, we summarize the theoretical and practical implications of this research with a discussion on perception of fairness.


The FairCeptron: A Framework for Measuring Human Perceptions of Algorithmic Fairness

Measures of algorithmic fairness often do not account for human percepti...

Disparate Impact Diminishes Consumer Trust Even for Advantaged Users

Systems aiming to aid consumers in their decision-making (e.g., by imple...

Legal perspective on possible fairness measures - A legal discussion using the example of hiring decisions (preprint)

With the increasing use of AI in algorithmic decision making (e.g. based...

Algorithmic Fairness

An increasing number of decisions regarding the daily lives of human bei...

What's the Problem, Linda? The Conjunction Fallacy as a Fairness Problem

The field of Artificial Intelligence (AI) is focusing on creating automa...

The Algorithmic Imprint

When algorithmic harms emerge, a reasonable response is to stop using th...

Reinforcement Learning with Stepwise Fairness Constraints

AI methods are used in societally important settings, ranging from credi...

Please sign up or login with your details

Forgot password? Click here to reset