Reinforcement Learning with Stepwise Fairness Constraints

11/08/2022
by   Zhun Deng, et al.
4

AI methods are used in societally important settings, ranging from credit to employment to housing, and it is crucial to provide fairness in regard to algorithmic decision making. Moreover, many settings are dynamic, with populations responding to sequential decision policies. We introduce the study of reinforcement learning (RL) with stepwise fairness constraints, requiring group fairness at each time step. Our focus is on tabular episodic RL, and we provide learning algorithms with strong theoretical guarantees in regard to policy optimality and fairness violation. Our framework provides useful tools to study the impact of fairness constraints in sequential settings and brings up new challenges in RL.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/20/2022

Survey on Fair Reinforcement Learning: Theory and Practice

Fairness-aware learning aims at satisfying various fairness constraints ...
research
04/30/2023

Joint Learning of Policy with Unknown Temporal Constraints for Safe Reinforcement Learning

In many real-world applications, safety constraints for reinforcement le...
research
10/26/2020

Interpretable Assessment of Fairness During Model Evaluation

For companies developing products or algorithms, it is important to unde...
research
09/29/2021

Understanding Relations Between Perception of Fairness and Trust in Algorithmic Decision Making

Algorithmic processes are increasingly employed to perform managerial de...
research
06/21/2020

On Optimism in Model-Based Reinforcement Learning

The principle of optimism in the face of uncertainty is prevalent throug...
research
07/13/2022

Hindsight Learning for MDPs with Exogenous Inputs

We develop a reinforcement learning (RL) framework for applications that...
research
03/21/2019

A Simulation Based Dynamic Evaluation Framework for System-wide Algorithmic Fairness

We propose the use of Agent Based Models (ABMs) inside a reinforcement l...

Please sign up or login with your details

Forgot password? Click here to reset