Diversity in Sociotechnical Machine Learning Systems

by   Sina Fazelpour, et al.

There has been a surge of recent interest in sociocultural diversity in machine learning (ML) research, with researchers (i) examining the benefits of diversity as an organizational solution for alleviating problems with algorithmic bias, and (ii) proposing measures and methods for implementing diversity as a design desideratum in the construction of predictive algorithms. Currently, however, there is a gap between discussions of measures and benefits of diversity in ML, on the one hand, and the broader research on the underlying concepts of diversity and the precise mechanisms of its functional benefits, on the other. This gap is problematic because diversity is not a monolithic concept. Rather, different concepts of diversity are based on distinct rationales that should inform how we measure diversity in a given context. Similarly, the lack of specificity about the precise mechanisms underpinning diversity's potential benefits can result in uninformative generalities, invalid experimental designs, and illicit interpretations of findings. In this work, we draw on research in philosophy, psychology, and social and organizational sciences to make three contributions: First, we introduce a taxonomy of different diversity concepts from philosophy of science, and explicate the distinct epistemic and political rationales underlying these concepts. Second, we provide an overview of mechanisms by which diversity can benefit group performance. Third, we situate these taxonomies–of concepts and mechanisms–in the lifecycle of sociotechnical ML systems and make a case for their usefulness in fair and accountable ML. We do so by illustrating how they clarify the discourse around diversity in the context of ML systems, promote the formulation of more precise research questions about diversity's impact, and provide conceptual tools to further advance research and practice.


page 1

page 2

page 3

page 4


A Framework for Fairness: A Systematic Review of Existing Fair AI Solutions

In a world of daily emerging scientific inquisition and discovery, the p...

Machine learning in the social and health sciences

The uptake of machine learning (ML) approaches in the social and health ...

Artificial intelligence in government: Concepts, standards, and a unified framework

Recent advances in artificial intelligence (AI) and machine learning (ML...

Towards Algorithmic Transparency: A Diversity Perspective

As the role of algorithmic systems and processes increases in society, s...

ML-Quest: A Game for Introducing Machine Learning Concepts to K-12 Students

Today, Machine Learning (ML) is of a great importance to society due to ...

Diversity and Inclusion Metrics in Subset Selection

The ethical concept of fairness has recently been applied in machine lea...

AI Ethics Statements – Analysis and lessons learnt from NeurIPS Broader Impact Statements

Ethics statements have been proposed as a mechanism to increase transpar...

Please sign up or login with your details

Forgot password? Click here to reset