Melting Pot 2.0

by   John P. Agapiou, et al.

Multi-agent artificial intelligence research promises a path to develop intelligent technologies that are more human-like and more human-compatible than those produced by "solipsistic" approaches, which do not consider interactions between agents. Melting Pot is a research tool developed to facilitate work on multi-agent artificial intelligence, and provides an evaluation protocol that measures generalization to novel social partners in a set of canonical test scenarios. Each scenario pairs a physical environment (a "substrate") with a reference set of co-players (a "background population"), to create a social situation with substantial interdependence between the individuals involved. For instance, some scenarios were inspired by institutional-economics-based accounts of natural resource management and public-good-provision dilemmas. Others were inspired by considerations from evolutionary biology, game theory, and artificial life. Melting Pot aims to cover a maximally diverse set of interdependencies and incentives. It includes the commonly-studied extreme cases of perfectly-competitive (zero-sum) motivations and perfectly-cooperative (shared-reward) motivations, but does not stop with them. As in real-life, a clear majority of scenarios in Melting Pot have mixed incentives. They are neither purely competitive nor purely cooperative and thus demand successful agents be able to navigate the resulting ambiguity. Here we describe Melting Pot 2.0, which revises and expands on Melting Pot. We also introduce support for scenarios with asymmetric roles, and explain how to integrate them into the evaluation protocol. This report also contains: (1) details of all substrates and scenarios; (2) a complete description of all baseline algorithms and results. Our intention is for it to serve as a reference for researchers using Melting Pot 2.0.


page 7

page 42


Pommerman: A Multi-Agent Playground

We present Pommerman, a multi-agent environment based on the classic con...

Cooperative Multi-Agent Planning: A Survey

Cooperative multi-agent planning (MAP) is a relatively recent research f...

Improving Multi-Agent Cooperation using Theory of Mind

Recent advances in Artificial Intelligence have produced agents that can...

Artificial Intelligence and Dual Contract

With the dramatic progress of artificial intelligence algorithms in rece...

Overview: Generalizations of Multi-Agent Path Finding to Real-World Scenarios

Multi-agent path finding (MAPF) is well-studied in artificial intelligen...

Definition and properties to assess multi-agent environments as social intelligence tests

Social intelligence in natural and artificial systems is usually measure...

Please sign up or login with your details

Forgot password? Click here to reset