Playing the Werewolf game with artificial intelligence for language understanding

by   Hisaichi Shibata, et al.

The Werewolf game is a social deduction game based on free natural language communication, in which players try to deceive others in order to survive. An important feature of this game is that a large portion of the conversations are false information, and the behavior of artificial intelligence (AI) in such a situation has not been widely investigated. The purpose of this study is to develop an AI agent that can play Werewolf through natural language conversations. First, we collected game logs from 15 human players. Next, we fine-tuned a Transformer-based pretrained language model to construct a value network that can predict a posterior probability of winning a game at any given phase of the game and given a candidate for the next action. We then developed an AI agent that can interact with humans and choose the best voting target on the basis of its probability from the value network. Lastly, we evaluated the performance of the agent by having it actually play the game with human players. We found that our AI agent, Deep Wolf, could play Werewolf as competitively as average human players in a villager or a betrayer role, whereas Deep Wolf was inferior to human players in a werewolf or a seer role. These results suggest that current language models have the capability to suspect what others are saying, tell a lie, or detect lies in conversations.


page 1

page 2

page 3

page 4


Measuring an artificial intelligence agent's trust in humans using machine incentives

Scientists and philosophers have debated whether humans can trust advanc...

Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Models

Are current language models capable of deception and lie detection? We s...

Reverse-Engineering Satire, or "Paper on Computational Humor Accepted Despite Making Serious Advances"

Humor is an essential human trait. Efforts to understand humor have call...

CALYPSO: LLMs as Dungeon Masters' Assistants

The role of a Dungeon Master, or DM, in the game Dungeons Dragons is...

Hacking with God: a Common Programming Language of Robopsychology and Robophilosophy

This note is a sketch of how the concept of robopsychology and robophilo...

Deep Artificial Intelligence for Fantasy Football Language Understanding

Fantasy sports allow fans to manage a team of their favorite athletes an...

Pair Programming with Large Language Models for Sampling and Estimation of Copulas

Without writing a single line of code by a human, an example Monte Carlo...

Please sign up or login with your details

Forgot password? Click here to reset