A Methodology for Player Modeling based on Machine Learning

by   Marlos C. Machado, et al.

AI is gradually receiving more attention as a fundamental feature to increase the immersion in digital games. Among the several AI approaches, player modeling is becoming an important one. The main idea is to understand and model the player characteristics and behaviors in order to develop a better AI. In this work, we discuss several aspects of this new field. We proposed a taxonomy to organize the area, discussing several facets of this topic, ranging from implementation decisions up to what a model attempts to describe. We then classify, in our taxonomy, some of the most important works in this field. We also presented a generic approach to deal with player modeling using ML, and we instantiated this approach to model players' preferences in the game Civilization IV. The instantiation of this approach has several steps. We first discuss a generic representation, regardless of what is being modeled, and evaluate it performing experiments with the strategy game Civilization IV. Continuing the instantiation of the proposed approach we evaluated the applicability of using game score information to distinguish different preferences. We presented a characterization of virtual agents in the game, comparing their behavior with their stated preferences. Once we have characterized these agents, we were able to observe that different preferences generate different behaviors, measured by several game indicators. We then tackled the preference modeling problem as a binary classification task, with a supervised learning approach. We compared four different methods, based on different paradigms (SVM, AdaBoost, NaiveBayes and JRip), evaluating them on a set of matches played by different virtual agents. We conclude our work using the learned models to infer human players' preferences. Using some of the evaluated classifiers we obtained accuracies over 60 preferences.


Setting Players' Behaviors in World of Warcraft through Semi-Supervised Learning

Digital games are one of the major and most important fields on the ente...

Modeling Individual Differences in Game Behavior using HMM

Player modeling is an important concept that has gained much attention i...

Can we infer player behavior tendencies from a player's decision-making data? Integrating Theory of Mind to Player Modeling

Game AI systems need the theory of mind, which is the humanistic ability...

Boolean Hedonic Games

We study hedonic games with dichotomous preferences. Hedonic games are c...

Mimicking Playstyle by Adapting Parameterized Behavior Trees in RTS Games

The discovery of Behavior Trees (BTs) impacted the field of Artificial I...

Identifying Playerś Strategies in No Limit Texas Holdém Poker through the Analysis of Individual Moves

The development of competitive artificial Poker playing agents has prove...

A Comparison of Contextual and Non-Contextual Preference Ranking for Set Addition Problems

In this paper, we study the problem of evaluating the addition of elemen...

Please sign up or login with your details

Forgot password? Click here to reset