Online behavior change detection in computer games

Player Modelling has been receiving much attention from the game community in the recent years. The ability to build accurate models of player behavior can be useful in many aspects of a game. One important aspect is the tracking of a player’s behavior along time, informing every time a change is perceived. This way, the game Artificial Intelligence can adapt itself to better respond to this new behavior. In order to build models of player behavior, researchers frequently resort to Machine Learning techniques. Such methods work on previously recorded game metrics representing player’s interactions with the game environment. However, if the player changes styles over time, the constructed models get out of date. In order to address this drawback, this work proposes the use of and incremental learning technique to track a player’s behavior during his/her interaction with the game environment. Our approach attempts to automatically detect the moments in time when the player changes behavior. We apply a change detection technique from the area of Data Stream Mining that is based on incremental clustering and novelty detection. We also propose three modifications to the original technique, in order to formalize change detection, improve detection rate and reduce detection delay. Simulations were performed considering data produced by the Unreal Tournament game, showing the applicability of the method to online tracking of a player’s behavior and informing whenever behavior changes occur.