Study of turn-taking coordination for nagents in game-theoretic scenarios, with reinforcement learning: Proposal of an evaluation framework of Perfect Alternation Equilibria for multi-agent environments
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Papadopoulos, Nikolaos
- dc.date.accessioned 2021-01-26T11:39:23Z
- dc.date.available 2021-01-26T11:39:23Z
- dc.date.issued 2020-07
- dc.description Treball fi de màster de: Master in Cognitive Systems and Interactive Mediaca
- dc.description Directos: Martí Sànchez-Fibla, Ismael Tito Freire Gonzalez
- dc.description.abstract In this thesis, a novel performance evaluation framework is introduced for several dynamic multi-agent interpretations of the Battle of the Exes scenario, which are also proposed for the first time. The Multi-Agent BoE scenario (MBoE) was modeled as a Markov Game and was computationally examined in 7 branches of 2-6 and 2-10 agents’ experiments (43 experiments) for two types of state-representations, two numbers of episodes and various reward systems. New variations of Fairness (Multi-agent Fairness & Reward Fairness) were proposed, with the latter being used to measure the systems’ performance, as literature’s 2-agents metrics were found insufficient for n-agents games. Furthermore, a Perfect Alternation equilibrium was introduced, defined and evaluated, as an ideal equilibrium, robust to the number of agents and episodes of a system. For the purposes of this thesis, it was hypothesized and eventually shown, that a Fair and Efficient equilibrium in multi-agent dynamic environments such as MBoE does not necessarily signify Perfect Alternation. Furthermore, new types of metrics and indicators for measuring and evaluating the performance of a system towards Perfect Alternation were introduced and tested: Rotation (RT, with 2 sub-metrics and 2 forms), Alternation (ALT, 6 versions) and Proportional Individual Performance. ALT metrics definitions were found sufficient for evaluating of Perfect Alternation, thus they was benchmarked and tested through the series of experiments, aspiring to initiate this branch of studies and contribute novel tools for deeper understanding of complexsystems, such as the social behavior of cognitive systems.ca
- dc.format.mimetype application/pdf*
- dc.identifier.uri http://hdl.handle.net/10230/46270
- dc.language.iso engca
- dc.rights This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licenseca
- dc.rights.accessRights info:eu-repo/semantics/openAccessca
- dc.rights.uri http://creativecommons.org/licenses/by-nc-nd/4.0*
- dc.subject.keyword Conventionalization
- dc.subject.keyword Game Theory
- dc.subject.keyword Battle of the Exes
- dc.subject.keyword Battle of the Sexes
- dc.subject.keyword Multi-agent Battle of the Exes
- dc.subject.keyword MBoE
- dc.subject.keyword Repeated Games
- dc.subject.keyword Repeated Games
- dc.subject.keyword Stochastic Games
- dc.subject.keyword Alternation Equilibrium
- dc.subject.keyword n-agents
- dc.subject.keyword Multi-Agent Reinforcement Learning
- dc.subject.keyword Q-learning
- dc.subject.keyword Perfect Alternation Equilibrium
- dc.subject.keyword Perfect Alternation
- dc.subject.keyword Fairness
- dc.subject.keyword Efficiency
- dc.subject.keyword Reward Fairness
- dc.subject.keyword Multi-agent Fairness
- dc.subject.keyword Rotation
- dc.subject.keyword Metric
- dc.subject.keyword Alternation Metric
- dc.subject.keyword ALT
- dc.title Study of turn-taking coordination for nagents in game-theoretic scenarios, with reinforcement learning: Proposal of an evaluation framework of Perfect Alternation Equilibria for multi-agent environmentsca
- dc.type info:eu-repo/semantics/masterThesisca