Potential and pitfalls of multi-armed bandits for decentralized spatial reuse in WLANs
Mostra el registre complet Registre parcial de l'ítem
- dc.contributor.author Wilhelmi Roca, Francesc
- dc.contributor.author Barrachina Muñoz, Sergio
- dc.contributor.author Bellalta, Boris
- dc.contributor.author Cano Bastidas, Cristina
- dc.contributor.author Jonsson, Anders, 1973-
- dc.contributor.author Neu, Gergely
- dc.date.accessioned 2019-07-30T08:18:39Z
- dc.date.available 2019-07-30T08:18:39Z
- dc.date.issued 2019
- dc.description.abstract Spatial Reuse (SR) has recently gained attention to maximize the performance of IEEE 802.11 Wireless Local Area Networks (WLANs). Decentralized mechanisms are expected to be key in the development of SR solutions for next-generation WLANs, since many deployments are characterized by being uncoordinated by nature. However, the potential of decentralized mechanisms is limited by the significant lack of knowledge with respect to the overall wireless environment. To shed some light on this subject, we show the main considerations and possibilities of applying online learning to address the SR problem in uncoordinated WLANs. In particular, we provide a solution based on Multi-Armed Bandits (MABs) whereby independent WLANs dynamically adjust their frequency channel, transmit power and sensitivity threshold. To that purpose, we provide two different strategies, which refer to selfish and environment-aware learning. While the former stands for pure individual behavior, the second one considers the performance experienced by surrounding networks, thus taking into account the impact of individual actions on the environment. Through these two strategies we delve into practical issues of applying MABs in wireless networks, such as convergence guarantees or adversarial effects. Our simulation results illustrate the potential of the proposed solutions for enabling SR in future WLANs. We show that substantial improvements on network performance can be achieved regarding throughput and fairness.
- dc.description.sponsorship This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the Catalan Government SGR grant for research support (2017-SGR-1188), by the European Regional Development Fund under grant TEC2015-71303-R (MINECO/FEDER), and by a Gift from the Cisco University Research Program (CG#890107, Towards Deterministic Channel Access in High-Density WLANs) Fund, a corporate advised fund of Silicon Valley Community Foundation.
- dc.format.mimetype application/pdf
- dc.identifier.citation Wilhelmi F, Barrachina-Muñoz S, Bellalta B, Cano C, Jonsson A, Neu G. Potential and pitfalls of multi-armed bandits for decentralized spatial reuse in WLANs. Journal of Network and Computer Applications. 2019;127:26-42. DOI: 10.1016/j.jnca.2018.11.006
- dc.identifier.doi http://dx.doi.org/10.1016/j.jnca.2018.11.006
- dc.identifier.issn 1084-8045
- dc.identifier.uri http://hdl.handle.net/10230/42206
- dc.language.iso eng
- dc.publisher Elsevier
- dc.relation.ispartof Journal of Network and Computer Applications. 2019;127:26-42.
- dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/TEC2015-71303-R
- dc.rights © Elsevier http://dx.doi.org/10.1016/j.jnca.2018.11.006
- dc.rights.accessRights info:eu-repo/semantics/openAccess
- dc.subject.keyword Spatial Reuse
- dc.subject.keyword IEEE 802.11 WLANs
- dc.subject.keyword Reinforcement Learning
- dc.subject.keyword Multi-Armed Bandits
- dc.subject.keyword Decentralized learning
- dc.title Potential and pitfalls of multi-armed bandits for decentralized spatial reuse in WLANs
- dc.type info:eu-repo/semantics/article
- dc.type.version info:eu-repo/semantics/acceptedVersion