Potential and Pitfalls of Multi-Armed Bandits for Decentralized Spatial Reuse in WLANs
share
Spatial Reuse (SR) has recently gained attention for performance maximization in IEEE 802.11 Wireless Local Area Networks (WLANs). Decentralized mechanisms are expected to be key in the development of solutions for next-generation WLANs, since many deployments are characterized by being uncoordinated by nature. However, the potential of decentralized mechanisms is limited by the significant lack of knowledge with respect to the overall wireless environment. To shed some light on this subject, we show the main considerations and possibilities of applying online learning in uncoordinated WLANs for the SR problem. In particular, we provide a solution based on Multi-Armed Bandits (MABs) whereby independent WLANs dynamically adjust their frequency channel, transmit power and sensitivity threshold. To that purpose, we provide two different strategies, which refer to selfish and environment-aware learning. While the former stands for pure individual behavior, the second one aims to consider the performance experienced by surrounding nodes, thus taking into account the impact of individual actions on the environment. Through these two strategies, we delve into practical issues for enabling MABs usage in wireless networks, such as convergence ensuring or adversarial effects. In addition, our simulation results illustrate the potential of our proposed solutions for enabling SR in future WLANs, showing that substantial improvements on network performance are achieved regarding throughput and fairness.t
READ FULL TEXT