This book lays out the theoretical foundation of the so-called multi-armed bandit (MAB) problems and puts it in the context of resource management in wireless networks. Part I of the book presents the formulations, algorithms and performance of three forms of MAB problems, namely, stochastic, Markov and adversarial. Covering all three forms of MAB problems makes this book unique in the field. Part II of the book provides detailed discussions of representative applications of the sequential learning framework in cognitive radio networks, wireless LANs and wireless mesh networks.
Both individuals in industry and those in the wireless research community will benefit from this comprehensive and timely treatment of these topics. Advanced-level students studying communications engineering and networks will also find the content valuable and accessible.

Emphasizes intuition rather than laborious proofs Provides a recipe for applying theoretical tools to real-world problems Treats both theoretical and practical aspects of the sequential learning and decision making framework Covers many representative applications in wireless networks Includes supplementary material: sn.pub/extras

Inhalt
Introduction.- Stochastic Multi-armed Bandit.- Markov Multi-armed Bandit.- Adversarial Multi-armed Bandit.- Spectrum Sensing and Access in Cognitive Radio Networks.- Sniffer Channel Assignment in Multi-channel Wireless Networks.- Online Routing in Multi-hop Wireless Networks.- Channel Selection and User Association in WiFi Networks.