Skip to Main content Skip to Navigation
Conference papers

Introducing strategic measure actions in multi-armed bandits

Abstract : Multi-armed bandits may be used for modelling the process of selecting one among different wireless networks, given a set of system constraints typically formed by user-perceived network quality indicators. This work proposes a novel multi-armed bandit, that is made appropriate to the above context by introducing a distinction between two actions, to measure and to use, in order to better reflect real communication application scenarios. The impact of this introduction is analysed through simulations by comparing a traditional multi-armed bandit algorithm against methods that integrate the new concept of measuring vs. using. Results show that performance in terms of regret can be significantly improved using the proposed algorithms if the period needed for measuring is at least 3 times shorter than the one for the using action. The classical method would require a significantly shorter measuring period to reach the same regret, i.e. much stricter constraints on the allowed measure action duration.
Document type :
Conference papers
Complete list of metadatas
Contributor : Jocelyn Fiorina <>
Submitted on : Friday, June 15, 2018 - 10:21:42 PM
Last modification on : Monday, December 14, 2020 - 12:38:07 PM

Links full text




Stefano Boldrini, Jocelyn Fiorina, Maria-Gabriella Di Benedetto. Introducing strategic measure actions in multi-armed bandits. 2013 IEEE 24th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC Workshops) , Sep 2013, London, United Kingdom. ⟨10.1109/PIMRCW.2013.6707833⟩. ⟨hal-01816970⟩



Record views