Skip to Main content Skip to Navigation
New interface
Journal articles

Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network

Abstract : This paper proposes a learning policy to improve the energy efficiency (EE) of heterogeneous cellular networks. The combination of active and inactive base stations (BS) that allows for maximizing EE is identified as a combinatorial learning problem and requires high computational complexity as well as a large signaling overhead. This paper aims at presenting a learning policy that dynamically switches a BS to ON or OFF status in order to follow the traffic load variation during the day. The network traffic load is represented as a Markov decision process, and we propose a modified upper confidence bound algorithm based on restless Markov multi-armed bandit framework for the BS switching operation. Moreover, to cope with initial reward loss and to speed up the convergence of the learning algorithm, the transfer learning concept is adapted to our algorithm in order to benefit from the transferred knowledge observed in historical periods from the same region. Moreover, based on our previous work, a convergence theorem is provided for the proposed policy. Extensive simulations demonstrate that the proposed algorithms follow the traffic load variation during the day and contribute to a performance jump-start in EE improvement under various practical traffic load profile. It also demonstrates that proposed schemes can significantly reduce the total energy consumption of cellular network, e.g. up to 70% potential energy savings based on a real traffic profile.
Complete list of metadata

Cited literature [47 references]  Display  Hide  Download
Contributor : Philippe Mary Connect in order to contact the contributor
Submitted on : Monday, October 7, 2019 - 11:22:52 AM
Last modification on : Wednesday, April 27, 2022 - 3:58:36 AM


Files produced by the author(s)



Navikkumar Modi, Philippe Mary, Christophe Moy. Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network. EURASIP Journal on Advances in Signal Processing, 2019, 46 (1), ⟨10.1186/s13634-019-0637-1⟩. ⟨hal-02307007⟩



Record views


Files downloads