Skip to Main content Skip to Navigation
Journal articles

Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network

Abstract : This paper proposes a learning policy to improve the energy efficiency (EE) of heterogeneous cellular networks. The combination of active and inactive base stations (BS) that allows for maximizing EE is identified as a combinatorial learning problem and requires high computational complexity as well as a large signaling overhead. This paper aims at presenting a learning policy that dynamically switches a BS to ON or OFF status in order to follow the traffic load variation during the day. The network traffic load is represented as a Markov decision process, and we propose a modified upper confidence bound algorithm based on restless Markov multi-armed bandit framework for the BS switching operation. Moreover, to cope with initial reward loss and to speed up the convergence of the learning algorithm, the transfer learning concept is adapted to our algorithm in order to benefit from the transferred knowledge observed in historical periods from the same region. Moreover, based on our previous work, a convergence theorem is provided for the proposed policy. Extensive simulations demonstrate that the proposed algorithms follow the traffic load variation during the day and contribute to a performance jump-start in EE improvement under various practical traffic load profile. It also demonstrates that proposed schemes can significantly reduce the total energy consumption of cellular network, e.g. up to 70% potential energy savings based on a real traffic profile.
Complete list of metadatas

Cited literature [47 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02307007
Contributor : Philippe Mary <>
Submitted on : Monday, October 7, 2019 - 11:22:52 AM
Last modification on : Wednesday, October 14, 2020 - 3:53:14 AM

File

eurasip_eem_ucb_revision2.pdf
Files produced by the author(s)

Identifiers

Citation

Navikkumar Modi, Philippe Mary, Christophe Moy. Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network. EURASIP Journal on Advances in Signal Processing, SpringerOpen, 2019, 46, ⟨10.1186/s13634-019-0637-1⟩. ⟨hal-02307007⟩

Share

Metrics

Record views

212

Files downloads

158