Learning-based control for a communicating mobile robot under unknown rates

Abstract : In problems such as surveying or monitoring remote regions, a mobile robot must transmit data over a wireless network with unknown, position-dependent transmission rates. We propose an algorithm to achieve this objective that learns approximations of the rate function and of an optimal-control solution that transmits the data in minimum time. The rates are estimated with supervised learning from the samples observed; and the control is found with dynamic programming sweeps around the current state of the robot that exploit the rate function estimate, combined with online reinforcement learning. For both synthetic and realistic rate functions, our experiments show that the learning algorithm empties the data buffer in less than twice the number of steps achieved by a model-based solution that requires to perfectly know the rate function.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

Contributor : Vineeth Satheeskumar Varma <>
Submitted on : Friday, August 23, 2019 - 3:10:57 PM
Last modification on : Monday, September 2, 2019 - 9:26:55 AM


Files produced by the author(s)


  • HAL Id : hal-02269995, version 1


Lucian Buşoniu, Vineeth Varma, Irinel-Constantin Morarescu, Samson Lasaulce. Learning-based control for a communicating mobile robot under unknown rates. American Control Conference, ACC 2019, Jul 2019, Philadelphie, PA, United States. ⟨hal-02269995⟩



Record views


Files downloads