Skip to Main content Skip to Navigation
Conference papers

Learning-based control for a communicating mobile robot under unknown rates

Abstract : In problems such as surveying or monitoring remote regions, a mobile robot must transmit data over a wireless network with unknown, position-dependent transmission rates. We propose an algorithm to achieve this objective that learns approximations of the rate function and of an optimal-control solution that transmits the data in minimum time. The rates are estimated with supervised learning from the samples observed; and the control is found with dynamic programming sweeps around the current state of the robot that exploit the rate function estimate, combined with online reinforcement learning. For both synthetic and realistic rate functions, our experiments show that the learning algorithm empties the data buffer in less than twice the number of steps achieved by a model-based solution that requires to perfectly know the rate function.
Complete list of metadata

Cited literature [19 references]  Display  Hide  Download
Contributor : Vineeth Satheeskumar Varma <>
Submitted on : Friday, August 23, 2019 - 3:10:57 PM
Last modification on : Saturday, May 1, 2021 - 3:51:22 AM
Long-term archiving on: : Saturday, January 11, 2020 - 2:16:16 AM


Files produced by the author(s)


  • HAL Id : hal-02269995, version 1


Lucian Busoniu, Vineeth Varma, Irinel-Constantin Morarescu, Samson Lasaulce. Learning-based control for a communicating mobile robot under unknown rates. American Control Conference, ACC 2019, Jul 2019, Philadelphia, PA, United States. ⟨hal-02269995⟩



Record views


Files downloads