Skip to Main content Skip to Navigation
Conference papers

Learning-based control for a communicating mobile robot under unknown rates

Abstract : In problems such as surveying or monitoring remote regions, a mobile robot must transmit data over a wireless network with unknown, position-dependent transmission rates. We propose an algorithm to achieve this objective that learns approximations of the rate function and of an optimal-control solution that transmits the data in minimum time. The rates are estimated with supervised learning from the samples observed; and the control is found with dynamic programming sweeps around the current state of the robot that exploit the rate function estimate, combined with online reinforcement learning. For both synthetic and realistic rate functions, our experiments show that the learning algorithm empties the data buffer in less than twice the number of steps achieved by a model-based solution that requires to perfectly know the rate function.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02269995
Contributor : Vineeth Satheeskumar Varma <>
Submitted on : Friday, August 23, 2019 - 3:10:57 PM
Last modification on : Wednesday, September 16, 2020 - 4:50:00 PM
Long-term archiving on: : Saturday, January 11, 2020 - 2:16:16 AM

File

acc19_commrob.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02269995, version 1

Citation

Lucian Busoniu, Vineeth Varma, Irinel-Constantin Morarescu, Samson Lasaulce. Learning-based control for a communicating mobile robot under unknown rates. American Control Conference, ACC 2019, Jul 2019, Philadelphia, PA, United States. ⟨hal-02269995⟩

Share

Metrics

Record views

85

Files downloads

192