Skip to Main content Skip to Navigation
Conference papers

Using Reinforcement Learning to Attenuate for Stochasticity in Robot Navigation Controllers

Abstract : Braitenberg vehicles are bio-inspired controllers for sensor-based local navigation of wheeled robots that have been used in multiple real world robotic implementations. The common approach to implement such non-linear control mechanisms is through neural networks connecting sensing to motor action, yet tuning the weights to obtain appropriate closed-loop navigation behaviours can be very challenging. Standard approaches used hand tuned spiking or recurrent neural networks, or learnt the weights of feedforward networks using evolutionary approaches. Recently, Reinforcement Learning has been used to learn neural controllers for simulated Braitenberg vehicle 3a-a bio-inspired model of target seeking for wheeled robots-under the assumption of noiseless sensors. Real sensors, however, are subject to different levels of noise, and multiple works have shown that Braitenberg vehicles work even on outdoor robots, demonstrating that these control mechanisms work in harsh and dynamic environments. This paper shows that a robust neural controller for Braitenberg vehicle 3a can be learnt using policy gradient reinforcement learning in scenarios where sensor noise plays a non negligible role. The learnt controller is robust and tries to attenuate the effects of noise in the closed-loop navigation behaviour of the simulated stochastic vehicle. We compare the neural controller learnt using Reinforcement Learning with a simple hand tuned controller and show how the neural control mechanism outperforms a naïve controller. Results are illustrated through computer simulations of the closed-loop stochastic system.
Document type :
Conference papers
Complete list of metadata

Cited literature [25 references]  Display  Hide  Download
Contributor : Mehdi Khamassi <>
Submitted on : Monday, October 21, 2019 - 7:16:56 PM
Last modification on : Wednesday, May 19, 2021 - 11:58:12 AM
Long-term archiving on: : Wednesday, January 22, 2020 - 9:05:58 PM


Files produced by the author(s)



James Gillespie, Iñaki Rañó, Nazmul Siddique, Jose Santos, Mehdi Khamassi. Using Reinforcement Learning to Attenuate for Stochasticity in Robot Navigation Controllers. 2019 IEEE Symposium Series on Computational Intelligence (SSCI 2019), Dec 2019, Xiamen, China. ⟨10.1109/SSCI44817.2019.9002834⟩. ⟨hal-02324129⟩



Record views


Files downloads