SULFR: Simulation of Urban Logistic For Reinforcement

Guillaume Bono (1, 2) , Jilles Dibangoye (1) , Laëtitia Matignon (1, 3) , Florian Pereyron (4) , Olivier Simonin (1)

1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
2 CITI - CITI Centre of Innovation in Telecommunications and Integration of services
3 SyCoSMA - Systèmes Cognitifs et Systèmes Multi-Agents
4 Volvo Group

In urban logistics, various sources of uncertainty can invalidate pre-planned routes. In this context, a routing strategy that uses available information from the environment could help improve the overall performance of the routing process by dynamically choosing the next client at the online execution time. While static and deterministic testbeds for vehicle routing exist, their stochastic and dynamic counterparts are still missing. This paper proposes an interface to the microtraffic simulation package SUMO that implement a generative model of stochastic and dynamic vehicle routing problems. We formalize the latter using a reinforcement learning framework for semi-Markov decision processes. The resulting testbeds make it possible to compare single- and multi-agent reinforcement learning algorithms in customizable routing environments. We report our preliminary tests to evaluate a hand-crafted policy on some basic scenarios.

Domaines: Intelligence artificielle [cs.AI]; Modélisation et simulation; Apprentissage [cs.LG]; Système multi-agents [cs.MA]

Guillaume Bono, Jilles Dibangoye, Laëtitia Matignon, Florian Pereyron, Olivier Simonin. SULFR: Simulation of Urban Logistic For Reinforcement. Workshop Prediction and Generative Modeling in Reinforcement Learning, Jul 2018, Stockholm, Sweden. pp.1-5. ⟨hal-01847773v1⟩