Experimental predictions drawn from a computational model of sign-trackers and goal-trackers

Florian Lesaint (1) , Olivier Sigaud (1, 2) , Jeremy J. Clark (3) , Shelly B. Flagel (4, 5, 6) , Mehdi Khamassi (1, 2)

1 ISIR - Institut des Systèmes Intelligents et de Robotique
2 AMAC
3 Department of Psychiatry and Behavioral Sciences, University of Washington
4 Department of Psychology
5 Department of Psychiatry
6 MBNI - Molecular and Behavioral Neuroscience Institute

Gaining a better understanding of the biological mechanisms underlying the individual variation observed in response to rewards and reward cues could help to identify and treat individuals more prone to disorders of impulsive control, such as addiction. Variation in response to reward cues is captured in rats undergoing autoshaping experiments where the appearance of a lever precedes food delivery. Although no response is required for food to be delivered, some rats (goal-trackers) learn to approach and avidly engage the magazine until food delivery, whereas other rats (sign-trackers) come to approach and engage avidly the lever. The impulsive and often maladaptive characteristics of the latter response are reminiscent of addictive behaviour in humans, In a previous article, we developed a computational model accounting for a set of experimental data regarding sign-trackers and goal-trackers. Here we show new simulations of the model to draw experimental predictions that could help further validate or refute the model. In particular, we apply the model to new experimental protocols such as injecting flupentixol locally into the core of the nucleus accumbens rather than systemically, and lesioning of the core of the nucleus accumbens before or after conditioning. In addition, we discuss the possibility of removing the food magazine during the inter-trial interval. The predictions from this revised model will help us better understand the role of different brain regions in the behaviours expressed by sign-trackers and goal-trackers.

Mots clés: Model-free; Model-based; Autoshaping; Goal-tracker; Factored representation; Sign-tracker; Reinforcement Learning; Dopamine; Pavlovian conditioning; Conditioned approach

Domaines: Neurosciences [q-bio.NC]

Florian Lesaint, Olivier Sigaud, Jeremy J. Clark, Shelly B. Flagel, Mehdi Khamassi. Experimental predictions drawn from a computational model of sign-trackers and goal-trackers. Journal of Physiology - Paris, 2015, 109 (1-3), pp.78-86. ⟨10.1016/j.jphysparis.2014.06.001⟩. ⟨hal-01219979⟩