V. Fiore, F. Mannella, M. Mirolli, K. Gurney, and G. Baldassarre
Instrumental conditioning driven by neutral stimuli: A model tested with a simulated robotic rat
In: Proceedings of the Eight International Conference on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, ed. by Schlesinger, M. and Berthouze, L. and Balkenius, C., vol. 139, pp. 13-20, Lund, University of Lund.
Current models of reinforcement learning are based on the assumption that learning must be guided by rewarding (unconditioned) stimuli. On the other hand, there is empirical evidence that dopamine bursts, which are commonly considered as the reinforcement learning signals, can also be triggered by apparently neutral stimuli, and that this canlead to conditioning phenomena in absence of any rewarding stimuli. In this paper we present a computational model, based on an hypothesis proposed in Redgrave and Gurney (2006), in which dopamine release is directly triggered by the superior colliculus (a dorsal midbrain structure) when it detects novel visual stimuli and this supports instrumental conditioning similarly to that usually ascribed to rewarding stimuli. The model incorporates various biological constraints, for example the anatomical and physiological data related to the micro-architecture of the superior colliculus presented in Binns and Salt (1997). The model is validated by reproducing with a simulated robotic rat the results of an experiment with real rats on the role of intrinsically reinforcing properties of apparently neutral stimuli reported in Reed et al. (1996).
Relevant for: WP5 intrinsic/extrinsic motivations. Based on the evidence showing that dopamine bursts can also be triggered by apparently neutral stimuli (in absence of any rewarding stimuli), this paper presents a computational model in which dopamine release is directly triggered by the superior colliculus when it detects novel visual stimuli and this supports instrumental conditioning similarly to that usually ascribed to rewarding stimuli.