Ashvin Shah (2012)
Psychological and Neuroscientific Connections With Reinforcement Learning
In: Reinforcement Learning: State of the Art, ed. by Marco Wiering and Martijn van Otterlo, chap. 16, pp. 507-537, Springer Verlag, Berlin Heidelberg, Book Chapter.
The field of Reinforcement Learning (RL) was inspired in large part by research in
animal behavior and psychology. Early research showed that animals can, through trial
and error, learn to execute behavior that would eventually lead to some (presumably
satisfactory) outcome, and decades of subsequent research was (and is still) aimed at discovering
the mechanisms of this learning process. This chapter describes behavioral and
theoretical research in animal learning that is directly related to fundamental concepts
used in RL. It then describes neuroscientific research that suggests that animals and
many RL algorithms use very similar learning mechanisms. Along the way, I highlight
ways that research in computer science contributes to and can be inspired by research
in psychology and neuroscience.
Animals, Brain, Dopamine, Exploratory Behavior, Humans, Models, NeuralPathways,Neurological, Reaction Time, Reinforcement (Psychology),Reward, SynapticTransmission, 17115078


