Dissociable roles of ventral pallidum neurons in the basal ganglia reinforcement learning network

Alexander Kaplan*, Aviv D. Mizrahi-Kliger, Zvi Israel, Avital Adler, Hagai Bergman

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

16 Scopus citations

Abstract

Reinforcement learning models treat the basal ganglia (BG) as an actor–critic network. The ventral pallidum (VP) is a major component of the BG limbic system. However, its precise functional roles within the BG circuitry, particularly in comparison to the adjacent external segment of the globus pallidus (GPe), remain unexplored. We recorded the spiking activity of VP neurons, GPe cells (actor) and striatal cholinergic interneurons (critic) while monkeys performed a classical conditioning task. Here, we report that VP neurons can be classified into two distinct populations. The persistent population displayed sustained activation following visual cue presentation, was correlated with monkeys’ behavior and showed uncorrelated spiking activity. The transient population displayed phasic synchronized responses that were correlated with the rate of learning and the reinforcement learning model’s prediction error. Our results suggest that the VP is physiologically different from the GPe and identify the transient VP neurons as a BG critic.

Original languageAmerican English
Pages (from-to)556-564
Number of pages9
JournalNature Neuroscience
Volume23
Issue number4
DOIs
StatePublished - 1 Apr 2020

Bibliographical note

Funding Information:
We thank Y. Dagan and T. Ravins-Yaish for assistance with animal care; A. Bick and A. Payis for assistance with the MRI scan; and H. Gabbay, S. Freeman, U. Werner-Reiss and E. Singer for general assistance. We thank A. Shapochnikov for help in preparing the experimental setup. We also thank M. Deffains for helpful comments and discussion. This work was supported by grants from the European Research Council (grant 322495) and the Rosetrees Trust (grant M93-F1) to H.B.

Publisher Copyright:
© 2020, The Author(s), under exclusive licence to Springer Nature America, Inc.

Fingerprint

Dive into the research topics of 'Dissociable roles of ventral pallidum neurons in the basal ganglia reinforcement learning network'. Together they form a unique fingerprint.

Cite this