TY - JOUR
T1 - Learning reward timing in cortex through reward dependent expression of synaptic plasticity
AU - Gavornik, Jeffrey P.
AU - Shuler, Marshall G.Hussain
AU - Loewenstein, Yonatan
AU - Bear, Mark F.
AU - Shouval, Harel Z.
PY - 2009/4/21
Y1 - 2009/4/21
N2 - The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.
AB - The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.
KW - Reinforcment learning
KW - Visual cortex
UR - http://www.scopus.com/inward/record.url?scp=66149143188&partnerID=8YFLogxK
U2 - 10.1073/pnas.0901835106
DO - 10.1073/pnas.0901835106
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
C2 - 19346478
AN - SCOPUS:66149143188
SN - 0027-8424
VL - 106
SP - 6826
EP - 6831
JO - Proceedings of the National Academy of Sciences of the United States of America
JF - Proceedings of the National Academy of Sciences of the United States of America
IS - 16
ER -