Deviation from the matching law reflects an optimal strategy involving learning over multiple timescales

Kiyohito Iigaya*, Yashar Ahmadian, Leo P. Sugrue, Greg S. Corrado, Yonatan Loewenstein, William T. Newsome, Stefano Fusi

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

24 Scopus citations

Abstract

Behavior deviating from our normative expectations often appears irrational. For example, even though behavior following the so-called matching law can maximize reward in a stationary foraging task, actual behavior commonly deviates from matching. Such behavioral deviations are interpreted as a failure of the subject; however, here we instead suggest that they reflect an adaptive strategy, suitable for uncertain, non-stationary environments. To prove it, we analyzed the behavior of primates that perform a dynamic foraging task. In such nonstationary environment, learning on both fast and slow timescales is beneficial: fast learning allows the animal to react to sudden changes, at the price of large fluctuations (variance) in the estimates of task relevant variables. Slow learning reduces the fluctuations but costs a bias that causes systematic behavioral deviations. Our behavioral analysis shows that the animals solved this bias-variance tradeoff by combining learning on both fast and slow timescales, suggesting that learning on multiple timescales can be a biologically plausible mechanism for optimizing decisions under uncertainty.

Original languageAmerican English
Article number1466
JournalNature Communications
Volume10
Issue number1
DOIs
StatePublished - 1 Dec 2019

Bibliographical note

Publisher Copyright:
© 2019, The Author(s).

Fingerprint

Dive into the research topics of 'Deviation from the matching law reflects an optimal strategy involving learning over multiple timescales'. Together they form a unique fingerprint.

Cite this