TY - JOUR
T1 - When to apply the fifth commandment
T2 - The effects of parenting on genetic and learning agents
AU - Berger, Michael
AU - Rosenschein, Jeffrey S.
PY - 2010/9
Y1 - 2010/9
N2 - This article explores hybrid agents that use a variety of techniques to improve their performance in an environment over time. We considered, specifically, genetic-learning-parenting hybrid agents, which used a combination of a genetic algorithm, a learning algorithm (in our case, reinforcement learning), and a parenting algorithm, to modify their activity. We experimentally examined what constitutes the best combination of weights over these three algorithms, as a function of the environment's rate of change. For stationary environments, a genetic-parenting combination proved best, with genetics being given the most weight. For environments with low rates of change, genetic-learning-parenting hybrids were best, with learning having the most weight, and parenting having at least as much weight as genetics. For environments with high rates of change, pure learning agents proved best. A pure parenting algorithm operated extremely poorly in all settings.
AB - This article explores hybrid agents that use a variety of techniques to improve their performance in an environment over time. We considered, specifically, genetic-learning-parenting hybrid agents, which used a combination of a genetic algorithm, a learning algorithm (in our case, reinforcement learning), and a parenting algorithm, to modify their activity. We experimentally examined what constitutes the best combination of weights over these three algorithms, as a function of the environment's rate of change. For stationary environments, a genetic-parenting combination proved best, with genetics being given the most weight. For environments with low rates of change, genetic-learning-parenting hybrids were best, with learning having the most weight, and parenting having at least as much weight as genetics. For environments with high rates of change, pure learning agents proved best. A pure parenting algorithm operated extremely poorly in all settings.
KW - Monte Carlo
KW - Q-learning
KW - genetic algorithms
KW - learning
KW - parenting
UR - http://www.scopus.com/inward/record.url?scp=77954831019&partnerID=8YFLogxK
U2 - 10.1080/09528130902846673
DO - 10.1080/09528130902846673
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:77954831019
SN - 0952-813X
VL - 22
SP - 159
EP - 195
JO - Journal of Experimental and Theoretical Artificial Intelligence
JF - Journal of Experimental and Theoretical Artificial Intelligence
IS - 3
ER -