Evolutionary selection of expectations in positive and negative feedback markets
 1.9k Downloads
 11 Citations
Abstract
An economic environment is a feedback system, where the dynamics of aggregate variables depend on individual expectations and vice versa. The type of feedback mechanism is crucial for the aggregate outcome. Experiments with human subjects (Heemeijer et al., J Econ Dyn Control 33:1052–1072, 2009) have shown that price converges to the fundamental level in a negative feedback environment but fails to do so under positive feedback. We present an explanation of these experimental results by means of a model of evolutionary switching between heuristics. Active heuristics are chosen endogenously, on the basis of their past performance. Under negative feedback an adaptive heuristic dominates explaining fast price convergence, whereas under positive feedback a trendfollowing heuristic dominates resulting in persistent price deviations and oscillations.
Keywords
Evolutionary learning Expectations feedback ExperimentsJEL Classification
D03 G12 D84 C91 C921 Introduction
Expectations play a major role in both financial and commodity markets affecting individual decisions and having a large impact on aggregate variables, such as prices. Sometimes the influence of expectations seems larger than that of other, more tangible fundamental factors. Recent literature on Heterogeneous Agent Models shows that when nonfundamental expectations are widespread among market participants they can result in price bubbles, see, e.g., the review in Hommes (2006). Dynamics of heterogeneous, nonfundamental expectations might explain different “stylized facts” of financial markets, above all excess volatility of asset prices (Shiller 1981). For this reason it is important to investigate how individuals form expectations about market variables and what is their aggregate effect. The expectations of the participants in real markets are not easily observable and are also affected by different uncontrolled factors. This makes experiments in a controlled environment particularly attractive for studying expectations (Duffy 2006). The number of experiments on expectations is growing, see, e.g., Hey (1994), Hommes et al. (2005, 2007, 2008), Adam (2007) and Fehr and Tyran (2008), see Hommes (2011) for a recent survey. By and large these experiments reject the dominating in economic theory Rational Expectations hypothesis. The development of an alternative theory of expectation formation thus becomes an important task.
In this paper we contribute to this task by fitting the Heuristics Switching Model (HSM), introduced in Anufriev and Hommes (2009, 2012), to a recent experiment on expectation formation presented in Heemeijer et al. (2009) (HHST, henceforth). This experiment is one of several “learning to forecast” experiments that have been performed in the CREED laboratory of the University of Amsterdam (UvA). Participants of these experiments have a single task to predict next period’s realization of an aggregate variable (price), which depends on the average of all individual predictions. The details of the pricing equation may change in these experiments, see the examples in Hommes et al. (2005, 2007, 2008) and Sonnemans and Tuinstra (2010). These early experiments have already pointed out that the type of feedback between expectations and realization is important. In the “hog cycle” model of a market for an agricultural good with a production lag, when the expectations about next period’s price are high, producers produce a large amount of the good and the realized price is low. This is an example of a negative feedback system. The opposite situation holds in positive feedback systems. For example, if expectations about the future price of a speculative asset are high, the demand for the asset will increase and the realized price will be also high. Experiments in Heemeijer et al. (2009) focus on the role of the feedback type. In a perfectly symmetric setting, where the only difference between two treatments is the sign of the average forecast in the pricing equation, two different qualitative patterns have been observed. In the negative feedback treatments, where higher expectations lead to lower price, the realized market price converges to the fundamental level very quickly and remains there for the rest of the experiment. In contrast, in a positive feedback market, where higher expectations lead to higher price realizations, the price exhibits fluctuations and long lasting deviations from the fundamental level. The purpose of this paper is to demonstrate that a single model of individual expectations can explain these different aggregate outcomes.
Estimation of individual forecasts in HHST reveals that participants of the experiment tended to use simple behavioral rules in their forecasting activity. These rules strongly depended on the feedback type. This paper takes these results as a starting point to fit the data with a heuristic switching model (HSM) which also explains why different rules are chosen under different feedback. This HSM proposed in Anufriev and Hommes (2012) extends the adaptive belief framework of Brock and Hommes (1997). In the HSM agents’ expectations are governed by several behavioral heuristics, e.g., adaptive or trendfollowing rules. Agents switch between heuristics learning to use those heuristics which performed better in the past. The impact of different heuristics on the aggregate price is, therefore, changing over time, explaining different aggregate outcome observed in the experiment. For the negative feedback experiment we find that in the initial periods the adaptive heuristic performs much better than the others. As this heuristic attracts enough participants, the price dynamics exhibit convergence to the fundamental level with small oscillations around it due to small noise. Along this converging time path the adaptive heuristic performs slightly better than the others, supporting this outcome in the long run. In the positive feedback environment the performance of the trendfollowing heuristic is better. When this heuristic is used by a majority of participants, the price deviates from the fundamental value leading to persistent price trends, and confirming the dominating trendfollowing heuristic.
The rest of the paper is organized as follows. In Section 2 we set out the background on which this work rests, discuss bounded rationality and recall the HHST experiment. Section 3 presents models with a single heuristic and HSM with several heuristics replicating the experimental data. In Section 4 we compare the performances of different models, optimize the best performing model and discuss the robustness of the model simulations. Finally, Section 5 presents the conclusions drawn from our research.
2 Agents’ rationality and market feedback
One of the main theoretical and methodological foundations of this paper is the concept of bounded rationality initially proposed by Herbert Simon, see, e.g., Simon (1957). According to Sargent (1993) bounded rationality provides an alternative to the stringent restrictions enforced by the concept of rational expectations (RE). Full rationality imposes two requirements on economic models. The first is that individuals act rationally, maximizing some objective function subject to perceived constraints. The second requirement is that there is consistency of perceptions about these constraints among different individuals, which is guaranteed by REs. REs require agents to have profound knowledge about their surroundings, such as knowledge of the precise equations of the environment and expectations of other agents. This suggests that REs only have limited and mostly theoretical appeal. We may expect from the outset that RE models will perform poorly descriptively, because the assumptions required by the concept are unlikely to be satisfied in most economic environments.
In contrast, bounded rationality does not assume that economic agents behave as allforeseeing beings who know the complicated structure of the whole economy. Instead it creates a system in which agents try to maximize their outcome by altering their forecasts to eliminate systematic forecast errors. For instance, the adaptive learning approach advocated by Sargent (1993) and extensively used in macroeconomics (e.g., Evans and Honkapohja 2001) assumes that agents form expectations by means of some underlying economic model whose parameters are unknown. Agents behave like econometricians and estimate these parameters. By explicitly modeling a learning process, models of bounded rationality can be used to describe nonequilibrium dynamics and, hence, are more useful in explaining experimental data. At the same time, experiments can be used to discriminate between plausible learning models. By abstracting from irrelevant details of individual learning processes, a good model should, in particular, explain why aggregate variables, such as price, converge to the RE trajectory in some laboratory experiments, but fail to do so in others. Recent empirical evidence suggests that the type of the environment’s feedback can be crucial for the outcome.
2.1 Feedback mechanisms
On the other hand, in physics and economics many systems have positive feedback which may trigger and reinforce instability. The chain of nuclear fission reactions is caused by a single neutron bombarding a nucleus of Uranium 235. As a result of collision, the Uranium 235 nucleus splits into smaller parts, liberates energy and emits new neutrons. These neutrons hit other Uranium 235 nuclei and so on.The Watt governor consists of a pair of balls which are whirled round by a steam engine. Each ball is on the end of a hinged arm. The faster the balls fly round, the more does centrifugal force push the arms towards a horizontal position, this tendency being resisted by gravity. The arms are connected to the steam valve feeding the engine, in such a way that the steam tends to be shut off when the arms approach the horizontal position. So, if the engine goes too fast, some of its steam will be shut off, and it will tend to slow down. If it slows down too much, more steam will automatically be fed to it by the valve, and it will speed up again.
In economic markets in general both types of feedback will play a role. On the whole however, negative feedback is usually associated with supply driven commodity markets and positive feedback with demand driven speculative asset markets. In commodity markets, if producers expect an increase in future prices of a certain commodity, they will start producing more of it. According to the law of supply and demand this will then lead to a decrease in price. In a speculative asset market, if all traders expect a stock’s value to increase they will start buying the stock. This creates a selffulfilling prophecy by causing the stock to increase in value. Some economists argue that financial markets can easily lead to a state of speculative bubbles, along which the growth of the asset prices is mainly driven by investors’ optimistic expectations, “animal spirit”, rather than by some fundamental factors of economy, see, e.g., Akerlof and Shiller (2009) and Kirman (2011).
The distinction between positive expectations feedback and negative expectations feedback is related to the idea of strategic complements and substitutes (Haltiwanger and Waldman 1989). If the majority of agents predict a higher price level in the market with positive feedback, every other agent is better off adjusting his/her own prediction upwards as well. Thus every agent has an incentive to behave similarly to others. Such behavior is typical for an environment with strategic substitutability. On the other hand, in a market with negative feedback, every agent has an incentive to considerably deviate from the majority, decreasing his/her prediction in response to an increase of the prediction from the majority. This is a characteristic of environment with strategic complementarity.
2.2 Experimental evidence
Another interesting characteristic of the experimental outcomes is that the price development seems to depend on the price in the first period. In the experiment this initial price p _{0} is a result of more or less random guesses made by the participants. Indeed, at time 0 participants do not have any knowledge of past prices. They are only given the range [0, 100] where the initial forecast has to lie. Apparently, the initial price realization had a big influence on the rest of the dynamics. In the negative feedback market shown in Fig. 1a, prices fluctuated more strongly in the beginning, when the initial price significantly differed from the equilibrium level. In the positive feedback market a more striking difference could be observed, see Fig. 1b. In all three groups where the standard deviation in the last 30 periods was less than 1, the initial price was in the range of 20 from the equilibrium level. On the other hand, in both groups where the initial price differed from the equilibrium level by a value larger than 20, strong oscillations were observed during the experiment.
2.3 Evolutionary model of heuristics
Which model of expectations would fit the results of the HHST experiment? As discussed above, the RE model implies that individuals immediately predict the equilibrium price 60. The results of the experiment show strong and persistent deviations from the equilibrium especially in the positive feedback treatment. This suggests that the more flexible concept of bounded rationality can be more relevant. Marcet and Sargent (1989) introduced adaptive learning models, where agents behave as econometricians, applying some linear model for price prediction and reestimating the coefficients of the model as more and more data are available. The models of adaptive learning generate convergence, although with different speed, to the equilibrium price for both feedback dynamics, Eqs. 1 and 2, considered in the HHST experiment (Evans and Honkapohja 2001). This outcome, however, is at odds with the experimental evidence. In fact, it is not very surprising that RE or adaptive learning dynamics do not fit experiments well. Both approaches require a relatively high amount of knowledge from the participants about the environment where they operate: under REs agents have a full knowledge of the equations governing the system, while under adaptive learning agents know the functional form of these equations.
The typical agent is not like Gary Kasparov, the world champion chess player who knows the rules of chess, but also knows that he doesn’t know the winning strategy. In most situations, people do not know they are playing a game. Rather, people have some (perhaps imprecise) notion of the environment they are in, their possible opponents, the actions they and their opponents have available, and the possible payoff implications of different actions. These people use heuristics and rules of thumb (generated from experience) to guide behavior; sometimes these heuristics work well and sometimes they don’t. These heuristics can generate behavior that is inconsistent with straightforward maximization.
To explain the experimental results we use the model of Anufriev and Hommes (2012) where predictions are made by simple behavioral rules, heuristics, as suggested by the above quote. To explain the behavior of agents in both positive and negative feedback experiments, the forecasting heuristics are combined in a socalled switching model, which is an extension of Brock and Hommes (1997). More than one forecasting heuristic is tried by agents and when a heuristic performs well it attracts more followers. Thus, the relative weights attached to different heuristics are timevarying.
3 Model and simulations
In this section we, first, present two different forecasting heuristics and study the dynamics of the corresponding models with homogeneous expectations. Then, we combine the heuristics in the switching model.
We evaluate the explanatory power of different models in two ways. In this section we apply a first test. We compare a 50 −periods ahead model simulation (socalled simulated path) with the experimental outcomes. The price dynamics, generated by a model, must have some of the characteristics of the price developments observed in the experiments. In the negative feedback market the price must fluctuate heavily in the first few periods and then converge quickly to the equilibrium value, see Fig. 1a. In the positive feedback market the price must oscillate slowly and either gradually converge towards the constant level or not converge at all, see Fig. 1b. After identifying a model that satisfies these requirements for the simulated path of 50 periods, we apply a second test in Section 4. There the model performance in oneperiodahead forecasting is investigated numerically, the models are optimized over parameters and tested for robustness.
3.1 Firstorder heuristics
3.2 Dynamics generated by single heuristics
The adaptive heuristic (Eq. 6) with w = 0.75 generates oscillatory converging price dynamics in the negative and monotonically converging price dynamics in the positive feedback markets, see Fig. 2a. This outcome is similar to the dynamics observed in the negative feedback sessions, but is very different from the oscillations observed in the positive feedback sessions. Notice that a decrease of the weight w in Eq. 6 leads to less oscillating and, eventually, to monotonic convergence under negative feedback and very slow convergence under positive feedback, as illustrated by example with w = 0.25.
Straightforward stability analysis reveals that the trend heuristic (Eq. 7) produces converging prices in the negative feedback market when − 21/20 < γ < 1/40, and converging prices in the positive feedback market when − 41/40 < γ < 21/20. For γ outside of the interval, the price dynamics under corresponding feedback diverge. Interestingly, all the values of γ estimated in the positive feedback sessions of the HHST experiment fall within the interval of convergence under positive feedback. But the dynamics with these γ’s would diverge under negative feedback. The dynamics of the model where expectations are generated by the trend heuristic are illustrated in Fig. 2b. For γ = 1 the dynamics under negative feedback (left panel) does not converge to the equilibrium but remain bounded because the forecasts in the simulations are limited to the interval [0, 100]. When γ is changing to 0.5 the initial oscillations are less wild but eventually converge to the same 2cycle. The right panel of Fig. 2b shows that for γ = 1 the price oscillates on the positive feedback market, resembling the experimental outcome. When γ decreases the oscillations are less pronounced and convergence eventually become monotonic, as shown for γ = 0.5.
3.3 Heuristic switching model
Two parameters are important in Eq. 10. The parameter δ is inversely related to the frequency with which every agent updates “active” forecasting heuristic. Positive values of δ capture the tendency of people to stick to their previously chosen rule despite the evidence that an alternative rule performs better. Such inertia is widely reported in experiments (Kahneman 2003). In a large population, δ is also the average percentage of agents who do not update their heuristic in every period. The parameter β ≥ 0 determines how strongly those agents who update their heuristic react to a difference in performance between heuristics. If β = 0 agents will not consider the differences in the performance of the heuristics at all; all heuristics will be given equal impacts. If, on the contrary, the value of β is very large, agents who update their forecasting heuristic will all switch to the best performing heuristic.

choose H different forecasting heuristics;

fix three learning parameters, β, η and δ;

initialize prices in order for the heuristics to yield the initial forecasts;

initialize the impacts for all heuristics so that the initial forecasts are combined to determine the average price forecast.
3.4 Dynamics of the heuristics switching model
Let us apply the heuristic switching model (HSM) given by Eqs. 9 and 10 to the experimental results of HHST. The parameters of the heuristics are chosen as w = 0.75 for the adaptive heuristic (Eq. 6), and γ = 1 for the trend heuristic (Eq. 7). Recall that the heuristics with these parameters describe the two markets relatively well: the negative feedback market is well described by the adaptive heuristic, while the positive feedback market is well described by the trend heuristic. After some trial and error simulations, we set the parameters of the HSM to β = 1.5, δ = 0.1 and η = 0.1. We also choose equal initial impacts of both heuristics and p _{0} = 50 as the initial price.
It is particularly informative to analyze the evolution of the heuristics’ impacts. When the feedback is negative, the impact of the trend heuristic immediately falls to almost 0 and increases later on only at the stage when the price has already converged to the equilibrium level, i.e., when the predictions of both heuristics are similar. When the feedback is positive, the opposite phenomenon takes place with the trend heuristic dominating from the beginning of the simulations. The intuition of this result is as follows. The trend heuristic performs well during the long phases of the trends and performs poorly during the periods with frequent fluctuations around the constant price. At the same time, an extensive use of the trend heuristic results in the trends under the positive feedback and in oscillations under the negative feedback, see Fig. 2b. Thus, under the positive feedback, the success of the trend heuristic reinforces its use, which makes the trend in prices sustainable. The adaptive heuristic performs relatively poorly during the trend phases and loses its impact. On the other hand, under the negative feedback, the trend heuristic generates oscillatory dynamics on which it performs very poorly, much worse than adaptive heuristic. Coordination on the adaptive heuristic leads to fast convergence through initial oscillations, as shown in Fig. 2a.
The initial 10 periods of the simulations are explained now, but what happens next? In the positive feedback market agents attach a higher impact to the trend heuristic at the trend phases and decrease their impacts when the price development changes direction. Even when all subjects use the trendfollowing heuristic, the trend cannot be sustained forever and, at a certain moment, the trend will be reverted and the impact of the adaptive heuristic will grow. This occurs in the periods 15–17 of the simulations. Afterwards the downwarding trend reinforces the use of the trend heuristic, but since the price is already close to the equilibrium, the relative impacts of the heuristics are similar. Notice that the model generates such convergence to the equilibrium only in the absence of noise, see the left panel of Fig. 3b. In the negative feedback market, the price is stabilized at the level close to the equilibrium during the periods 10–15. However, the steadystate dynamics with price at the equilibrium level is not stable in the model with switching. Indeed, when the price stabilizes both heuristics give the same predictions and their impacts are the same. But the trend heuristic reinforces a trend and leads to the overshooting of the equilibrium level. As a result, dynamics converge to the 2period cycle with price being very close to the equilibrium level but jumping around it.^{5} At the cycle, the forecast of the trend heuristic is worse than the forecast of the adaptive heuristic, which results in their different impacts: around 80% of the adaptive heuristic and around 20% of the trend heuristic.
3.5 Discussion
The first simulations of the heuristic switching model point to a behavioral explanation of the difference in the experimental outcomes between positive and negative feedback markets. When people, as subjects in the experiment or agents in the model, cannot make strategic decisions due to the absence of full knowledge of the environment they are operating in, they rely on behavioral rules of thumb. In the learning to forecast experiment different rules are possible, and some of them provide better forecasts than others. The learning of agents then takes a form of evaluating different forecasting possibilities and switching to those which performed better in the past. Agents in the HSM learn individually (not socially, through the interaction with others) by applying a counterfactual analysis of alternative forecasting rules on the basis of past data. As a result, the population of agents switch to more successful rules and the aggregate dynamics may change its properties (e.g., the trend in prices may revert). Then, via the reevaluation of performances, dynamics feed back to the distribution of the rules’ impacts. Three parameters of the model allow to capture the behavioral characteristics such as imperfect switching behavior and, consequently, heterogeneity (especially when β is small), inertia in switching (when δ is close to 1), and short memory of past performances (when η is close to 0).
While the behavioral assumptions underlying our model are known from the behavioral literature,^{6} our model does not aim to provide a precise description of the behavior of subjects in the experiment.^{7} Instead, the aim of the model is to outline a mechanism explaining both negative and positive feedback markets at the same time. Indeed, in the simulations discussed in Section 3.4 the same heuristics and values of the learning parameters have been used. Our model is, essentially, a parsimonious version of the numerous computational learning models based on genetic algorithms (see, e.g., Arifovic 1996 and Hommes and Lux 2011) or its modifications such as Individual Evolutionary Learning (see Arifovic and Ledyard 2007 and Anufriev et al. 2011).
Our model also stresses importance of heterogeneity in the explanation of the experiments. According to the results of Section 3.2, the homogeneous expectations model with simple firstorder heuristics we considered can not explain negative and positive feedback experimental data simultaneously. The results of the experiments can be explained, however, by assuming that agents learn to change their forecasting methods. The heuristic switching model can be simulated with many heuristics. For example, the model analyzed in Anufriev and Hommes (2012) had 4 different heuristics. We found, however, that the two heuristics are sufficient to reproduce the result of the HHST experiment qualitatively, and preferred such parsimonious version of the model over other possible specifications.^{8}
4 Validation and robustness
In this section we further examine the performance of the heuristic switching model with the adaptive and trend forecasting heuristics. First, we investigate the oneperiodahead forecasting performance of the HSM, compare it with performances of the other models, and also fit the HSM to the data.^{9} Second, we investigate robustness of the model with respect to the change in parameter values.
4.1 Oneperiod ahead model predictions
4.2 Model optimization
MSEs of 5 different models over 47 time periods of the experiment
Model  Negative feedback  Positive feedback  12 groups 

Fundamental  2.5712  46.8344  24.7028 
Adaptive  2.3001  2.9992  2.6497 
Trend  21.1112  0.9260  11.0186 
Mixed  7.9798  1.0518  4.5158 
HSM  3.2967  0.9065  2.1016 
As expected from the previous analysis, in the negative feedback environment the fundamental model works well, and the adaptive model is better than the trend model. In contrast, in the positive feedback environment the trend model works very well, the adaptive model is worse and the fundamental models perform very bad. Consider now a forecasting method of averaging the predictions of the two heuristics (line ‘mixed’ in Table 1). Performance of this model with heterogeneous expectations but fixed, equal weights is better than the average performance of the heuristics in a given environment. However, in every environment and also for all 12 groups, this model still performs considerably worse than the best of the two simple heuristics. Finally, the heuristic switching model performs better than the other models in the positive feedback environment and is worse than the adaptive heuristic in the negative feedback environment. It is also the best performing among these 5 models when the MSEs are averaged over 12 experimental groups. As opposed to the model with constant equal weights, the HSM makes the best out of two homogeneous heuristics.
A comparison of the models on the basis of the mean squared errors is not completely satisfactory, since the HSM has more additional parameters. To address this issue one can relate minimization of the MSE with maximization of a certain likelihood function and then evaluate the fitness of the models using the two criteria commonly used to penalize models for additional parameters, the Akaike Information Criterion and the Bayesian Information Criterion. See Appendix for details. According to the Akaike Information Criterion better models should have lower value of \(\text{AIC} = 2n + kG \ln (\text{MSE}_{kG}) 2C\), where k = 47 is the number of observations in one group, G is the number of groups in the sample, n is the number of parameters of the model and C is a constant which depends on the sample size but does not depend on the model. According to the Bayesian Information Criterion better models should have lower value of \(\text{BIC} = n \ln (kG)+ kG \ln (k \text{MSE}_{k})2C\).
Fit of 9 different models over 47 time periods of the experiment
Model  Negative feedback  Positive feedback  12 groups  

Adaptive  Benchmark  MSE  2.3001  2.9992  2.6497 
w  0.75  0.75  0.75  
AIC  2070.3458  2220.0313  2150.1399  
BIC  2070.3458  2220.0313  2150.1399  
Optimized  MSE  2.3001  1.8218  2.3680  
\(\hat{w}\)  0.75  1.00  0.91  
AIC  2072.3451  1940.8575  2088.7528  
BIC  2076.6802  1945.1926  2093.0879  
Trend  Benchmark  MSE  21.1112  0.9260  11.0186 
γ  1.00  1.00  1.00  
AIC  3320.6515  1557.2206  2953.9288  
BIC  3320.6515  1557.2206  2953.9288  
Optimized  MSE  1.9237  0.7480  2.2940  
\(\hat{\gamma}\)  − 0.33  0.71  − 0.16  
AIC  \(\textbf{1971.5531}\)  1438.7973  2070.8502  
BIC  \(\textbf{1975.8881}\)  1443.1323  2075.1852  
Mixed  Benchmark  MSE  7.9798  1.0518  4.5158 
(w, γ, n)  (0.75,1.00,0.50)  (0.75,1.00,0.50)  (0.75,1.00,0.50)  
AIC  2771.9429  1629.0202  2450.8370  
BIC  2771.9429  1629.0202  2450.8370  
Optimized  MSE  2.3001  0.7568  2.6276  
\((w,\gamma,\hat{n})\)  (0.75,1.00,0.76)  (0.75,1.00,0.38)  (0.75,1.00,1.00)  
AIC  2072.3458  1445.4272  2147.4263  
BIC  2076.6809  1449.7623  2151.7614  
HSM  Benchmark  MSE  3.2967  0.9065  2.1016 
(β, η, δ)  (1.50,0.10,0.10)  (1.50,0.10,0.10)  (1.50,0.10,0.10)  
(w, γ)  (0.75,1.00)  (0.75,1.00)  (0.75,1.00)  
AIC  2273.3741  1545.1924  2019.4464  
BIC  2273.3741  1545.1924  2019.4464  
Optimized 1  MSE  2.3001  0.7329  1.5402  
\((\hat{\beta},\hat{\eta},\hat{\delta})\)  (1.44,1.00,0.00)  (0.01,0.96,0.34)  (0.02,0.97,0.00)  
(w, γ)  (0.75,1.00)  (0.75,1.00)  (0.75,1.00)  
AIC  2076.3458  1431.2754  1850.1692  
BIC  2089.3510  1444.2806  1863.1743  
Optimized 2  MSE  1.9225  0.7088  1.5051  
\((\hat{\beta},\hat{\eta},\hat{\delta})\)  (1.46,1.00,0.15)  (0.48,0.85,0.00)  (0.37,0.87,0.00)  
\((\hat{w},\hat{\gamma})\)  (0.98,− 2.00)  (0.83,0.75)  (0.75,0.75)  
AIC  1979.2104  1416.4752  1841.1650  
BIC  2000.8857  1438.1504  1862.8403 
4.3 Robustness
Finally, we briefly discuss the issue of robustness. A model is said to be robust if a change in parameter values does not immediately result in a change of the model’s characteristics. A good prediction model should yield good results even if parameters are slightly changed. If, for example, the parameter value for β in the HSM is increased by, say, ten percent, this should not lead to a dramatic change in price dynamics. In the experiments it is unlikely that the agents held stringent parameters from which they do not deviate. The general results of the model should, therefore, hold even if the parameters of the model change slightly.
Robustness test of the heuristics switching model
 0%  + 10%  − 10%  + 20%  − 20%  + 30%  − 30%  + 40%  − 40% 

β  1.5051  1.5052  1.5052  1.5053  1.5055  1.5054  1.5061  1.5056  1.5072 
η  1.5051  1.5109  1.5158  1.5156  1.5654  1.5163  1.6037  1.5166  1.6350 
δ  1.5051  1.5051  1.5051  1.5051  1.5051  1.5051  1.5051  1.5051  1.5051 
β, η  1.5051  1.5114  1.5188  1.5160  1.5745  1.5168  1.6190  1.5171  1.6585 
β, δ  1.5051  1.5052  1.5052  1.5053  1.5055  1.5054  1.5061  1.5056  1.5072 
η, δ  1.5051  1.5109  1.5158  1.5156  1.5654  1.5163  1.6037  1.5166  1.6350 
β, η, δ  1.5051  1.5114  1.5188  1.5160  1.5745  1.5168  1.6190  1.5171  1.6585 
MSE  1.5051  1.6556  1.8061  1.9566  2.1072 
5 Conclusion
This paper analyzed the experimental results of markets with negative and positive feedbacks in Heemeijer et al. (2009). Estimations of individual forecasting rules in that paper showed that participants relied on simple firstorder forecasting heuristics, anchoring their expectations to past prices and past predictions and extrapolating past trends. The estimated individual rules tended to attach positive weight to the trend term in the positive feedback treatments but did not attach weight to this term in the negative feedback treatments. The aggregate dynamics was also very different between the two treatments. The heuristic switching model, simulated in this paper, provides an explanation why this difference in individual forecasting and aggregate price behavior took place.
Several models have been compared with the aggregate price dynamics from the experiment. None of the single heuristic models could provide qualitative features observed in both negative and positive feedback experimental environments. In contrast, the switching model was able to reproduce experimental “stylized facts”. In fact, a parsimonious model where agents switch between the adaptive and the trend heuristics does well in explaining the most important characteristics of the price dynamics observed in the experiment. Consistently with the experiment, in the negative feedback market the simulations showed strong oscillations in the first periods followed by quick convergence towards the equilibrium price. In the positive feedback market the model exhibited persistent deviations from the equilibrium price and slow oscillations. The price outcomes of the model were also dependent on the initial price with more persistent oscillations when the initial state deviated more from the fundamental price, similarly to the outcome of the experiments.
Footnotes
 1.
The data of all the learning to forecast experiments, including the experiments we discuss in this paper, are freely available at the personal web page of Cars Hommes, http://www1.fee.uva.nl/cendef.
 2.
Bao et al. (2010) ran similar learning to forecast experiment with a time varying fundamental price subject to large unanticipated shocks.
 3.
Ignoring the first 5 periods, the standard deviation of the price in 6 groups with negative feedback were 0.63, 0.93, 2.97, 0.57, 1.55 and 0.84. In all these cases the interval of oscillations contained the price 60. Ignoring the first 20 periods, the standard deviation of the price in 7 groups with positive feedback was 3.35, 0.89, 0.82, 7.01, 2.63, 5.96 and 0.80. In all three groups where the standard deviation was less than 1, the equilibrium price 60 did not belong to the interval of oscillations.
 4.
The value of γ was significantly different from 0 in 3 out of 19 firstorder heuristics (Eq. 5) estimated for the participants in the negative feedback experiments and in 15 out of 21 firstorder heuristics estimated for the participants in the positive feedback experiments. In the former case values of γ were estimated as − 0.44, − 0.38 and 0.06. In the latter case values of γ in the range from 0.28 to 0.97 were observed.
 5.
This cycle is almost invisible at Fig. 3a. The prices are 59.74418 and 60.2559 along the cycle. The impacts are 0.8125 and 0.1875 for the adaptive and trend heuristics, respectively.
 6.
HHST and other learning to forecast experiments showed that agents use firstorder heuristics for forecasting. Indeed, the heuristics we have chosen for the simulations were used by some subjects in the experiment. Recent learning to forecast experiments provide evidence of switching between simple heuristics, see illustration in Anufriev and Hommes (2009). Anufriev et al. (2011) estimate switching parameters in a multiple choice experiment.
 7.
For example, we ignore the fact that actual impacts in the experiment could be a multiple of 1/6, proceeding instead with arbitrary values of impacts, which is valid only under a continuum of agents. An alternative interpretation is that every agent combines two forecasts, adaptive and trend, with time varying weights.
 8.
We simulated the model with 3 heuristics, adding to the adaptive and trend heuristic a, socalled, anchoring and adjustment heuristic obtained from Eq. 5 by replacing the (unknown to the participants) fundamental price 60 by the average of all past prices. The anchoring and adjustment heuristic combines some features of the trend and adaptive heuristics. It is, therefore, not surprising that the dynamics of the model with 3 heuristics (not shown in the paper) is not very different from the dynamics shown in Fig. 3.
 9.
 10.
The errors of the first three periods are not taken into account for the following reason. Both heuristics of the HSM require two prices to be initialized (for adaptive heuristic we set \(p^e_{1}=p_0^\text{Gr X}\)). Therefore, at time t = 2 the first performances of the heuristics are obtained when their first predictions, \(p^e_{h,2}\), are compared with experimental price \(p_2^\text{Gr X}\). The performances determine the impacts and only from period t = 3 the HSM is able to generate price prediction. For comparison, in all other models we compute errors also from t = 3. We also have computed similar MSEs on the data starting from periods t = 4, 5 and 6 and obtained very similar results.
 11.
We eliminated one of the groups of the positive feedback experiment as an outlier. In this group at time t = 7 one of the participants predicted 5250, making, presumably, a typing error (in previous three period the predictions of this participant were 50.0, 52.0 and 51.0). As a result, the realized price was 877.8 and was above 100 for another four periods.
 12.
The search is made by fmincon routine in MATLAB, and we controlled the results using the grid search. We implemented the following constraints: w ∈ [0, 1], γ ∈ [ − 2, 2], β ≥ 0, η ∈ [0, 1], and δ ∈ [0, 1].
Notes
Acknowledgements
We are grateful to the participants of the workshop “Evolution and market behavior in economics and finance” in Pisa, Italy (October 2009) for fruitful discussion, and to the three anonymous referees for useful suggestions. This work was supported by the EU 7th framework collaborative project “Monetary, Fiscal and Structural Policies with Heterogeneous Agents (POLHIA)”, grant no. 225408. The usual caveats apply.
Open Access
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
References
 Adam K (2007) Experimental evidence on the persistence of output and inflation. Econ J 117:520CrossRefGoogle Scholar
 Akerlof G, Shiller R (2009) Animal spirits: how human psychology drives the economy, and why it matters for global capitalism. Princeton University Press, PrincetonGoogle Scholar
 Anufriev M, Hommes C (2009) Evolutionary selection of individual expectations and aggregate outcomes. CeNDEF working paper 200909. University of AmsterdamGoogle Scholar
 Anufriev M, Hommes C (2012) Evolution of market heuristics. Knowl Eng Rev (forthcoming)Google Scholar
 Anufriev M, Arifovic J, Ledyard J, Panchenko V (2011) Efficiency of continuous double auctions under individual evolutionary learning with full and limited information. J Evol Econ. doi: 10.1007/s0019101102308 Google Scholar
 Anufriev M, Bao T, Tuinstra J (2011) Switching behavior in the lab. Mimeo. University of AmsterdamGoogle Scholar
 Arifovic J (1996) The behavior of the exchange rate in the genetic algorithm and experimental economies. J Polit Econ 104(3):510–541CrossRefGoogle Scholar
 Arifovic J, Ledyard J (2007) Call market book information and efficiency. J Econ Dyn Control 31(6):1971–2000CrossRefGoogle Scholar
 Bao T, Hommes C, Sonnemans J, Tuinstra J (2010) Individual expectation, limited rationality and aggregate outcome. CeNDEF working paper 201007. University of AmsterdamGoogle Scholar
 Branch W (2004) The theory of rationally heterogeneous expectations: evidence from survey data on inflation expectations. Econ J 114(497):592–621CrossRefGoogle Scholar
 Brock WA, Hommes CH (1997) A rational route to randomness. Econometrica 65(5):1059–1095CrossRefGoogle Scholar
 Colucci D, Valori V (2006) Ways of learning in a simple economic setting: a comparison. Chaos Solitons Fractals 29(3):653–670CrossRefGoogle Scholar
 Conlisk J (1996) Bounded rationality and market fluctuations. J Econ Behav Organ 29(2):233–250CrossRefGoogle Scholar
 Davidovits P (2008) Physics in biology and medicine. Academic, New YorkGoogle Scholar
 Dawkins R (1976) The selfish gene. Oxford University Press, LondonGoogle Scholar
 Diks C, van der Weide R (2005) Herding, asynchronous updating and heterogeneity in memory in a CBS. J Econ Dyn Control 29:741–763CrossRefGoogle Scholar
 Duffy J (2006) Agentbased models and human subject experiments. In: Judd K, Tesfatsion L (eds) Handbook of computational economics: agentbased computational economics (Handbooks in economics series), vol 2. Elsevier/NorthHollandGoogle Scholar
 Evans GW, Honkapohja S (2001) Learning and expectations in macroeconomics. Princeton University Press, PrincetonGoogle Scholar
 Fehr E, Tyran J (2008) Limited rationality and strategic interaction: the impact of the strategic environment on nominal inertia. Econometrica 76(2):353–394Google Scholar
 Haltiwanger J, Waldman M (1989) Limited rationality and strategic complements: the implications for macroeconomics. Q J Econ 104(3):463–483CrossRefGoogle Scholar
 Heemeijer P, Hommes C, Sonnemans J, Tuinstra J (2009) Price stability and volatility in markets with positive and negative expectations feedback: an experimental investigation. J Econ Dyn Control 33:1052–1072CrossRefGoogle Scholar
 Hey JD (1994) Expectation formation: rational or adaptive or ...? J Econ Behav Organ 25:329–349CrossRefGoogle Scholar
 Hommes C (2006) Heterogeneous agent models in economics and finance. In: Judd K, Tesfatsion L (eds) Handbook of computational economics: agentbased computational economics (Handbooks in economics series), vol 2. Elsevier/NorthHollandGoogle Scholar
 Hommes C (2011) The heterogeneous expectations hypothesis: some evidence from the lab. J Econ Dyn Control 35(1):1–24CrossRefGoogle Scholar
 Hommes C, Lux T (2011) Individual expectations and aggregate behavior in learning to forecast experiments. Macroecon Dyn (forthcoming)Google Scholar
 Hommes C, Huang H, Wang D (2005) A robust rational route to randomness in a simple asset pricing model. J Econ Dyn Control 29:1043–1072CrossRefGoogle Scholar
 Hommes C, Sonnemans J, Tuinstra J, van de Velden H (2005) Coordination of expectations in asset pricing experiments. Rev Financ Stud 18(3):955–980CrossRefGoogle Scholar
 Hommes C, Sonnemans J, Tuinstra J, van de Velden H (2007) Learning in Cobweb experiments. Macroecon Dyn 11(S1):8–33CrossRefGoogle Scholar
 Hommes C, Sonnemans J, Tuinstra J, van de Velden H (2008) Expectations and bubbles in asset pricing experiments. J Econ Behav Organ 67(1):116–133CrossRefGoogle Scholar
 Kahneman D (2003) Maps of bounded rationality: psychology for behavioral economics. Am Econ Rev 93:1449–1475CrossRefGoogle Scholar
 Kirman A (2011) Complex economics: individual and collective rationality. Routledge, AbingdonGoogle Scholar
 Mailath G (1998) Do people play Nash equilibrium? Lessons from evolutionary game theory. J Econ Lit 36(3):1347–1374Google Scholar
 Marcet A, Sargent T (1989) Convergence of least squares learning mechanisms in selfreferential linear stochastic models. J Econ Theory 48(2):337–368CrossRefGoogle Scholar
 Sargent TJ (1993) Bounded rationality in macroeconomics. Oxford University Press, LondonGoogle Scholar
 Shiller R (1981) Do stock prices move too much to be justified by subsequent changes in dividends? Am Econ Rev 71(3):421–436Google Scholar
 Simon HA (1957) Models of man: social and rational. Wiley, New YorkGoogle Scholar
 Sonnemans J, Tuinstra J (2010) Positive expectations feedback experiments and number guessing games as models of financial markets. J Econ Psychol 31:964–984CrossRefGoogle Scholar
 Sutan A, Willinger M (2009) Guessing with negative feedback: an experiment. J Econ Dyn Control 33(5):1123–1133CrossRefGoogle Scholar