Abstract
The evolutionary theory of behavior dynamics (ETBD) is a complexity theory, which means that it is stated in the form of simple low-level rules, the repeated operation of which generates high-level outcomes that can be compared to data. The low-level rules of the theory implement Darwinian processes of selection, reproduction, and mutation. This tutorial is an introduction to the ETBD for a general audience, and illustrates how the theory is used to animate artificial organisms that can behave continuously in any experimental environment. Extensive research has shown that the theory generates behavior in artificial organisms that is indistinguishable in qualitative and quantitative detail from the behavior of live organisms in a wide variety of experimental environments. An overview and summary of this supporting evidence is provided. The theory may be understood to be computationally equivalent to the biological nervous system, which means that the algorithmic operation of the theory and the material operation of the nervous system give the same answers. The applied relevance of the theory is also discussed, including the creation of artificial organisms with various forms of psychopathology that can be used to study clinical problems and their treatment. Finally, possible future directions are discussed, such as the extension of the theory to behavior in a two-dimensional grid world.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.
References
Ballerini, M., Cabibbo, N., Candelier, R., Cavagna, A., Cisbani, E., Giardina, I., Lecomte, V., Orlandi, A., Parisi, G., Procaccini, A., Viale, M., & Zdravkovic, V. (2008). Interaction ruling animal collective behavior depends on topological rather than metric distance: Evidence from a filed study. Proceedings of the National Academy of Sciences of the United States of America, 105, 1232–1237. https://doi.org/10.1073/pnas.0711437105
Bentley, P. J. (2001). Digital biology. Simon & Schuster.
Bunyard-Wild, P. (2013). Gretna green starling murmurations. https://www.youtube.com/watch?v=M1Q-EbX6dso. Accessed 19 Sept 2022.
Chi, C. (2019). Monkey see computer do: Simulation of dynamic behavior via the evolutionary theory of behavior dynamics [Master's thesis]. Emory University. https://etd.library.emory.edu/concern/etds/tm70mw37x?locale=en. Accessed 11 Nov 2020.
Cox, B., & Forshaw, J. (2012). The quantum universe: Everything that can happen does happen. Da Capo Press.
Davison, M., & Baum, W. M. (2000). Choice in a variable environment: Every reinforcer counts. Journal of the Experimental Analysis of Behavior, 74, 1–24. https://doi.org/10.1901/jeab.2000.74-1
de Villiers, P. A. (1977). Choice in concurrent schedules and a quantitative formulation of the law of effect. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 233–287). Prentice Hall.
Dishion, T. J., Spracklen, K. M., Andrews, D. W., & Patterson, G. R. (1996). Deviancy training in male adolescent friendships. Behavior Therapy, 27, 373–390. https://doi.org/10.1016/S0005-7894(96)80023-2
Edelman, G. M. (1987). Neural Darwinism: The theory of neuronal group selection. Basic Books.
Falligant, J. M., Hagopian, L., Laureano, B., & Klapes, B. (2022). Examining resurgence and repetition with the evolutionary theory of behavior dynamics. Behavioural Processes, 203, 104776.
Feynman, R. P. (2006). QED: The strange theory of light and matter. Princeton University Press. (Original work published 1985)
Furukawa, E., Alsop, B., Shimabukuro, & Tripp, G. (2019). Is increased sensitivity to punishment a common characteristic of attention deficit/hyperactivity disorder? An experimental study of response allocation in Japanese children. ADHD Attention Deficit & Hyperactivity Disorders, 11, 433–443.
Hayek, F. A. (1952a). The counter-revolution of science: Studies on the abuse of reason. Free Press.
Hayek, F. A. (1952b). The sensory order: An inquiry into the foundations of theoretical psychology. University of Chicago Press.
Heisenberg, W. (2007). Quantum-theoretical re-interpretation of kinematic and mechanical relations. In B. L. van derWaerden (Ed.), Sources of quantum mechanics (pp. 261–276). Dover (Original work published 1925.).
Herrnstein, R. J., & Vaughan Jr., W. (1980). Melioration and behavioral allocation. In J. E. R. Staddon (Ed.), Limits to action: The allocation of individual behavior (pp. 143–176). Academic Press.
Holland, J. H. (1995). Hidden order. Perseus Books.
Holland, J. H. (1998). Emergence. Perseus Books.
Horner, J. M., & Staddon, J. E. R. (1987). Probabilistic choice: A simple invariance. Behavioural Processes, 15, 59–92. https://doi.org/10.1016/0376-6357(87)90034-9
Klapes, B. (2022). Performing simulated experiments using an Evolutionary Theory of Behavior Dynamics: A tutorial. In B. Laureano (Chair), Modeling severe problem behavior and treatment effects using artificial organisms: A new frontier [Conference symposium] 48th Association for Behavior Analysis International Annual Convention, Boston, MA. https://www.researchgate.net/publication/360950785_Performing_Simulated_Experiments_Using_an_Evolutionary_Theory_of_Behavior_Dynamics_A_Tutorial
Kollins, S. H., Lane, S. D., & Shapiro, S. K. (1997). Experimental analysis of childhood psychopathology: A laboratory matching analysis of the behavior of children diagnosed with attention-deficit hyperactivity disorder (ADHD). Psychological Record, 47, 25–44.
Kulubekova, S., & McDowell, J. J. (2013). Computational model of selection by consequences: Patterns of preference change on concurrent schedules. Journal of the Experimental Analysis of Behavior, 100, 147–164.
Li, D., Elliffe, D., & Hautus, M. J. (2018). A multivariate assessment of the rapidly changing procedure with McDowell’s evolutionary theory of behavior dynamics. Journal of the Experimental Analysis of Behavior, 110, 336–365. https://doi.org/10.1002/jeab.478
McDowell, J. J. (2004). A computational model of selection by consequences. Journal of the Experimental Analysis of Behavior, 81, 297–317. https://doi.org/10.1901/jeab.2004.81-297
McDowell, J. J. (2010). Behavioral and neural Darwinism: Selectionist function and mechanism in adaptive behavior dynamics. Behavioural Processes, 84, 358–365. https://doi.org/10.1016/j.beproc.2009.11.011
McDowell, J. J. (2013a). Representations of complexity: How nature appears in our theories. The Behavior Analyst, 36, 345–359.
McDowell, J. J. (2013b). A quantitative evolutionary theory of adaptive behavior dynamics. Psychological Review, 120, 731–750. https://doi.org/10.1037/a0034244
McDowell, J. J. (2017a). Animal cognition + optimal choice = behavior: A review of Adaptive Behavior and Learning (2nd ed.), by J. E. R. Staddon. Journal of the Experimental Analysis of Behavior, 108, 125–138. https://doi.org/10.1002/jeab.262
McDowell, J. J. (2017b). The effect of reinforcement, and the roles of mutation rate and selection pressure, in an evolutionary theory of behavior dynamics. The Behavior Analyst, 40(1), 75–82. https://doi.org/10.1007/s40614-017-0094-9
McDowell, J. J. (2019). On the current status of the evolutionary theory of behavior dynamics. Journal of the Experimental Analysis of Behavior, 111, 130–145. https://doi.org/10.1002/jeab.495
McDowell, J. J. (2021). Empirical matching, matching theory, and an evolutionary theory of behavior dynamics in clinical application. Perspectives on Behavior Science, 44, 561–580. https://doi.org/10.1007/s40614-021-00296-w
McDowell, J. J., & Arashanapalli, S. (2021). Evolutionary theory prediction: Response rate on single schedules as a joint function of reinforcement rate and reinforcer magnitude. Journal of the Experimental Analysis of Behavior, 116, 225–242. https://doi.org/10.1002/jeab.710
McDowell, J. J., & Calvin, N. T. (2015). Against matching theory: Predictions of an evolutionary theory of behavior dynamics. Behavioural Processes, 114, 14–25. https://doi.org/10.1016/j.beproc.2015.02.007
McDowell, J. J., & Caron, M. L. (2007). Undermatching is an emergent property of selection by consequences. Behavioural Processes, 75, 97–106.
McDowell, J. J., & Caron, M. L. (2010). Bias and undermatching in delinquent boys’ verbal behavior as a function of their level of deviance. Journal of the Experimental Analysis of Behavior, 93, 469–481. https://doi.org/10.1901/jeab.2010.93-469
McDowell, J. J., Caron, M. L., Kulubekova, S., & Berg, J. P. (2008). A computational theory of selection by consequences applied to concurrent schedules. Journal of the Experimental Analysis of Behavior, 90, 387–403. https://doi.org/10.1901/jeab.2008.90-387
McDowell, J. J., & Klapes, B. (2018). An evolutionary theory of behavior dynamics applied to concurrent ratio schedules. Journal of the Experimental Analysis of Behavior, 110, 323–335. https://doi.org/10.1002/jeab.468
McDowell, J. J., & Klapes, B. (2019). An implementation of punishment in the evolutionary theory of behavior dynamics. Journal of the Experimental Analysis of Behavior, 112, 128–143.
McDowell, J. J., & Klapes, B. (2020). All behavior is choice: Revisiting an evolutionary theory’s account of behavior on single schedules. Journal of the Experimental Analysis of Behavior, 114, 430–446. https://doi.org/10.1002/jeab.630
McDowell, J. J., Klapes, B., & Arashanapalli, S. (2023). A test of the evolutionary theory’s account of punishment superimposed on single-alternative schedules. Journal of the Experimental Analysis of Behavior, 119, 117–128. https://doi.org/10.1002/jeab.811
McDowell, J. J., & Popa, A. (2010). Toward a mechanics of adaptive behavior: Evolutionary dynamics and matching theory statics. Journal of the Experimental Analysis of Behavior, 94, 241–260. https://doi.org/10.1901/jeab.2010.94-241
McDowell, J. J., Popa, A., & Calvin, N. T. (2012). Selection dynamics in joint matching to rate and magnitude of reinforcement. Journal of the Experimental Analysis of Behavior, 98, 199–212. https://doi.org/10.1901/jeab.2012.98-199
McDowell, J. J., & Riley, S. (2020). Improving on Skinner: An evolutionary theory of behavior dynamics and its neural interpretation. Behavior & Philosophy, 48, 18–24.
McDowell, J. J., Soto, P. L., Dallery, J., & Kulubekova, S. (2006). A computational theory of adaptive behavior based on an evolutionary reinforcement mechanism. In M. Keijzer (Ed.), Proceedings of the 2006 Conference on Genetic and Evolutionary Computation (GECCO-2006) (pp. 175–182). ACM Press.
Mermin, N. D. (2004). Could Feynman have said this? Physics Today, 57, 10. https://doi.org/10.1063/1.1768652
Miller, J. H., & Page, S. E. (2007). Complex adaptive systems: An introduction to computational models of social life. Princeton University Press.
Morris, S. L., & McDowell, J. J. (2021). Modeling subtypes of automatically reinforced self-injurious behavior with the evolutionary theory of behavior dynamics. Perspectives on Behavior Science, 44, 581–603. https://doi.org/10.1007/s40614-021-00297-9
Popa, A. (2013). The evolutionary theory of behavior dynamics: Complexity, Darwinism, and the emergence of high-level phenotypes [Doctoral dissertation]. Emory University. http://pid.emory.edu/ark:/25593/f8hw4
Popa, A., & McDowell, J. J. (2010). The effect of Hamming distances in a computational model of selection by consequences. Behavioural Processes, 84, 428–434.
Popa, A., & McDowell, J. J. (2016). Behavioral variability in an evolutionary theory of behavior dynamics. Journal of the Experimental Analysis of Behavior, 105, 270–290. https://doi.org/10.1002/jeab.199
Popper, K. (1965). Conjectures and refutations: The growth of scientific knowledge.
Pringle, J. W. S. (1951). On the parallel between learning and evolution. Behaviour, 3, 174–214. https://doi.org/10.1163/156853951X00269
Santa Fe Institute. (2011). Retrieved from http://www.santafe.edu
Shahan, T. A., Browning, K. O., Nist, A. N., & Sutton, G. M. (2020). Resurgence and downshifts in alternative reinforcement rate. Journal of the Experimental Analysis of Behavior, 114, 163–178.
Taylor, D., Lincoln, A. J., & Foster, S. L. (2010). Impaired behavior regulation under conditions of concurrent variable schedules of reinforcement in children with ADHD. Journal of Attention Disorders, 13, 358–368. https://doi.org/10.1177/1087054708329974
Todoelectronica (2011). Robot Araña Caminante. [Video]. YouTube. https://www.youtube.com/watch?v=qtT0HfgJ28s. Accessed 15 Nov 2020.
von Neumann, J., & Morgenstern, O. (2007). Theory of games and economic behavior. Princeton University Press. (Original work published 1944)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of Interests/Competing Interests
There are no conflicts of interest or competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
I thank Cyrus Chi for his helpful comments on an earlier version of this article.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
McDowell, J.J. Creating and Studying the Behavior of Artificial Organisms Animated by an Evolutionary Theory of Behavior Dynamics. Perspect Behav Sci 46, 119–136 (2023). https://doi.org/10.1007/s40614-023-00366-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40614-023-00366-1