Animal Cognition

, Volume 17, Issue 5, pp 1081–1088 | Cite as

Exploration and learning in capuchin monkeys (Sapajus spp.): the role of action–outcome contingencies

  • Eugenia Polizzi di Sorrentino
  • Gloria Sabbatini
  • Valentina Truppa
  • Anna Bordonali
  • Fabrizio Taffoni
  • Domenico Formica
  • Gianluca Baldassarre
  • Marco Mirolli
  • Eugenio Guglielmelli
  • Elisabetta Visalberghi
Original Paper

Abstract

Animals have a strong propensity to explore the environment. Spontaneous exploration has a great biological significance since it allows animals to discover and learn the relation between specific behaviours and their consequences. The role of the contingency between action and outcome for learning has been mainly investigated in instrumental learning settings and much less in free exploration contexts. We tested 16 capuchin monkeys (Sapajus spp.) with a mechatronic platform that allowed complex modules to be manipulated and to produce different outcomes. Experimental subjects could manipulate the modules and discover the contingencies between their own specific actions and the outcomes produced (i.e., the opening and lighting of a box). By contrast, Control subjects could operate on the modules, but the outcomes experienced were those performed by their paired Experimental subjects (“yoked-control” paradigm). In the exploration phase, in which no food reward was present, Experimental subjects spent more time on the board and manipulated the modules more than Yoked subjects. Experimental subjects outperformed Yoked subjects in the following test phase, where success required recalling the effective action so to open the box, now baited with food. These findings demonstrate that the opportunity to experience action–outcome contingencies in the absence of extrinsic rewards promotes capuchins’ exploration and facilitates learning processes. Thus, this intrinsically motivated learning represents a powerful mechanism allowing the acquisition of skills and cognitive competence that the individual can later exploit for adaptive purposes.

Keywords

Learning Intrinsic motivation Contingency Mechatronic platform 

Supplementary material

10071_2014_740_MOESM1_ESM.docx (15 kb)
Supplementary material 1 (DOCX 15 kb)

Supplementary material 2 (MPG 1996 kb)

10071_2014_740_MOESM3_ESM.jpg (124 kb)
Supplementary material 3 (JPEG 123 kb)
10071_2014_740_MOESM4_ESM.jpg (46 kb)
Supplementary material 4 (JPEG 46 kb)

References

  1. Antunes M, Biala G (2012) The novel object recognition memory: neurobiology, test procedure, and its modifications. Cogn Process 13(2):93–110PubMedCentralPubMedCrossRefGoogle Scholar
  2. Baldassarre G, Mirolli M (2013a) Intrinsically motivated learning systems: an overview. In: Baldassarre G, Mirolli M (eds) Intrinsically motivated learning in natural and artificial systems. Springer, Berlin, pp 1–14CrossRefGoogle Scholar
  3. Baldassarre G, Mirolli M (2013b) Intrinsically motivated learning in natural and artificial systems. Springer, BerlinCrossRefGoogle Scholar
  4. Barto AG, Singh S, Chentanez N (2004) Intrinsically motivated learning of hierarchical collections of skills. In: Triesch J, Jebara T (eds) International conference on developmental learning (ICDL 2004). IEEE, Piscataway, pp 112–119Google Scholar
  5. Blatter K, Schultz W (2006) Rewarding properties of visual stimuli. Exp Brain Res 168(4):541–546PubMedCrossRefGoogle Scholar
  6. Buchanan-Smith HM, Badihi I (2011) The psychology of control: effects of control over supplementary light on welfare of marmosets. Appl Anim Behav Sci 137(3):166–174Google Scholar
  7. Butler RA (1954) Incentive conditions which influence visual exploration. J Exp Psychol 48(1):19PubMedCrossRefGoogle Scholar
  8. Butler RA (1957) Discrimination learning by rhesus monkeys to auditory incentives. J Comp Physiol Psychol 50(3):239–241PubMedCrossRefGoogle Scholar
  9. Byrne RW (2013) Animal curiosity. Curr Biol 23(11):469–471CrossRefGoogle Scholar
  10. Byrne G, Suomi S (1996) Individual differences in object manipulation in a colony of tufted capuchins. J Hum Evol 31(3):259–267CrossRefGoogle Scholar
  11. Capitanio JP, Mason WA (2000) Cognitive style: problem solving by rhesus macaques (Macaca mulatta) reared with living or inanimate substitute mothers. J Comp Psychol 114(2):115–125PubMedCrossRefGoogle Scholar
  12. Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36(2):285–298PubMedCrossRefGoogle Scholar
  13. Deci EL (1975) Intrinsic motivation. Plenum, New YorkCrossRefGoogle Scholar
  14. Fiorillo C (2004) The uncertain nature of dopamine. Mol Psychiatry 9(2):122–123PubMedCrossRefGoogle Scholar
  15. Fragaszy DM, Adams-Curtis LE (1991) Generative aspects of manipulation in tufted capuchin monkeys (Cebus apella). J Comp Psychol 105(4):387–397PubMedCrossRefGoogle Scholar
  16. Fragaszy DM, Boinski S (1995) Patterns of individual diet choice and efficiency of foraging in wedge-capped capuchin monkeys (Cebus olivaceus). J Comp Psychol 109(4):339–348PubMedCrossRefGoogle Scholar
  17. Fragaszy D, Visalberghi E, Fedigan L (2004) The complete capuchin: the biology of the genus Cebus. Cambridge University Press, CambridgeGoogle Scholar
  18. Glow PH, Winefield AH (1978) Response-contingent sensory change in a causally structured environment. Anim Learn Behav 6(1):1–18CrossRefGoogle Scholar
  19. Glow PH, Roberts JE, Russell A (1972) Sound and light preference behaviour in naïve adult rats. Aust J Psychol 24(2):173–178CrossRefGoogle Scholar
  20. Gunnar MR (1980a) Contingent stimulation: a review of its role in early development. In: Vevine S, Ursin H (eds) Coping and health. Plenum, New York, pp 101–119CrossRefGoogle Scholar
  21. Gunnar MR (1980b) Control, warning signals, and distress in infancy. Dev Psychol 16:281–289CrossRefGoogle Scholar
  22. Harlow HF, Harlow MK, Meyer DR (1950) Learning motivated by a manipulation drive. J Exp Psychol 40(2):228–234PubMedCrossRefGoogle Scholar
  23. Hooks MS, Kalivas PW (1994) Involvement of dopamine and excitatory amino acid transmission in novelty-induced motor activity. J Pharmacol Exp Ther 269(3):976–988PubMedGoogle Scholar
  24. Hughes RN (1997) Intrinsic exploration in animals: motives and measurement. Behav Process 41(3):213–226CrossRefGoogle Scholar
  25. Kish GB (1955) Learning when the onset of illumination is used as reinforcing stimulus. J Comp Physiol Psychol 48(4):261–264PubMedCrossRefGoogle Scholar
  26. Li S, Cullen WK, Anwyl R, Rowan MJ (2003) Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat Neurosci 6(5):526–531PubMedGoogle Scholar
  27. Lynch Alfaro JW, Boubli JP, Olson LE, Di Fiore A, Wilson B, Gutiérrez-Espeleta GA, Chiou KL, Schulte M, Neitzel S, Ross V, Schwochow D, Nguyen MTT, Farias I, Janson C, Alfaro ME (2012a) Explosive Pleistocene range expansion leads to widespread Amazonian sympatry between robust and gracile capuchin monkeys. J Biogeogr 39:272–288CrossRefGoogle Scholar
  28. Lynch Alfaro JW, Souza De, Silva J, Rylands AB (2012b) How different are robust and gracile capuchin monkeys? An argument for the use of Sapajus and Cebus. Am J Primatol 14:1–14Google Scholar
  29. Manrique HM, Sabbatini G, Call J, Visalberghi E (2011) Tool choice on the basis of rigidity in capuchin monkeys. Anim Cogn 14(6):775–786PubMedCrossRefGoogle Scholar
  30. Meyer ME, Collins MD (1971) Light deprivation and sensory reinforced behavior in chicks. Percept Mot Skills 32(2):602PubMedCrossRefGoogle Scholar
  31. Mineka S, Gunnar M, Champoux M (1986) Control and early socioemotional development: infant rhesus monkeys reared in controllable versus uncontrollable environments. Child Dev 57(5):1241–1256CrossRefGoogle Scholar
  32. Mirolli M, Baldassarre G (2013) Functions and mechanisms of intrinsic motivations. In: Baldassarre G, Mirolli M (eds) Intrinsically motivated learning in natural and artificial systems. Springer, Berlin, pp 49–72CrossRefGoogle Scholar
  33. Mirolli M, Santucci V, Baldassarre G (2013) Phasic dopamine as a prediction error signal of intrinsic and extrinsic reinforcements: a computational model. Neural Netw 39:40–51PubMedCrossRefGoogle Scholar
  34. Ottoni EB, Mannu M (2001) Semifree-ranging tufted capuchins (Cebus apella) spontaneously use tools to crack open nuts. Int J Primatol 22(3):347–358CrossRefGoogle Scholar
  35. Oudeyer PY, Kaplan F, Hafner VV (2007) Intrinsic motivation systems for autonomous mental development. IEEE Trans Evol Comput 11(2):265–286CrossRefGoogle Scholar
  36. Panger MA (1998) Object use in free-ranging white faced capuchins (Cebus capucinus) in Costa Rica. Am J Phys Anthropol 106(3):311–321PubMedCrossRefGoogle Scholar
  37. Pearce JM (2008) Animal learning and cognition: an introduction, 3rd edn. Psychology Press, HoveGoogle Scholar
  38. Perry S, Manson JH (2008) Manipulative monkeys. Harvard University Press, CambridgeGoogle Scholar
  39. Redgrave P, Gurney K (2006) The short-latency dopamine signal: a role in discovering novel actions? Nat Rev Neurosci 7(12):967–975PubMedCrossRefGoogle Scholar
  40. Reed P, Mitchell C, Nokes T (1996) Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task. Anim Learn Behav 24(1):38–45CrossRefGoogle Scholar
  41. Rescorla RA (1968) Probability of shock in the presence and absence of CS in fear conditioning. J Comp Physiol Psychol 66(1):1–5PubMedCrossRefGoogle Scholar
  42. Ryan RM, Deci EL (2000a) Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol 25(1):54–67PubMedCrossRefGoogle Scholar
  43. Ryan RM, Deci EL (2000b) Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 55(1):68–78PubMedCrossRefGoogle Scholar
  44. Schembri M, Mirolli M, Baldassarre G (2007) Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot. In: Proceedings of the 6th international conference on development and learning. Imperial College, London, pp E1–6Google Scholar
  45. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80(1):1–27PubMedGoogle Scholar
  46. Seligman ME, Maier SF (1967) Failure to escape traumatic shock. J Exp Psychol 74(1):1–9PubMedCrossRefGoogle Scholar
  47. Seligman ME, Rosellini RA, Kozak MJ (1975) Learned helplessness in the rat: time course, immunization, and reversibility. J Comp Physiol Psychol 88(2):542–547PubMedCrossRefGoogle Scholar
  48. Stafford T, Thirkettle M, Walton T, Vautrelle N, Hetherington L, Port M, Redgrave P (2012) A novel task for the investigation of action acquisition. PloS One 7(6):e37749PubMedCentralPubMedCrossRefGoogle Scholar
  49. StataCorp (2005) Stata Statistical Software: Release 9. StataCorp LP, College Station, TXGoogle Scholar
  50. Taffoni F, Vespignani M, Formica D, Cavallo G, Di Sorrentino EP, Sabbatini G, Truppa V, Mirolli M, Baldassarre G, Visalberghi E (2012) A mechatronic platform for behavioral analysis on nonhuman primates. J Integr Neurosci 11(01):87–101PubMedCrossRefGoogle Scholar
  51. Taffoni F, Tamilia E, Focaroli V, Formica D, Ricci L, Di Pino G, Baldassarre G, Mirolli M, Guglielmelli E, Keller F (2014) Development of goal-directed action selection guided by intrinsic motivations: an experiment with children. Exp Brain Res. doi:10.1007/s00221-014-3907-z PubMedGoogle Scholar
  52. Terborgh J (1983) Five new world primates: a study in comparative ecology. Princeton University Press, PrincetonGoogle Scholar
  53. Visalberghi E (1988) Responsiveness to objects in two social groups of tufted capuchin monkeys (Cebus apella). Am J Primatol 15(4):349–360CrossRefGoogle Scholar
  54. Visalberghi E, Fragaszy D (2013) The Etho–Cebus project: stone-tool use by wild capuchin monkeys. In: Sanz C, Call J, Boesch C (eds) Tool use in animals: cognition and ecology. Cambridge University Press, Cambridge, pp 203–223CrossRefGoogle Scholar
  55. White RW (1959) Motivation reconsidered: the concept of competence. Psychol Rev 66(5):297PubMedCrossRefGoogle Scholar
  56. Winefield AH, Glow PH (1980) Active versus passive control in sensory contingent bar pressing in rats. J Gen Psychol 103(1):27–40PubMedCrossRefGoogle Scholar
  57. Yang Z, Bertolucci F, Wolf R, Heisenberg M (2013) Flies cope with uncontrollable stress by learned helplessness. Curr Biol 23(9):799–803PubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Eugenia Polizzi di Sorrentino
    • 1
  • Gloria Sabbatini
    • 1
  • Valentina Truppa
    • 1
  • Anna Bordonali
    • 2
  • Fabrizio Taffoni
    • 3
  • Domenico Formica
    • 3
  • Gianluca Baldassarre
    • 4
  • Marco Mirolli
    • 4
  • Eugenio Guglielmelli
    • 3
  • Elisabetta Visalberghi
    • 1
  1. 1.Unit of Cognitive Primatology and Primate CenterISTC-CNRRomeItaly
  2. 2.Department of Life Sciences and Systems BiologyUniversity of TorinoTurinItaly
  3. 3.Laboratory of Biomedical Robotics and Biomicrosystems, Center for Integrated ResearchUniversità Campus Bio-MedicoRomeItaly
  4. 4.Laboratory of Computational Embodied NeuroscienceISTC-CNRRomeItaly

Personalised recommendations