Neuroscience and Behavioral Physiology

, Volume 27, Issue 4, pp 370–380 | Cite as

A systems process of reinforcement

  • K. V. Sudakov
Article
Received:
Accepted:

Abstract

Functional systems theory was used to consider the process of reinforcement in terms on the body of reinforcing factors, i.e., the results of behavior satisfying the body's original needs. The systems process of reinforcement includes reverse afferentation entering the CNS from receptors acted upon by various parameters of the desired results, and mechanisms for comparing reverse afferentation with the apparatus which accepts the results of the action and the corresponding emotional component. A tight interaction between reinforcement and the dominant motivation is generated on the basis of the hologram principle. Reinforcement forms an apparatus for predicting a desired result, i.e. a result-of-action acceptor. Reinforcement produces significant changes in the activities of individual neurons in the various brain structures involved in dominant motivation, transforming their spike activity for a burst pattern to regular discharges; there are also molecular changes in neuron properties. After preliminary reinforcement, the corresponding motivation induces the ribosomal system of neurons to start synthesizing special effector molecules, which organize molecular engrams of the acceptor of the action's result. Sensory mechanisms of reinforcement are considered, with particular reference to the information role of emotions.

Keywords

Conditioned Stimulus Ouabain Functional System Sensorimotor Cortex Apply Physiology 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    V. V. Andrianov, The Neurochemical Mechanisms of Involvement of Cerebral Cortex Neurons in Systems Organizing Food-Procuring Behavior [in Russian], Author's Abstract of Dissertation for Doctorate in Medical Sciences, P. K. Anokhin Science Research Institute of Normal Physiology, Moscow (1990).Google Scholar
  2. 2.
    V. V. Andrianov, “The effect of cycloheximide on the nature of brain neuron spike activity at different steps of a behavioral act: the restorative effect of lysine-vasopressin,” in: Experimental and Applied Physiology. Systems Mechanisms of Behavior. Proceedings of the Scientific Conference on Experimental and Applied Physiology [in Russian], Russian Academy of Medical Sciences, Moscow (1993), Vol. 2, p. 113.Google Scholar
  3. 3.
    K. V. Anokhin, The Role of Cholecystokinin in the Mechanisms of Food Satisfaction [in Russian], Author's Abstract of Dissertation for Doctorate in Medical Sciences, P. K. Anokhin Science Research Institute of Normal Physiology, Moscow (1984).Google Scholar
  4. 4.
    P. K. Anokhin, Foreword to: E. Gelhorn and J. Loughborrow, Emotions and Emotional Disturbances, [Russian translation], Mir, Moscow (1966), p. 5.Google Scholar
  5. 5.
    P. K. Anokhin, “Fundamental questions in the general theory of functional systems,” in: Philosophical Aspects of the Theory of Functional Systems, Selected Works [in Russian], Nauka, Moscow (1978), pp. 49–106.Google Scholar
  6. 6.
    P. K. Anokhin, Systems Mechanisms of Higher Nervous Activity. Selected Works [in Russian], Nauka, Moscow (1979).Google Scholar
  7. 7.
    A. F. Belov, A Systems Approach to Studies of Reinforcement as a System-Organizing Factor in the Formation of the Purposive Behavior of Animals. A Speech [in Russian], Ryazan' (1989).Google Scholar
  8. 8.
    G. A. Vartanyan and A. A. Pirogov, The Neurobiological Bases of Higher Nervous Activity [in Russian], Nauka, Leningrad (1991).Google Scholar
  9. 9.
    B. V. Zhuravlev, A. I. Shumilina, T. N. Loseva, and G. N. Rychkova, “Behavioral, vegetative, and electrophysiological correlates of the results-of-action acceptor apparatus,” Vestnik American SSSR No. 2, 46 (1985).Google Scholar
  10. 10.
    A. I. Esakov, Systems Mechanisms of Receptor Activity. Functional Systems of the Body [in Russian], Meditsina, Moscow (1987), p. 201.Google Scholar
  11. 11.
    A. V. Kotov, The Interaction of Food Motivational and Reinforcing Influences on Cerebral Cortex Neurons [in Russian], Author's Abstract of Dissertation for Doctorate in Medical Sciences, I. M. Sechenov Moscow Medical Institute No. I, Moscow (1973).Google Scholar
  12. 12.
    L. V. Krushinskii, The Biological Bases of Judgment Activity [in Russian], Izdatel'stvo MGU (Moscow State University Press), Moscow (1977).Google Scholar
  13. 13.
    A. V. Lisitskii, The Role of Food Motivational Excitation in the Convergent Properties of Sensorimotor Cortex Neurons [in Russian], Author's Abstract of Dissertation for Doctorate in Medical Sciences, Voronezh State University, Voronezh (1976).Google Scholar
  14. 14.
    Yu. A. Makarenko, The Systems Organization of Emotional Behavior [in Russian], Meditsina, Moscow (1980).Google Scholar
  15. 15.
    E. S. Petrov and A. A. Lebedev, “Dopamine and the reinforcing systems of the brain,” Fiziol. Zh. I. M. Sechenova,81, No. 8, 135 (1995).Google Scholar
  16. 16.
    Yu. N. Samko, “Conditioned active escape reflexes in rats after treatment with 8-azaguanine and leu-enkephalin,” Zh. Vyssh. Nerv. Deyat.,42, No. 5, 1031 (1992).Google Scholar
  17. 17.
    P. V. Simonov, “The reflex theory of behavior,” in: Ninth Sechenov Readings [in Russian], I. M. Sechenov Moscow Medical Institute No. I, Moscow (1984).Google Scholar
  18. 18.
    P. G. Snyakin, “The functional mobility of receptors,” Usp. Fiziol. Nauk,2, No. 3, 32 (1971).Google Scholar
  19. 19.
    K. V. Sudakov, Biological motivation [in Russian], Meditsina, Moscow (1971).Google Scholar
  20. 20.
    K. V. Sudakov, A General Theory of Functional Systems [in Russian], Meditsina, Moscow (1984).Google Scholar
  21. 21.
    K. V. Sudakov, “Oligopeptides in systems mechanisms of behavior,” in: Physiologically Active Peptides [in Russian], Scientific Center for Biological Studies, Academy of Sciences of the USSR, Pushchino (1988), p. 68.Google Scholar
  22. 22.
    K. V. Sudakov, “Holographic homologies of biological motivation in the systems organization of behavioral acts,” Zh. Vyssh. Nerv. Deyat.,38, No. 1, 10 (1988).Google Scholar
  23. 23.
    K. V. Sudakov, “Systems functions of the brain in conditions of blockade of protein and oligopeptide synthesis,” Vestnik RAMN, No. 7, 40 (1992).Google Scholar
  24. 24.
    K. V. Sudakov, “Quantum vital activity,” Usp. Sovrem. Biol.,112, No. 4, 12 (1992).Google Scholar
  25. 25.
    K. V. Sudakov, Selected Lectures in Normal Physiology [in Russian], Erus, Moscow (1992).Google Scholar
  26. 26.
    K. V. Sudakov, “Functional systems in normal conditions and pathology,” in: Experimental and Applied Physiology. Systems Mechanisms of Behavior. Proceedings of the Scientific Conference on Experimental and Applied Physiology [in Russian], Russian Academy of Medical Sciences, Moscow, Vol. 2, p. 17.Google Scholar
  27. 27.
    K. V. Sudakov, “Motivation and reinforcement in systems mechanisms of behavior: dynamic reinforcement engrams,” Zh. Vyssh. Nerv. Deyat.,45, No. 6, 627 (1995).Google Scholar
  28. 28.
    K. V. Sudakov, “The neurochemical nature of depressive excitation in brain structures in emotional stress,” Patol. Fiziol. Éksp. Terap., No. 1, 3 (1995).Google Scholar
  29. 29.
    K. V. Sudakov, “The information principle in physiology: analysis from the point of view of the general theory of functional systems,” Usp. Fiziol. Nauk.,26, No. 4, 3 (1995).PubMedGoogle Scholar
  30. 30.
    K. V. Sudakov and V. I. Badikov, “The defensive behavior of rabbits in conditions of bradykinin and cycloheximide treatment,” Fiziol. Zh. I. M. Sechenova,78, No. 9, 1 (1992).Google Scholar
  31. 31.
    K. V. Sudakov, N. A. Salukvadze, and L. A. Nedel'kina, “Mechanisms for the distribution of ascending activating influences of the food center of the lateral hypothalamus on the cerebral cortex,” Fiziol. Zh. SSSR No. 8, 1099 (1971).Google Scholar
  32. 32.
    S. K. Sudakov, “Disturbances in the food behavior of rabbits after intracerebroventricular administration of anti-gastrin immunoglobulins,” Zh. Vyssh. Nerv. Deyat.,36, No. 2, 391 (1986).Google Scholar
  33. 33.
    S. K. Sudakov, “Molecular mechanisms of memory in the systems organization of behavioral acts,” in: Functional Systems of the Body [in Russian], Meditsina, Moscow (1987), p. 167.Google Scholar
  34. 34.
    S. K. Sudakov and E. A. Shumova, “The effect of central administration of synthetic fragments of gastrin on food behavior in rabbits,” Zh. Vyssh. Nerv. Deyat.,36, No. 6 (1987).Google Scholar
  35. 35.
    N. Tinbergen in: Animal Behavior [in Russian], K. Fabri (ed.), Moscow (1969).Google Scholar
  36. 36.
    S. M. Tolpygo, Yu. S. Komarov, A. V. Kotov, et al., “Beta-lipotropin as a factor in food motivation,” Byull. Éksp. Biol. Med.,92, No. 12, 643 (1981).Google Scholar
  37. 37.
    I. V. Tomilina and A. N. Kravtsov, “The responses of sensorimotor cortex neurons to stimulation of the ‘hunger center’ of the lateral hypothalamus after microiontophoretic application of ouabain,” in: Experimental and Applied Physiology. Systems Mechanisms of Behavior. Proceedings of the Scientific Conference on Experimental and Applied Physiology [in Russian], Russian Academy of Medical Sciences, Moscow (1993), Vol. 2, p. 149.Google Scholar
  38. 38.
    M. M. Khananashvili, “Informational pathology of behavior and some mechanisms of the self-regulation of higher nervous activity,” Fiziol. Chelov.,10, No. 5, 778 (1984).Google Scholar
  39. 39.
    R. Haydn, Animal Behavior [Russian translation], Mir, Moscow (1975).Google Scholar
  40. 40.
    N. N. Shamaev, “Spike activity of orbital cortex and lateral hypothalamus neurons during food behavior,” in: Neurons in Behavior: Systems Aspects [in Russian], Nauka, Moscow (1985), p. 35.Google Scholar
  41. 41.
    O. F. X. Almeida and T. S. Shippenberg, Neurobiology of Opioids (1990).Google Scholar
  42. 42.
    J. D. Beitner, X. Guitart, and E. J. Nestler, “Common intracellular actions of chronic morphine and cocaine in dopaminergic brain reward region,” Neurobiol. Drug Alcohol Addition.,654, 70 (1992).Google Scholar
  43. 43.
    R. W. Brosemer, “Effects of inhibitors of Na+/K+-ATPase on the membrane potentials and neurotransmitter efflux in rat brain slices,” Brain Res.,334, 125 (1985).PubMedCrossRefGoogle Scholar
  44. 44.
    D. Hebb, “Drives and the CNS (Conceptual nervous system),” Psychol. Rev.,62, 243 (1955).PubMedCrossRefGoogle Scholar
  45. 45.
    R. Hernandez-Peon, “Reticular mechanisms of sensory control,” in: Sensory Communication, W. A. Rosenblith (ed.), MIT Press (1962), p. 497.Google Scholar
  46. 46.
    G. Horn, Physiological and Psychological Aspects of Selective Perception, D. S. Lehrman et al. (eds.), Academic Press, New York (1965).Google Scholar
  47. 47.
    D. H. Hubel and T. N. Wiesel, “Receptive fields of single neurons in the cat's striate cortex,” J. Physiol.,148, 574 (1959).PubMedGoogle Scholar
  48. 48.
    G. F. Koob, “Drugs of abuse: pharmacology and function of reward pathways,” J. Trends Pharmacol. Sci.,13, No. 5, 177 (1992).CrossRefGoogle Scholar
  49. 49.
    A. N. Kravtzov, S. K. Sudakov, Bhattacharja, et al., “Changes in the responses of the neurons of the sensorimotor cortex to stimulation of the hunger center in the lateral hypothalamus,” Biomed. Sci., No. 2, 357 (1991).Google Scholar
  50. 50.
    R. B. Livingston, “Central control of receptors and sensory transmission system,” in: Handbook of Physiology and Neurophysiology, H. W. Field et al., (eds.), Williams and Wilkins, Baltimore (1959), Vol. 1, No. 1, p. 741.Google Scholar
  51. 51.
    K. Lorenz, “Die Entwicklung der Vergleichenden Verhaltensforschung in den letzten 12 Jahren,” Zoo. Anreid., Suppl.,17, 36 (1953).Google Scholar
  52. 52.
    S. M. McCann, C. R. Franci, and J. Antunes-Rodrigues, “Hormonal control of water and electrolyte intake and output,” Acta Phys. Scand.,136, Suppl. 583, 97 (1989).Google Scholar
  53. 53.
    M. F. McDonnel and J. F. Flynn, “Control of sensory fields by stimulation of the hypothalamus,” Science,3727, No. 152, 1406 (1966).Google Scholar
  54. 54.
    B. Mareska and A. R. Cassins, “Fat feedback and fluidity,” Monthly Nature,1, No. 10, 22 (1993).Google Scholar
  55. 55.
    S. Olds, “Hypothalamic substrate of reward,” Physiol. Rev.,42, 554 (1962).PubMedGoogle Scholar
  56. 56.
    Y. Oomura, “Chemical and neuronal factors affecting feeding behavior,” J. Cell. Biochem.,13E, Suppl., 227 (1983).Google Scholar
  57. 57.
    Y. Oomura, K. Sasaki, and A. Li, “Functional correlation between food intake and memory facilitation,” in: Physiological and Biochemical Basis of Brain Activity, Abstracts of International Symposium, St. Petersburg, June 22–24 (1994), p. 5.Google Scholar
  58. 58.
    R. B. Rothman, “A review of the anti-opioid peptides in morphine tolerance and dependence,” J. Synapse, No. 2, 129 (1992).CrossRefGoogle Scholar
  59. 59.
    K. V. Sudakov, “Oligopeptides in organization of hypothalamically induced behavior,” Acta Physiol. Scand.,136, Suppl. 583, 35 (1989).Google Scholar
  60. 60.
    A. B. Steffens, G. J. Mogenson, and J. A. Stevenson, “Blood glucose, insulin and free fatty acids after stimulation and lesions of the hypothalamus,” Am. J. Physiol.,222, No. 6, 1446 (1972).PubMedGoogle Scholar

Copyright information

© Plenum Publishing Corporation 1997

Authors and Affiliations

  • K. V. Sudakov

There are no affiliations available

Personalised recommendations