Advertisement

Biological Cybernetics

, 100:159 | Cite as

Parabolic movement primitives and cortical states: merging optimality with geometric invariance

  • Felix PolyakovEmail author
  • Eran Stark
  • Rotem Drori
  • Moshe Abeles
  • Tamar Flash
Original Paper

Abstract

Previous studies have suggested that several types of rules govern the generation of complex arm movements. One class of rules consists of optimizing an objective function (e.g., maximizing motion smoothness). Another class consists of geometric and kinematic constraints, for instance the coupling between speed and curvature during drawing movements as expressed by the two-thirds power law. It has also been suggested that complex movements are composed of simpler elements or primitives. However, the ability to unify the different rules has remained an open problem. We address this issue by identifying movement paths whose generation according to the two-thirds power law yields maximally smooth trajectories. Using equi-affine differential geometry we derive a mathematical condition which these paths must obey. Among all possible solutions only parabolic paths minimize hand jerk, obey the two-thirds power law and are invariant under equi-affine transformations (which preserve the fit to the two-thirds power law). Affine transformations can be used to generate any parabolic stroke from an arbitrary parabolic template, and a few parabolic strokes may be concatenated to compactly form a complex path. To test the possibility that parabolic elements are used to generate planar movements, we analyze monkeys’ scribbling trajectories. Practiced scribbles are well approximated by long parabolic strokes. Of the motor cortical neurons recorded during scribbling more were related to equi-affine than to Euclidean speed. Unsupervised segmentation of simulta- neously recorded multiple neuron activity yields states related to distinct parabolic elements. We thus suggest that the cortical representation of movements is state-dependent and that parabolic elements are building blocks used by the motor system to generate complex movements.

Keywords

Drawing primitives Equi-affine geometry Geometric invariants Neural representation Hidden Markov modeling 

References

  1. Abeles M, Bergman H, Gat I, Meilijson I, Seidemann E, Tishby N, Vaadia E (1995) Cortical activity flips among quasi-stationary states. Proc Natl Acad Sci USA 92: 8616–620CrossRefPubMedGoogle Scholar
  2. Averbeck BB, Chafee MV, Crowe DA, Georgopoulos AP (2002) Parallel processing of serial movements in prefrontal cortex. Proc Natl Acad Sci USA 99: 13172–3177CrossRefPubMedGoogle Scholar
  3. Averbeck BB, Crowe DA, Chafee MV, Georgopoulos AP (2003) Neural activity in prefrontal cortex during copying geometrical shapes II. Decoding shape segments from neural ensembles. Exp Brain Res 150: 142–53PubMedGoogle Scholar
  4. Ben-Shaul Y, Drori R, Asher I, Stark E, Nadasdy Z, Abeles M (2004) Neuronal activity in motor cortical areas reflects the sequential context of movement. J Neurophysiol 91: 1748–762CrossRefPubMedGoogle Scholar
  5. Biess A, Liebermann DG, Flash T (2007) Computational model for redundant human 3D pointing movements: integration of independent spatial and temporal motor plans simplifies movement dynamics. J Neurosci 48: 13045–3064CrossRefGoogle Scholar
  6. Bizzi E, Mussa-Ivaldi FA, Giszter S (1991) Computations underlying the execution of movement—a biological perspective. Science 253: 287–91CrossRefPubMedGoogle Scholar
  7. Bright I (2007) Motion planning through optimization. MSc Thesis, Weizmann Institute of ScienceGoogle Scholar
  8. Bring J (1996) A geometric approach to compare variables in a regression model. Am Stat 50: 57–2CrossRefGoogle Scholar
  9. Brockwell A, Kass RE, Schwartz AB (2007) Statistical signal processing and the motor cortex. Proc IEEE 95: 881–98CrossRefGoogle Scholar
  10. Burdet E, Milner TE (1998) Quantization of human motions and learning of accurate movements. Biol Cybern 78: 307–18CrossRefPubMedGoogle Scholar
  11. Calabi E, Olver PJ, Tannebaum AT (1996) Affine geometry, curve flows, and invariant numerical approximations. Adv Math 124: 154–96CrossRefGoogle Scholar
  12. Calabi E, Olver PJ, Shakiban C, Tannenbaum A, Haker S (1998) Differential and numerically invariant signature curves applied to object recognition. Int J Comp Vis 26: 107–35CrossRefGoogle Scholar
  13. Carpenter AF, Georgopoulos AP, Pellizzer G (1999) Motor cortical encoding of serial order in a context-recall task. Science 283: 1752–757CrossRefPubMedGoogle Scholar
  14. Craizer M, Lewiner T, Morvan J-M (2007) Combining points and tangents into parabolic polygons. J Math Imaging Vis 29: 131–40CrossRefGoogle Scholar
  15. d’Avella A, Bizzi E (2005) Shared and specific muscle synergies in natural motor behaviors. Proc Natl Acad Sci USA 102: 3076–081CrossRefPubMedGoogle Scholar
  16. d’Avella A, Saltiel P, Bizzi E (2003) Combinations of muscle synergies in the construction of a natural motor behavior. Nat Neurosci 6: 300–08CrossRefPubMedGoogle Scholar
  17. d’Avella A, Portone A, Fernandez L, Lacquaniti F (2006) Control of fast-reaching movements by muscle synergy combinations. J Neurosci 26: 7791–810CrossRefPubMedGoogle Scholar
  18. Dayan E, Casile A, Levit-Binnun N, Giese MA, Hendler T, Flash T (2007) Neural representations of kinematic laws of motion: evidence for action-perception coupling. Proc Natl Acad Sci USA 104: 20582–0587CrossRefPubMedGoogle Scholar
  19. Dounskaia N (2007) Kinematic invariants during cyclical arm movements. Biol Cybern 96: 147–63CrossRefPubMedGoogle Scholar
  20. Fishbach A, Roy SA, Bastianen C, Miller LE, Houk JC (2005) Kinematic properties of on-line error corrections in the monkey. Exp Brain Res 164: 442–57CrossRefPubMedGoogle Scholar
  21. Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5: 1688–703PubMedGoogle Scholar
  22. Flash T, Henis E (1991) Arm trajectory modifications during reaching towards visual targets. J Cogn Neurosci 3: 220–30CrossRefGoogle Scholar
  23. Flash T, Hochner B (2005) Motor primitives in vertebrates and invertebrates. Curr Opin Neurobiol 15: 660–66CrossRefPubMedGoogle Scholar
  24. Flash T, Handzel AA (2007) Affine differential geometry analysis of human arm movements. Biol Cybern 96: 577–01CrossRefPubMedGoogle Scholar
  25. Gat I, Tishby N (1993) Statistical modeling of cell assemblies activities in associative cortex of behaving monkeys. In: Hanson SJ, Cowan JD, Giles SL(eds) Neural information processing systems, vol 5. Denver, Colorado, pp 945–53Google Scholar
  26. Gat I, Tishby N, Abeles M (1997) Hidden Markov modelling of simultaneously recorded cells in the associative cortex of behaving monkeys. Netw Comput Neural Syst 8: 297–22CrossRefGoogle Scholar
  27. Gelfand I, Fomin S (1963) Calculus of variations. Prentice-Hall, Englewood CliffsGoogle Scholar
  28. Giszter SF, Mussa-Ivaldi FA, Bizzi E (1993) Convergent force fields organized in the frog’s spinal cord. J Neurosci 13: 467–91PubMedGoogle Scholar
  29. Giszter S, Patil V, Hart C (2007) Primitives, premotor drives, and pattern generation: a combined computational and neuroethological perspective. Prog Brain Res 165: 323–46CrossRefPubMedGoogle Scholar
  30. Gribble PL, Ostry DJ (1996) Origins of the power law relation between movement velocity and curvature: modeling the effects of muscle mechanics and limb dynamics. J Neurophysiol 76: 2853–2860PubMedGoogle Scholar
  31. Guggenheimer HW (1977) Differential geometry. Dover, New YorkGoogle Scholar
  32. Handzel A, Flash T (1999) Geometric methods in the study of human motor control. Cogn Stud 6: 309–21Google Scholar
  33. Handzel A, Flash T (2001) Affine invariant edge completion with affine geodesics. In: IEEE workshop on variational and level set methods, Vancouver, Canada, pp 97–03Google Scholar
  34. Harris CM, Wolpert DM (1998) Signal-dependent noise determines motor planning. Nature 394: 780–84CrossRefPubMedGoogle Scholar
  35. Harris CM, Wolpert DM (2006) The main sequence of saccades optimizes speed-accuracy trade-off. Biol Cybern 95: 21–9CrossRefPubMedGoogle Scholar
  36. Hart CB, Giszter SF (2004) Modular premotor drives and unit bursts as primitives for frog motor behaviors. J Neurosci 24: 5269–282CrossRefPubMedGoogle Scholar
  37. Hatsopoulos NG, Paininski L, Donoghue JP (2003) Sequential movement representations based on correlated neuronal activity. Exp Brain Res 149: 478–86PubMedGoogle Scholar
  38. Hatsopoulos NG, Xu Q, Amit Y (2007) Encoding of movement fragments in the motor cortex. J Neurosci 27: 5105–114CrossRefPubMedGoogle Scholar
  39. Hebb DO (1949) The organization of behavior. Wiley, New YorkGoogle Scholar
  40. Hogan N (1984) An organizing principle for a class of voluntary movements. J Neurosci 4: 2745–754PubMedGoogle Scholar
  41. Ivanenko YP, Grasso R, Macellari V, Lacquaniti F (2002) Two-thirds power law in human locomotion: role of ground contact forces. Neuroreport 13: 1171–174CrossRefPubMedGoogle Scholar
  42. Ivanenko YP, Poppele RE, Lacquaniti F (2004) Five basic muscle activation patterns account for muscle activity during human locomotion. J Physiol 556: 267–82CrossRefPubMedGoogle Scholar
  43. Ivanenko YP, Cappellini G, Dominici N, Poppele RE, Lacquaniti F. (2005) Coordination of locomotion with voluntary movements in humans. J Neurosci 25: 7238–253CrossRefPubMedGoogle Scholar
  44. Jackson A, Mavoori J, Fetz EE (2006) Long-term motor cortex plasticity induced by an electronic neural implant. Nature 444: 56–0CrossRefPubMedGoogle Scholar
  45. Johnson MTV, Coltz JD, Ebner TJ (1999) Encoding of target direction and speed during visual instruction and arm tracking in dorsal premotor and primary motor cortical neurons. Eur J Neurosci 11: 4433–445CrossRefPubMedGoogle Scholar
  46. Jones LM, Fontanini A, Sadacca BF, Miller P, Katz DB (2007) Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proc Natl Acad Sci USA 104: 18772–8777CrossRefPubMedGoogle Scholar
  47. Kargo WJ, Giszter SF (2000) Rapid correction of aimed movements by summation of force-field primitives. J Neurosci 20: 409–26PubMedGoogle Scholar
  48. Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2003) Spontaneously emerging cortical representations of visual attributes. Nature 425: 954–56CrossRefPubMedGoogle Scholar
  49. Kording KP, Wolpert DM (2006) Bayesian decision theory in sensorimotor control. Trends Cogn Sci 10: 319–26CrossRefPubMedGoogle Scholar
  50. Krebs HI, Aisen MI, Volpe BT, Hogan N (1999) Quantization of continuous arm movements in humans with brain injury. Proc Natl Acad Sci USA 96: 4645–649CrossRefPubMedGoogle Scholar
  51. Lacquaniti F, Terzuolo C, Viviani P (1983) The law relating the kinematic and figural aspects of drawing movements. Acta Psychol (Amst) 54: 115–30CrossRefGoogle Scholar
  52. Levit-Binnun N, Schechtman E, Flash T (2006) On the similarities between the perception and production of elliptical trajectories. Exp Brain Res 172: 533–55CrossRefPubMedGoogle Scholar
  53. Maoz U (2007) Trajectory formation and units of action, from two- to three-dimensional motion. PhD Thesis, The Hebrew University of JerusalemGoogle Scholar
  54. Maoz U, Berthoz A, Flash T (2008) Complex unconstrained three-dimensional arm movement and constant equi-affine speed. J Nurohysiol. doi: 10.1152/jn.90702.2008
  55. Moran DW, Schwartz AB (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol 82: 2676–2692PubMedGoogle Scholar
  56. Morasso P (1981) Spatial control of arm movements. Exp Brain Res 42: 223–27CrossRefPubMedGoogle Scholar
  57. Morasso P, Mussa Ivaldi FA (1982) Trajectory formation and handwriting: a computational model. Biol Cybern 45: 131–42CrossRefPubMedGoogle Scholar
  58. Mussa-Ivaldi FA, Bizzi E (2000) Motor learning through the combination of primitives. Philos Trans R Soc Lond B Biol Sci 355: 1755–769CrossRefPubMedGoogle Scholar
  59. Mussa-Ivaldi FA, Solla SA (2004) Neural primitives for motion control. IEEE J Ocean Eng 29: 640–50CrossRefGoogle Scholar
  60. Nakano E, Imamizu H, Osu R, Uno Y, Gomi H, Yoshioka T, Kawato M (1999) Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. J Neurophysiol 81: 2140–155PubMedGoogle Scholar
  61. Nichols TR (1994) A biomechanical perspective on spinal mechanisms of coordinated muscular action: an architecture principle. Acta Anatomica 151: 1–3PubMedGoogle Scholar
  62. Osu R, Kamimura N, Iwasaki H, Nakano E, Harris CM, Wada Y, Kawato M (2004) Optimal impedance control for task achievement in the presence of signal-dependent noise. J Neurophysiol 92: 1199–215CrossRefPubMedGoogle Scholar
  63. Paninski L, Shoham S, Fellows MR, Hatsopoulos NG, Donoghue JP (2004) Superlinear population encoding of dynamic hand trajectory in primary motor cortex. J Neurosci 24: 8551–561CrossRefPubMedGoogle Scholar
  64. Pollick FE, Sapiro G (1997) Constant affine velocity predicts the 1/3 power law of planar motion perception and generation. Vis Res 37: 347–53CrossRefPubMedGoogle Scholar
  65. Pollick FE, Maoz U, Handzel AA, Giblin PJ, Sapiro G, Flash T (2008) Three-dimensional arm movements at constant equi-affine speed. Cortex (in press). doi: 10.1016/j.cortex.2008.03.010
  66. Polyakov F (2001) Analysis of monkey scribbles in the framework of models of planar hand motion. MSc Thesis, Weizmann Institute of Science. http://www.wisdom.weizmann.ac.il/~felix/texts/polyakov_thesis_msc.pdf(cited on June 18, 2008)
  67. Polyakov F (2006) Motion primitives and invariants in monkey scribbling movements: analysis and mathematical modeling of movement kinematics and neural activities. PhD Thesis, Weizmann Institute of Science. http://www.wisdom.weizmann.ac.il/~felix/texts/polyakov_thesis_phd.pdf(cited on May 29, 2008)
  68. Polyakov F, Flash T, Abeles M, Ben-Shaul Y, Drori R, Nadasdy Z (2001) Analysis of motion planning and learning in monkey scribbling movements. In: Meulenbrouk R, Steenbergen B (eds) Proceedings of the 10th biennial conference of the International Graphonomics Society. The University of Nijmegen, Nijmegen, The Netherlands. pp 78–3. http://www.wisdom.weizmann.ac.il/~felix/texts/IGS2001.pdf(cited on June 18, 2008)
  69. Reina GA, Schwartz AB (2003) Eye–hand coupling during closed-loop drawing: Evidence of shared motor plans?. Hum Mov Sc 22: 137–52CrossRefGoogle Scholar
  70. Richardson MJ, Flash T (2002) Comparing smooth arm movements with the two-thirds power law and the related segmented-control hypothesis. J Neurosci 22: 8201–211PubMedGoogle Scholar
  71. Rohrer B, Hogan N (2003) Avoiding spurious submovement decompositions: a globally optimal algorithm. Biol Cybern 89: 190–99CrossRefPubMedGoogle Scholar
  72. Rohrer B, Hogan N (2006) Avoiding spurious submovement decompositions II: a scattershot algorithm. Biol Cybern 94: 409–14CrossRefPubMedGoogle Scholar
  73. Sanger TD (2000) Human arm movements described by a low-dimensional superposition of principal components. J Neursci 20: 1066–072Google Scholar
  74. Schaal S, Sternad D (2001) Origins and violations of the two-thirds power law in rhythmic three-dimensional arm movements. Exp Brain Res 136: 60–2CrossRefPubMedGoogle Scholar
  75. Schwartz AB (1992) Motor cortical activity during drawing movements—single-unit activity during sinusoid tracing. J Neurophysiol 68: 528–41PubMedGoogle Scholar
  76. Schwartz AB (1994) Direct cortical representation of drawing. Science 265: 540–42CrossRefPubMedGoogle Scholar
  77. Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6: 461–64CrossRefGoogle Scholar
  78. Scott SH (2004) Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5: 532–46CrossRefPubMedGoogle Scholar
  79. Sergio LE, Hamel-Paquet C, Kalaska JF (2005) Motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks. J Neurophysiol 94: 2353–378CrossRefPubMedGoogle Scholar
  80. Shirokov PA, Shirokov AP (1959) Affine differential geometry (in Russian). GIFML, MoscowGoogle Scholar
  81. Soechting JF, Terzuolo CA (1987a) Organization of arm movements. Motion is segmented. Neuroscience 23: 39–1CrossRefPubMedGoogle Scholar
  82. Soechting JF, Terzuolo CA (1987b) Organization of arm movements in three-dimensional space. Wrist motion is piecewise planar. Neuroscience 23: 53–1CrossRefPubMedGoogle Scholar
  83. Sosnik R, Hauptmann B, Karni A, Flash T (2004) When practice leads to co-articulation: the evolution of geometrically defined movement primitives. Exp Brain Res 156: 422–38CrossRefPubMedGoogle Scholar
  84. Spivak MA (1999) A comprehensive introduction to differential geometry. Publish or Perish Inc., BerkeleyGoogle Scholar
  85. Stark E, Drori R, Asher I, Ben-Shaul Y, Abeles M (2007) Distinct movement parameters are represented by different neurons in the motor cortex. Eur J Neurosci 26: 1055–066CrossRefPubMedGoogle Scholar
  86. Sternad D, Schaal S (1999) Segmentation of endpoint trajectories does not imply segmented control. Exp Brain Res 124: 118–36CrossRefPubMedGoogle Scholar
  87. Tanaka H, Krakauer JW, Qian N (2006) An optimization principle for determining movement duration. J Neurophysiol 95: 3875–3886CrossRefPubMedGoogle Scholar
  88. Thoroughman KA, Shadmehr R (2000) Learning of action through adaptive combination of motor primitives. Nature 407: 742–47CrossRefPubMedGoogle Scholar
  89. Todd JT, Oomes AH, Koenderink JJ, Kappers AM (2001) On the affine structure of perceptual space. Psychol Sci 12: 191–96CrossRefPubMedGoogle Scholar
  90. Todorov E (2004) Optimality principles in sensorimotor control. Nat Neurosci 7: 907–15CrossRefPubMedGoogle Scholar
  91. Todorov E, Jordan MI (1998) Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. J Neurophysiol 80: 696–14PubMedGoogle Scholar
  92. Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226–235CrossRefPubMedGoogle Scholar
  93. Torres E, Andersen R (2006) Space-time separation during obstacle-avoidance learning in monkeys. J Neurophysiol 96: 2613–632CrossRefPubMedGoogle Scholar
  94. Tresch MC, Saltiel P, Bizzi E (1999) The construction of movement by the spinal cord. Nat Neurosci 2: 162–67CrossRefPubMedGoogle Scholar
  95. Uno Y, Kawato M, Suzuki R (1989) Formation and control of optimal trajectory in human multijoint arm movement—minimum torque-change model. Biol Cybern 61: 89–01CrossRefPubMedGoogle Scholar
  96. Viviani P (1986) Do units of motor action really exist?. In: Heuer H, Fromm C(eds) Generation and modulation of action patterns. Springer, Berlin, pp 201–16Google Scholar
  97. Viviani P, Cenzato M (1985) Segmentation and coupling in complex movements. J Exp Psychol Hum Percept Perform 11: 828–45CrossRefPubMedGoogle Scholar
  98. Viviani P, Flash T (1995) Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. J Exp Psychol Hum Percept Perform 21: 32–3CrossRefPubMedGoogle Scholar
  99. Viviani P, Stucchi N (1992) Biological movements look uniform: evidence of motor-perceptual interactions. J Exp Psychol Hum Percept Perform 18: 603–23CrossRefPubMedGoogle Scholar
  100. Wu W, Black MJ, Mumford D, Gao Y, Bienenstock E, Donoghue JP (2004) Modeling and decoding motor cortical activity using a switching Kalman filter. IEEE Trans Biomed Eng 51: 933–42CrossRefPubMedGoogle Scholar
  101. Zuylen EJ, Gielen CC, Gon Denier JJ (1988) Coordination and inhomogeneous activation of human arm muscles during isometric torques. J Neurophysiol 60: 1523–548PubMedGoogle Scholar

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  • Felix Polyakov
    • 1
    Email author
  • Eran Stark
    • 2
  • Rotem Drori
    • 2
  • Moshe Abeles
    • 2
    • 3
  • Tamar Flash
    • 1
  1. 1.Department of Computer Science and Applied MathematicsWeizmann Institute of ScienceRehovotIsrael
  2. 2.Department of Physiology, Hadassah Medical SchoolHebrew UniversityJerusalemIsrael
  3. 3.Gonda Brain Research CenterBar-Ilan UniversityRamat-GanIsrael

Personalised recommendations