Abstract
This chapter outlines the design of software for embedded control of robotic marionettes using choreography. In traditional marionette puppetry, the puppets often possess dynamics that are quite different from the creatures they imitate. Puppeteers must therefore understand and leverage the inherent dynamics of the puppets to create believable and expressive characters. Because marionettes are actuated by strings, the mechanical description of the marionettes either creates a multiscale or degenerate system—making simulation of the constrained dynamics challenging. Moreover, marionettes have 40–50 degrees of freedom with closed kinematic chains. Generating puppet choreography that is mimetic (that is, recognizably human) results in a high-dimensional nonlinear optimal control problem that must be solved for each motion. In performance, these motion primitives must be combined in a way that preserves stability, resulting in an optimal timing control problem. Our software accounts for the efficient computation of the (1) discrete time dynamics that preserve the constraints and other integrals of motion, (2) nonlinear optimal control policies (including optimal control of LTV systems), and (3) optimal timing of choreography, all within a single framework. We discuss our current results and the potential application of our findings across disciplines, including the development of entertainment robots and autonomous theater.
This material is based upon work supported by the National Science Foundation under award IIS-0917837. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Goodman N (1978) Ways of worldmaking. Hackett Publishing, Indianapolis
Kant I (1911) Critique of aesthetic judgement (1790). Oxford University Press, Oxford
Schiller F (1794) On the aesthetic education of man. Oxford University Press, Oxford
Smith R (2008) Open dynamics engine. http://www.ode.org
Smith R (2004) Dynamics simulation: a whirlwind tour (current state, and new frontiers). http://ode.org/slides/parc/dynamics.pdf
Baraff D (1996) Linear-time dynamics using Lagrange multipliers. In: SIGGRAPH, pp 137–146
Baraff D (1994) Fast contact force computation for nonpenetrating rigid bodies. In: SIGGRAPH
Baraff D (1993) Non-penetrating rigid body simulation. In: State of the Art Reports
Featherstone R (1987) Robot dynamics algorithms. Kluwer Academic Publishers, Boston. The Springer International Series in Engineering and Computer Science Vol 22, Springer US New York
Francis P (2012) Puppetry. Palgrave Macmillan, London
Kleist H (1972) On the marionette theatre. Drama Rev 16(3):22–26
Craig EG (2009) On the art of the theatre. Routledge, London
Kaplin S (1999) A puppet tree: a model for the field of puppet theatre. TDR 43(3):28–35
Jochum E (2013) King kong by Craig Lucas and Marius de Vries (review). Theatre J 65(4):580–582
Burnham J (1968) Beyond modern sculpture: the effects of science and technology on the sculpture of this century. George Braziller, New York
Salter C (2010) Entangled: technology and the transformation of performance. MIT Press, Cambridge
Wood G (2002) Edison’s Eve: a magical history of the quest for mechanical life. A.A. Knopf, New York
Jurkowski H (1988) Aspects of puppet theatre. Puppet Centre Trust, London
Johnson E, Murphey T (2007) Dynamic modeling and motion planning for marionettes: Rigid bodies articulated by massless strings. In: International conference on robotics and automation, Vol 2007. Rome
Johnson ER, Murphey TD (2010) Scalable variational integrators for constrained mechanical systems in generalized coordinates. IEEE Trans Rob. 25(6):1249–1261
Bullo F, Lewis A (2005) Low-order controllability and kinematic reductions for affine connection control systems. SIAM J Control Optim 44(3):885–908
Bullo F, Lewis A (2004) Geometric control of mechanical systems, ser. number 49 in texts in applied mathematics. Springer, London
Nakamura Y, Yamane K (2000) Dynamics computation of structure-varying kinematic chains and its application to human figures. IEEE Trans Robot Autom 16(2):124–134
Johnson E, Murphey TD (2010) Linearizations for mechanical systems in generalized coordinates. In: American controls conference (ACC), pp 629–633
Hauser J (2002) A projection operator approach to optimization of trajectory functionals. In: IFAC world congress, Barcelona, 2002
Martin P, Johnson E, Murphey TD, Egerstedt M (2010) Constructing and implementing motion programs for robotic marionettes. IEEE Trans Autom Control 56(4):902–907
Egerstedt M, Murphey TD, Ludwig J (2007) Hybrid systems: computation and control. In: Bemporad A, Bicchi A, Buttazzo GC (eds) Motion programs for puppet choreography and control. Lecture notes in computer science, vol TBD. Springer, pp 190–202
Murphey TD, Egerstedt ME (2007) Choreography for marionettes: imitation, planning, and control. In: IEEE international conference on intelligent robots and systems workshop on art and robotics, p 6
Johnson E, Murphey TD (2010) Second-order switching time optimization for nonlinear time-varying dynamic systems. IEEE Trans Autom Control. 56(8):1953–1957
Caldwell T, Murphey TD (2011) Switching mode generation and optimal estimation with application to skid-steering. Automatica 47(1):50–64
Egerstedt M, Wardi Y, Delmotte F (2003) Optimal control of switching times in switched dynamical systems. In: IEEE conference on decision and control, Maui, Dec 2003
Egerstedt M, Wardi Y, Axelsson H (2003) Optimal control of switching times in hybrid systems. In: IEEE methods and models in automation and robotics, Miedzyzdroje
Johnson E, Murphey TD (2009) Scalable variational integrators for constrained mechanical systems in generalized coordinates. IEEE Trans Robot 25(6):1249–1261
Nichols K, Murphey TD (2008) Variational integrators for constrained cables. In: IEEE international conference on automation science and engineering (CASE), pp 802–807
Kharevych L, Yang W, Tong Y, Kanso E, Marsden JE, Schroder P, Desbrun M (2006) Geometric, variational integrators for computer animation. Eurographics/ACM SIGGRAPH symposium on computer, animation
Lew A, Marsden JE, Ortiz M, West M (2004) Variational time integrators. Int J Numer Meth Eng 60:153–212
Lew A, Marsden JE, Ortiz M, West M (2004) An overview of variational integrators. In: Finite element methods: 1970’s and beyond, pp 98–115
West M (2004) Variational integrators. California Institute of Technology Thesis
Lew A, Marsden JE, Ortiz M, West M (2003) Asynchronous variational integrators. Arch Ration Mech Anal 167:85–146
Marsen JE, West M (2001) Discrete mechanics and variational integrators. Acta Numerica 10:357–514
Anderson B, Moore J (1971) Linear optimal control. Prentice Hall Inc, Englewood Cliffs. Upper Saddle River, New Jersey
Snyder K, Murphey TD (2010) Second-order DMOC using projections. In IEEE international conference on decision and control (CDC), 2010
Paynter B (2009) Robodinos: what could possibly go wrong? Wired magazine. Issue 17.08
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Jochum, E., Schultz, J., Johnson, E., Murphey, T.D. (2014). Robotic Puppets and the Engineering of Autonomous Theater . In: LaViers, A., Egerstedt, M. (eds) Controls and Art. Springer, Cham. https://doi.org/10.1007/978-3-319-03904-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-03904-6_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03903-9
Online ISBN: 978-3-319-03904-6
eBook Packages: EngineeringEngineering (R0)