Robust Coordinated Aerial Deployments for Theatrical Applications Given Online User Interaction via Behavior Composition

  • Ellen A. CappoEmail author
  • Arjav Desai
  • Nathan Michael
Part of the Springer Proceedings in Advanced Robotics book series (SPAR, volume 6)


We propose and evaluate a multirobot system designed to enable live theatric presentation of episodic stories through online interaction between a performer and a robot system. The proposed system translates theatric performer intent into dynamically feasible robot trajectories without requiring prior knowledge of the ordering or timing of the desired robot motions. The system enables a user to issue instructions composed of desired motion descriptors at arbitrary times to specify the motion of the robot ensemble. The system refines user motion specifications into safe and dynamically feasible trajectories thereby reducing the cognitive burden placed on the performer. We evaluate the system on a team of aerial robots (quadrotors), and show through offline simulation and online performance that the proposed system formulation translates online input into non-colliding dynamically feasible trajectories enabling the performance of an epic poem over the course of a three act performance spanning fifteen minutes of coordinated flight by a six robot team.



We thank James Laney and Eric Adlam for their user interface implementations and Nima Dehghani and Ali Momeni for their theatric contributions. We gratefully acknowledge support from ONR grants N00014-13-1-0821 and N00014-15-1-2929.


  1. 1.
    Augugliaro, F., Schoellig, A.P., D’Andrea, R.: Dance of the flying machines: methods for designing and executing an aerial dance choreography. IEEE Robot. Autom. Mag. 20(4), 96–104 (2013)CrossRefGoogle Scholar
  2. 2.
    Cirque du Soleil, ETH Zurich, Verity Studios.: Sparked: a live interaction between humans and quadcopters (2014). Accessed 14 July 2016
  3. 3.
    Coxworth, B.: Cirque du Soleil and ETH Zurich collaborate on human/drone performance. Gizmag (2014). Accessed 14 July 2016
  4. 4.
    Desai, A., Cappo, E.A., Michael, N.: Dynamically feasible and safe shape transitions for teams of aerial robots. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (2016)Google Scholar
  5. 5.
    Hoffman, G., Kubat, R., Breazeal, C.: A hybrid control system for puppeteering a live robotic stage actor. In: RO-MAN 17th IEEE International Symposium on Robot and Human Interactive Communication, pp. 354–359. IEEE (2008)Google Scholar
  6. 6.
    Holmes, K.: Watch this: flying quadrotor light show spectacular artist [Q&A]. The Creators Project (2012). Accessed 14 June 2016
  7. 7.
    Kaplan, K.: 100 dancing drones set world record. Tech Innovation (2016). Accessed 14 June 2016
  8. 8.
    Knight, H., Gray, M.: Acting lesson with robot: Emotional gestures. In: Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, pp. 407–407. IEEE (2012)Google Scholar
  9. 9.
    Lupashin, S., Hehn, M., Mueller, M.W., Schoellig, A.P., Sherback, M., D’Andrea, R.: A platform for aerial robotics research and demonstration: the flying machine arena. Mechatronics 24(1), 41–54 (2014)CrossRefGoogle Scholar
  10. 10.
    MagicLab, Rhizomatiks Research: DroneMagic - Behind the Scenes (2016). Accessed 14 June 2016
  11. 11.
    MagicLab, Rhizomatiks Research: MagicLab 24 Drone Flight (2016). Accessed 14 June 2016
  12. 12.
    Mahony, R., Kumar, V., Corke, P.: Multirotor aerial vehicles: modeling, estimation, and control of quadrotor. IEEE Robot. Autom. Mag. 19(3), 20–32 (2012)CrossRefGoogle Scholar
  13. 13.
    Mellinger, D., Kushleyev, A., Kumar, V.: Mixed-integer quadratic program trajectory generation for heterogeneous quadrotor teams. In: Proceedings of the IEEE Interantional Conference on Robotics and Automation, pp. 477–483 (2012)Google Scholar
  14. 14.
    Richter, C., Bry, A., Roy, N.: Polynomial trajectory planning for quadrotor flight. In: Proceedings of Robotics: Science and Systems (2013)Google Scholar
  15. 15.
    Saha, I., Ramaithitima, R., Kumar, V., Pappas, G.J., Seshia, S.A.: Automated composition of motion primitives for multi-robot systems from safe LTL specifications. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1525–1532. IEEE (2014)Google Scholar
  16. 16.
    Saha, I., Ramaithitima, R., Kumar, V., Pappas, G.J., Seshia, S.A.: Implan: scalable incremental motion planning for multi-robot systems. In: ACM/IEEE 7th International Conference on Cyber-Physical Systems, pp. 1–10. IEEE (2016)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.Carnegie Mellon UniversityPittsburghUSA

Personalised recommendations