Skip to main content
SpringerLink
Log in

Crowd Simulation with Detailed Body Motion and Interaction

  • Conference paper
  • First Online:
Advances in Computer Graphics (CGI 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13443))

Included in the following conference series:

  • 1130 Accesses

Abstract

Crowd simulation methods generally focus on high fidelity 2D trajectories but ignore detailed 3D body animation which is normally added in a post-processing step. We argue that this is an intrinsic flaw as detailed body motions affect the 2D trajectories, especially when interactions are present between characters, and characters and the environment. In practice, this requires labor-intensive post-processing, fitting individual character animations onto simulated trajectories where anybody interactions need to be manually specified. In this paper, we propose a new framework to integrate the modeling of crowd motions with character motions, to enable their mutual influence, so that crowd simulation also incorporates agent-agent and agent-environment interactions. The whole framework is based on a three-level hierarchical control structure to effectively control the scene at different scales efficiently and consistently. To facilitate control, each character is modeled as an agent governed by four modules: visual system, blackboard system, decision system, and animation system. The animation system of the agent model consists of two modes: a traditional Finite State Machine (FSM) animation mode, and a motion matching mode. So an agent not only retains the flexibility of FSMs, but also has the advantage of motion matching which adapts detailed body movements for interactions with other agents and the environment. Our method is universal and applicable to most interaction scenarios in various environments in crowd animation, which cannot be achieved by prior work. We validate the fluency and realism of the proposed method by extensive experiments and user studies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agrawal, S., van de Panne, M.: Task-based locomotion. ACM Trans. Graph. (TOG) 35(4), 82:1–82:11 (2016)

    Google Scholar 

  2. Chraibi, M., Tordeux, A., Schadschneider, A.: A force-based model to reproduce stop-and-go waves in pedestrian dynamics. In: Knoop, V.L., Daamen, W. (eds.) Traffic and Granular Flow ’15, pp. 169–175. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-33482-0_22

    Chapter  Google Scholar 

  3. Dönmez, H.A.: Collision avoidance for virtual crowds using reinforcement learning. Master’s thesis (2017)

    Google Scholar 

  4. Felder, A., Van Buskirk, D., Bobda, C.: Automatic generation of waypoint graphs from distributed ceiling-mounted smart cameras for decentralized multi-robot indoor navigation. In: Proceedings of the 13th International Conference on Distributed Smart Cameras, pp. 1–7 (2019)

    Google Scholar 

  5. Gaisbauer, F., Lehwald, J., Agethen, P., Sues, J., Rukzio, E.: Proposing a co-simulation model for coupling heterogeneous character animation systems. In: Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP, pp. 65–76 (2019)

    Google Scholar 

  6. Gillies, M.: Learning finite-state machine controllers from motion capture data. IEEE Trans. Comput. Intell. AI Games 1(1), 63–72 (2009)

    Article  MathSciNet  Google Scholar 

  7. Guy, S.J., van den Berg, J., Liu, W., Lau, R., Lin, M.C., Manocha, D.: A statistical similarity measure for aggregate crowd dynamics. ACM Trans. Graph. (TOG) 31(6), 1–11 (2012)

    Article  Google Scholar 

  8. He, F., Xiang, Y., Zhao, X., Wang, H.: Informative scene decomposition for crowd analysis, comparison and simulation guidance. ACM Trans. Graph. (TOG) 4(39), 50 (2020)

    Google Scholar 

  9. Helbing, D., Farkas, I., Vicsek, T.: Simulating dynamical features of escape panic. Nature 407(6803), 487–490 (2000)

    Article  Google Scholar 

  10. Helbing, D., Johansson, A.: Pedestrian, crowd, and evacuation dynamics. In: Encyclopedia of Complexity and System Science, pp. 6476–6495 (2009)

    Google Scholar 

  11. Holden, D., Kanoun, O., Perepichka, M., Popa, T.: Learned motion matching. ACM Trans. Graph. (TOG) 39(4), 53 (2020)

    Article  Google Scholar 

  12. Holden, D., Komura, T., Saito, J.: Phase-functioned neural networks for character control. ACM Trans. Graph. (TOG) 36(4), 42:1–42:13 (2017)

    Google Scholar 

  13. Hoyet, L., Olivier, A.H., Kulpa, R., Pettré, J.: Perceptual effect of shoulder motions on crowd animations. ACM Trans. Graph. (TOG) 35(4), 53:1–53:10 (2016)

    Google Scholar 

  14. Johansson, A., Dell’Acqua, P.: Emotional behavior trees. In: 2012 IEEE Conference on Computational Intelligence and Games (CIG), pp. 355–362 (2012)

    Google Scholar 

  15. Juliani, A., et al.: Unity: a general platform for intelligent agents. arXiv preprint arXiv:1809.02627 (2018)

  16. Justesen, N., Bontrager, P., Togelius, J., Risi, S.: Deep learning for video game playing. IEEE Trans. Games 12(1), 1–20 (2020)

    Article  Google Scholar 

  17. Llobera, J., Boulic, R.: A tool to design interactive characters based on embodied cognition. IEEE Trans. Games 11(4), 311–319 (2019)

    Article  Google Scholar 

  18. Low, M., Cai, W., Zhou, S.: A federated agent-based crowd simulation architecture. In: The 2007 European Conference on Modelling and Simulation, Prague, Czech Republic, pp. 188–194. Citeseer (2007)

    Google Scholar 

  19. Manenti, L., Manzoni, S.: Crystals of crowd: modelling pedestrian groups using mas-based approach. In: Proceedings of the 12th Workshop on Objects and Agents, Rende (CS), Italy, 4–6 July 2011, CEUR Workshop Proceedings, vol. 741, pp. 51–57 (2011)

    Google Scholar 

  20. Narang, S., Best, A., Manocha, D.: Simulating movement interactions between avatars & agents in virtual worlds using human motion constraints. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 9–16 (2018)

    Google Scholar 

  21. Nystrom, R.: Game programming patterns (2014)

    Google Scholar 

  22. Ren, J., Sun, W., Manocha, D., Li, A., Jin, X.: Stable information transfer network facilitates the emergence of collective behavior of bird flocks. Phys. Rev. E 98(5), 052309 (2018)

    Google Scholar 

  23. Reynolds, C.W.: Flocks, herds and schools: a distributed behavioral model. In: Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, pp. 25–34 (1987)

    Google Scholar 

  24. Ruiz, S., Hernandez, B.: Real time Markov decision processes for crowd simulation. GPU Zen, pp. 323–341 (2017)

    Google Scholar 

  25. Shao, W., Terzopoulos, D.: Autonomous pedestrians. Graph. Models 69(5–6), 246–274 (2007)

    Article  Google Scholar 

  26. Starke, S., Zhang, H., Komura, T., Saito, J.: Neural state machine for character-scene interactions. ACM Trans. Graph. (TOG) 38(6), 209:1–209:14 (2019)

    Google Scholar 

  27. Sun, L., Zhai, J., Qin, W.: Crowd navigation in an unknown and dynamic environment based on deep reinforcement learning. IEEE Access 7, 109544–109554 (2019)

    Article  Google Scholar 

  28. Thalmann, D.: Crowd simulation. Wiley encyclopedia of computer science and engineering (2007)

    Google Scholar 

  29. van Toll, W., Pettré, J.: Algorithms for microscopic crowd simulation: advancements in the 2010s. Comput. Graph. Forum 40(2), 731–754 (2021)

    Article  Google Scholar 

  30. Wang, H., Ondřej, J., O’Sullivan, C.: Path patterns: analyzing and comparing real and simulated crowds. In: ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games 2016, pp. 49–57 (2016)

    Google Scholar 

  31. Wang, H., Ondrej, J., O’Sullivan, C.: Trending paths: a new semantic-level metric for comparing simulated and real crowd data. IEEE Trans. Visual Comput. Graphics 23(5), 1454–1464 (2017)

    Article  Google Scholar 

  32. Wang, H., O’Sullivan, C.: Globally continuous and non-Markovian crowd activity analysis from videos. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9909, pp. 527–544. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46454-1_32

    Chapter  Google Scholar 

  33. Zhou, S., et al.: Crowd modeling and simulation technologies. ACM Trans. Model. Comput. Simul. (TOMACS) 20(4), 1–35 (2010)

    Article  Google Scholar 

Download references

Acknowledgement

Xiaogang Jin was supported by the National Natural Science Foundation of China (Grant No. 62036010) and the Key Research and Development Program of Zhejiang Province (Grant No. 2020C03096).

Author information

Authors and Affiliations

  1. State Key Lab of CAD &CG, Zhejiang University, Hangzhou, 310058, People’s Republic of China

    Xinran Yao, Shuning Wang, Wenxin Sun & Xiaogang Jin

  2. University of Leeds, Leeds, UK

    He Wang

  3. CROS of Tencent Games, Shenzhen, People’s Republic of China

    Yangjun Wang

Authors
  1. Xinran Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuning Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenxin Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. He Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yangjun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiaogang Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaogang Jin .

Editor information

Editors and Affiliations

  1. University of Geneva, Geneva, Switzerland

    Nadia Magnenat-Thalmann

  2. Bournemouth University, Poole, UK

    Jian Zhang

  3. University of Sydney, Sydney, NSW, Australia

    Jinman Kim

  4. University of Crete, Heraklion, Greece

    George Papagiannakis

  5. Shanghai Jiao Tong University, Shanghai, China

    Bin Sheng

  6. Swiss Federal Institute of Technology, Lausanne, Switzerland

    Daniel Thalmann

  7. University of Calgary, Calgary, AB, Canada

    Marina Gavrilova

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yao, X., Wang, S., Sun, W., Wang, H., Wang, Y., Jin, X. (2022). Crowd Simulation with Detailed Body Motion and Interaction. In: Magnenat-Thalmann, N., et al. Advances in Computer Graphics. CGI 2022. Lecture Notes in Computer Science, vol 13443. Springer, Cham. https://doi.org/10.1007/978-3-031-23473-6_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-23473-6_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-23472-9

  • Online ISBN: 978-3-031-23473-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation