Abstract
Deformation of skin and muscle is essential for bringing an animated character to life. This deformation is difficult to animate in a realistic fashion using traditional techniques because of the subtlety of the skin deformations that must move appropriately for the character design. In this paper, we present an algorithm that generates natural, dynamic, and detailed skin deformation (movement and jiggle) from joint angle data sequences. The algorithm has two steps: identification of parameters for a quasi-static muscle deformation model, and simulation of skin deformation. In the identification step, we identify the model parameters using a musculoskeletal model and a short sequence of skin deformation data captured via a dense marker set. The simulation step first uses the quasi-static muscle deformation model to obtain the quasi-static muscle shape at each frame of the given motion sequence (slow jump). Dynamic skin deformation is then computed by simulating the passive muscle and soft tissue dynamics modeled as a mass–spring–damper system. Having obtained the model parameters, we can simulate dynamic skin deformations for subjects with similar body types from new motion data. We demonstrate our method by creating skin deformations for muscle co-contraction and external impacts from four different behaviors captured as skeletal motion capture data. Experimental results show that the simulated skin deformations are quantitatively and qualitatively similar to measured actual skin deformations.
Article PDF
Similar content being viewed by others
References
Autodesk. Maya 2015. 2015.
Lewis, J. P.; Anjyo, K.; Rhee, T.; Zhang, M.; Pighin, F.; Deng, Z. Practice and theory of blendshape facial models. In: Proceedings of Eurographics 2014—State of the Art Reports, 2014.
Pons-Moll, G.; Romero, J.; Mahmood, N.; Black, M. J. Dyna: A model of dynamic human shape in motion. ACM Transactions on Graphics Vol. 34, No. 4, Article No. 120, 2015.
Si, W.; Lee, S.-H.; Sifakis, E.; Terzopoulos, D. Realistic biomechanical simulation and control of human swimming. ACM Transactions on Graphics Vol. 34, No. 1, Article No. 10, 2014.
Murai, A.; Takeichi, K.; Miyatake, T.; Nakamura, Y. Musculoskeletal modeling and physiological validation. In: Proceedings of 2014 IEEE International Workshop on Advanced Robotics and its Social Impacts, 108–113, 2014.
Park, S. I.; Hodgins, J. K. Capturing and animating skin deformation in human motion. ACM Transactions on Graphics Vol. 25, No. 3, 881–889, 2006.
Vaillant, R.; Barthe, L.; Guennebaud, G.; Cani, M.-P.; Rohmer, D.; Wyvill, B.; Gourmel, O.; Paulin, M. Implicit skinning: Real-time skin deformation with contact modeling. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 125, 2013.
Chadwick, J. E.; Haumann, D. R.; Parent, R. E. Layered construction for deformable animated characters. In: Proceedings of the 16th Annual Conference on Computer Graphics and Interactive Techniques, 243–252, 1989.
Tsoli, A.; Mahmood, N.; Black, M. J. Breathing life into shape: Capturing, modeling and animating 3D human breathing. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 52, 2014.
Sueda, S.; Pai, D. K. Dynamic simulation of the hand. In: The Human Hand as an Inspiration for Robot Hand Development. Balasubramanian, R.; Santos, V. J. Eds. Springer International Publishing, 267–288, 2014.
Lee, S.-H.; Sifakis, E.; Terzopoulos, D. Comprehensive biomechanical modeling and simulation of the upper body. ACM Transactions on Graphics Vol. 28, No. 4, Article No. 99, 2009.
Pratscher, M.; Coleman, P.; Laszlo, J.; Singh, K. Outside-in anatomy based character rigging. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 329–338, 2005.
Mitsuhashi, N.; Fujieda, K.; Tamura, T.; Kawamoto, S.; Takagi, T.; Okubo, K. BodyParts3D: 3D structure database for anatomical concepts. Nucleic Acids Research Vol. 37, D782–D785, 2009.
Zordan, V. B.; Celly, B.; Chiu, B.; DiLorenzo, P. C. Breathe easy: Model and control of simulated respiration for animation. In: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 29–37, 2004.
Koch, R. M.; Gross, M. H.; Carlsy, F. R.; von Büren, D. F.; Fankhauser, G.; Parish, Y. I. H. Simulating facial surgery using finite element models. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, 421–428, 1996.
Blemker, S.; Teran, J.; Sifakis, E.; Fedkiw, R.; Delp, S. Fast 3D muscle simulations using a new quasistatic invertible finite-element algorithm. In: Proceedings of International Symposium on Computer Simulation in Biomechanics, 2005.
Webb, J. D.; Blemker, S. S.; Delp, S. L. 3D finite element models of shoulder muscles for computing lines of actions and moment arms. Computer Methods in Biomechanics and Biomedical Engineering Vol. 17, No. 8, 829–837, 2014.
Fan, Y.; Litven, J.; Pai, D. K. Active volumetric musculoskeletal systems. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 152, 2014.
Anguelov, D.; Srinivasan, P.; Koller, D.; Thrun, S.; Rodgers, J.; Davis, J. SCAPE: Shape completion and animation of people. ACM Transactions on Graphics Vol. 24, No. 3, 408–416, 2005.
Park, S. I.; Hodgins, J. K. Data-driven modeling of skin and muscle deformation. ACM Transactions on Graphics Vol. 27, No. 3, Article No. 96, 2008.
Wang, H.; Hecht, F.; Ramamoorthi, R.; O’Brien, J. Example-based wrinkle synthesis for clothing animation. ACM Transactions on Graphics Vol. 29, No. 4, Article No. 107, 2010.
Delp, S. L.; Anderson, F. C.; Arnold, A. S.; Loan, P.; Habib, A.; John, C. T.; Guendelman, E.; Thelen, D. G. OpenSim: Open-source software to create and analyze dynamic simulations of movement. IEEE Transactions on Biomedical Engineering Vol. 54, No. 11, 1940–1950, 2007.
Nakamura, Y.; Yamane, K.; Fujita, Y.; Suzki, I. Somatosensory computation for manmachine interface from motion-capture data and musculoskeletal human model. IEEE Transactions on Robotics Vol. 21, No. 1, 58–66, 2005.
AIST. Japanese body dimension data 1997–98. 1998. Available at http://www.dh.aist.go.jp/database/97-98/e index.html.
Yamane, K.; Nakamura, Y. Natural motion animation through constraining and deconstraining at will. IEEE Transactions on Visualization and Computer Graphics Vol. 9, No. 3, 352–360, 2003.
Luh, J. Y. S.; Walke, M. W.; Paul, R. P. C. On-line computational scheme for mechanical manipulators. Journal of Dynamic Systems, Measurement, and Control Vol. 102, No. 2, 69–76, 1980.
Nakamura, Y.; Yamane, K.; Murai, A. Macroscopic modeling and identification of the human neuromuscular network. In: Proceedings of the 28th Annual International Conference of the IEEE, 99–105, 2006.
Yamane, K.; Fujita, Y.; Nakamura, Y. Estimation of physically and physiologically valid somatosensory information. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2624–2630, 2005.
Coleman, T. F.; Li, Y. On the convergence of interior reflective Newton methods for nonlinear minimization subject to bounds. Mathematical Programming Vol. 67, No. 1, 189–224, 1994.
Kardel, T. Niels Stensen’s geometrical theory of muscle contraction (1667): A reappraisal. Journal of Biomechanics Vol. 23, No. 10, 953–965, 1990.
Howell, J.; Chleboun, G.; Conatser, R. Muscle stiffness, strength loss, swelling and soreness following exercise-induced injury in humans. The Journal of Physiology Vol. 464, No. 1, 183–196, 1993.
Swope, W. C.; Andersen, H. C.; Berens, P. H.; Wilson, K. R. A computer simulation method for the calculation of equilibrium constants for the formation of physical clusters of molecules: Application to small water clusters. The Journal of Chemical Physics Vol. 76, 637–649, 1982.
Baraff, D.; Witkin, A. Large steps in cloth simulation. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, 43–54, 1998.
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is published with open access at Springerlink.com
Akihiko Murai received his B.S. degree in mechanical engineering, and M.S. and Ph.D. degrees in mechano-informatics, in 2003, 2005, and 2009 respectively from the University of Tokyo, Japan. He is currently a research scientist at the National Institute of Advanced Industrial Science and Technology (AIST). Prior to joining AIST, he was a postdoctoral researcher at Disney Research, Pittsburgh, and a project assistant professor at the University of Tokyo. Dr. Murai is a recipient of Young Investigation Excellence Award of RSJ (2016), Robotics-Mechatronics Division Annual Prize (2010), SICE Research Award (2009), and JSPS Research Fellowship for Young Scientists (2009). His research interests include anatomical human modeling, the human neuro-musculoskeletal system, human motion measurement and analysis, and character animation.
Q. Youn Hong received her bachelor degree from Seoul National University, Seoul, Repulic of Korea, in 2006. She is currently working toward a graduate degree at Carnegie Mellon University. Her research interests include character animation and skin deformation.
Katsu Yamane received his B.S., M.S., and Ph.D. degrees in mechanical engineering in 1997, 1999, and 2002 respectively from the University of Tokyo, Japan. He is currently a senior research scientist at Disney Research, Pittsburgh, and an adjunct associate professor at the Robotics Institute, Carnegie Mellon University. Prior to joining Disney, he was an associate professor at the University of Tokyo. Dr. Yamane is a recipient of numerous awards including King-Sun Fu Best Transactions Paper Award and Early Academic Career Award from the IEEE Robotics and Automation Society, and Young Scientist Award from the Ministry of Education, Japan. He has served as an associate editor of IEEE Transactions on Robotics and an area chair of the Robotics: Science and Systems Conference, as well as program committee member of various international conferences in robotics and graphics. His research interests include humanoid robot control and motion synthesis, human–robot interaction, character animation, and human motion simulation.
Jessica K. Hodgins is a professor in the Robotics Institute and Computer Science Department at Carnegie Mellon University and a director of Disney Research, Pittsburgh. Prior to moving to Carnegie Mellon in 2000, she was an associate professor and assistant dean in the College of Computing at Georgia Institute of Technology. She received her Ph.D. degree in computer science from Carnegie Mellon University in 1989. Her research focuses on computer graphics, animation, and robotics with an emphasis on generating and analyzing human motion. She has received NSF Young Investigator Award, Packard Fellowship, and Sloan Fellowship. She was editor-in-chief of ACM Transactions on Graphics from 2000 to 2002 and ACM SIGGRAPH Papers Chair in 2003. In 2010, she was awarded the ACM SIGGRAPH Computer Graphics Achievement Award.
Electronic supplementary material
Rights and permissions
Open Access The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
About this article
Cite this article
Murai, A., Youn Hong, Q., Yamane, K. et al. Dynamic skin deformation simulation using musculoskeletal model and soft tissue dynamics. Comp. Visual Media 3, 49–60 (2017). https://doi.org/10.1007/s41095-016-0065-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41095-016-0065-1