Abstract
This paper presents a method of animating the facial expressions of virtual characters based on data capture processes. A presentation is given of a facial rigging system capable of simulating facial muscle activity in a realistic way. A distance-based methodology is outlined in which curves are calculated that define animation by the rig controllers, using data from Saragih’s Face Tracker. The method’s performance is tested by reproducing expressions from various different public databases of facial expressions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Orvalho, V., Bastos, P., Parke, F., Oliveira, B., Alvarez, X.: A Facial Rigging Survey, pp. 183–204 (2012)
Maraffi, C.: Maya Character Creation: Modeling and Animation Controls. New Riders (2004)
Gorden, J.: LightWave 3D 8 Cartoon Character Creation: Modeling & Texturing. Wordware Publishing, Inc., (2004)
Ritchie, K., Callery, J., Biri, K.: The Art of Rigging. CG Toolkit (2005)
Miller, E., Thuriot, P., Unay, J.: Maya Techniques: Hyper-Real Creature Creation, 2006th edn. Sybex (2006)
McKinley, M.: The Game Animator’s Guide to Maya, Pap/Cdr. John Wiley & Sons (2006)
Bredow, R., Schaub, D., Kramer, D., Hausman, M., Dimian, D., Duguid, R.S.: Surf’s up: The making of an animated documentary. In: ACM SIGGRAPH 2007 Courses, New York, NY, USA, pp. 1–123 (2007)
Chang, E., Jenkins, O.: Sketching Articulation and Pose for Facial Animation. In: Deng, Z., Neumann, U. (eds.) Data-Driven 3D Facial Animation, pp. 145–161. Springer, London (2007)
Pardew, L.: Character Emotion in 2D and 3D Animation, 1st edn. Course Technology Press, Boston (2007)
O’Neill, R.: Digital Character Development: Theory and Practice. Morgan Kaufmann Publishers Inc., San Francisco (2008)
Villagrassa, S., Susín, A.: FACe! 3D facial Animation System based on FACS. In: Rodríguez, F.S.O. (ed.) IV Iberoamerican Symposium in Computer Graphics – SIACG 2009, p. 209 (2009)
Alexander, O., Rogers, M., Lambeth, W., Chiang, M., Debevec, P.: Creating a Photoreal Digital Actor: The Digital Emily Project. In: Conference for Visual Media Production, CVMP 2009, pp. 176–187 (2009)
Osipa, J.: Stop Staring: Facial Modeling and Animation Done Right. John Wiley & Sons (2010)
Arghinenti, A.: Animation workflow in KILLZONE3™: A fast facial retargeting system for game characters. In: ACM SIGGRAPH 2011 Talks, New York, NY, USA, pp. 37:1–37:1 (2011)
Innes, L.: The Secret To Drawing Characters Consistently & Expressively, http://www.paperwingspodcast.com/2011/06/the-secret-to-drawin-expressive-consistent-characters/ (accessed: September 18, 2012)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, pp. I-511–I-518 (2001)
Varona, J., Manresa-Yee, C., Perales, F.J.: Hands-free vision-based interface for computer accessibility. Journal of Network and Computer Applications 31(4), 357–374 (2008)
Castrillón, M., Déniz, O., Hernández, D., Lorenzo, J.: A comparison of face and facial feature detectors based on the Viola–Jones general object detection framework. Machine Vision and Applications 22(3), 481–494 (2011)
Cerezo, E., Hupont, I., Manresa-Yee, C., Varona, J., Baldassarri, S., Perales, F.J., Seron, F.J.: Real-Time Facial Expression Recognition for Natural Interaction. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, pp. 40–47. Springer, Heidelberg (2007)
Pighin, F., Lewis, J.P.: Facial motion retargeting. In: ACM SIGGRAPH 2006 Courses, New York, NY, USA (2006)
Patras, I., Pantic, M.: Particle filtering with factorized likelihoods for tracking facial features. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004, pp. 97–102 (2004)
Pantic, M., Patras, I.: Detecting facial actions and their temporal segments in nearly frontal-view face image sequences. In: 2005 IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 3358–3363 (2005)
Saragih, J., Lucey, S., Cohn, J.: Deformable Model Fitting by Regularized Landmark Mean-Shift. International Journal of Computer Vision 91(2), 200–215 (2011)
Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4), 77 (2011)
Ekman, P., Friesen, W.V.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press (1978)
Unay, J., Grossman, R.: Hyper-real advanced facial blendshape techniques and tools for production. In: ACM SIGGRAPH 2005 Master Class (2005)
Alexander, O., Rogers, M., Lambeth, W., Chiang, M., Debevec, P.: The Digital Emily project: Photoreal facial modeling and animation. In: ACM SIGGRAPH 2009 Courses, New York, NY, USA, pp. 12:1–12:15 (2009)
Digital-Tutors, Facial Rigging in Maya, http://www.digitaltutors.com (accessed: May 15, 2009)
Boris with Facial GUI - Free Character Rigs Downloads for Maya, http://www.creativecrash.com/maya/downloads/character-rigs/c/boris-with-facial-gui (accessed: November 20, 2013)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101 (2010)
Pantic, M., Valstar, M., Rademaker, R., Maat, L.: Web-based database for facial expression analysis. In: IEEE International Conference on Multimedia and Expo, ICME 2005, p. 5 (2005)
BBC - Science & Nature - Human Body and Mind - Spot The Fake Smile, http://www.bbc.co.uk/science/humanbody/mind/surveys/smiles/ (accessed: November 23, 2012)
Hoque, M.E., McDuff, D.J., Picard, R.W.: Exploring Temporal Patterns in Classifying Frustrated and Delighted Smiles. IEEE Transactions on Affective Computing 3(3), 323–334 (2012)
Dibeklioğlu, H., Salah, A.A., Gevers, T.: Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 525–538. Springer, Heidelberg (2012)
Petridis, S., Martinez, B., Pantic, M.: The MAHNOB Laughter Database. Image and Vision Computing Journal 31(2), 186–202 (2013)
ELAN, http://tla.mpi.nl/tools/tla-tools/elan/ (accessed: January 27, 2014)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Mascaró, M., Serón, F.J., Perales, F.J., Varona, J. (2014). Rigging and Data Capture for the Facial Animation of Virtual Actors. In: Perales, F.J., Santos-Victor, J. (eds) Articulated Motion and Deformable Objects. AMDO 2014. Lecture Notes in Computer Science, vol 8563. Springer, Cham. https://doi.org/10.1007/978-3-319-08849-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-08849-5_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08848-8
Online ISBN: 978-3-319-08849-5
eBook Packages: Computer ScienceComputer Science (R0)