Abstract
We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Vauclair, J.: Le développement du jeune enfant. Belin Sup Psycho (2004)
Stephens, W.B.: Piaget and inhelder—application of theory and diagnostic techniques to the area of mental retardation. Educ. Training Mentally Retarded 1(2), 75–86 (1966)
Ruff, H.A.: Role of manipulation in infants’ responses to invariant properties of objects. Dev. Psychol. 18(5), 682 (1982)
Ruff, H.A.: Infants’ manipulative exploration of objects: effects of age and object characteristics. Dev. Psychol. 20(1), 9 (1984)
Ruff, H.A.: The differentiation of activity in infants’ exploration of objects. Dev. Psychol. 28(5), 851 (1992)
Kretch, K.S., et al.: The organization of exploratory behaviors in infant locomotor planning. Dev. Sci. 20(4), e12421 (2017)
Wagner, B.S., Frost, J.L.: Assessing play and exploratory behaviors of infants and toddlers. J. Res. Child. Educ. 1(1), 27 (1986)
Moeslund, T.B., et al.: A survey of computer vision-based human motion capture. Comput. Vis. Image Unders. 81(3), 231 (2001)
Cao, Z., et al.: Realtime multi-person 2D pose estimation using part affinity fields. arXiv preprint arXiv:1611.08050 (2016)
Simon, T., et al.: Hand keypoint detection in single images using multiview bootstrapping. In: CVPR, vol. 1 (2017)
Wei, S.-E., et al.: Convolutional pose machines. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)
Amos, B., et al.: OpenFace: a general-purpose face recognition library with mobile applications. CMU-CS-16-118, CMU School of Computer Science, Technical report (2016)
Bradski, G.: The openCV library. Dr. Dobb’s J. Softw. Tools 25, 120 (2000)
Acknowledgements
This research was supported by JST PRESTO (JPMJPR16D7).
Author information
Authors and Affiliations
Contributions
K.S. and M.N. developed observation system and K.S. implemented computer vision analysis system. All authors conducted experiments and data analysis. K.S. and M.N. conceived the experiments and wrote this paper.
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sakurada, K., Oka, A., Kiso, R., Shimabukuro, L., Ueno, A., Nakatani, M. (2019). Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. In: Kajimoto, H., Lee, D., Kim, SY., Konyo, M., Kyung, KU. (eds) Haptic Interaction. AsiaHaptics 2018. Lecture Notes in Electrical Engineering, vol 535. Springer, Singapore. https://doi.org/10.1007/978-981-13-3194-7_55
Download citation
DOI: https://doi.org/10.1007/978-981-13-3194-7_55
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3193-0
Online ISBN: 978-981-13-3194-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)