Abstract
The paper presents a technique to automatically track the progress of maintenance or assembly tasks using body worn sensors. The technique is based on a novel way of combining data from accelerometers with simple frequency matching sound classification. This includes the intensity analysis of signals from microphones at different body locations to correlate environmental sounds with user activity.
To evaluate our method we apply it to activities in a wood shop. On a simulated assembly task our system can successfully segment and identify most shop activities in a continuous data stream with zero false positives and 84.4% accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abowd, D., Dey, A.K., Orr, R., Brotherton, J.: Context-awareness in wearable and ubiquitous computing. Virtual Reality 3(3), 200–211 (1998)
Bass, L., Siewiorek, D., Smailagic, A., Stivoric, J.: On site wearable computer system. In: Proceedings of ACM CHI 1995 Conference on Human Factors in Computing Systems, Interactive Experience, vol. 2, pp. 83–84 (1995)
Büchler, M.C.: Algorithms for Sound Classification in Hearing Instruments. PhD thesis, ETH Zurich (2002)
Buergy Jr., C., Garrett, J.H., Klausner, M., Anlauf, J., Nobis, G.: Speechcontrolled wearable computers for automotive shop workers. In: Proceedings of SAE 2001 World Congress, number 2001-01-0606 in SAE Technical Paper Series (March 2001)
Clarkson, B., Sawhney, N., Pentland, A.: Auditory context awareness in wearable computing. In: Workshop on Perceptual User Interfaces (November 1998)
Duda, R., Hart, P., Stork, D.: Pattern Classification, 2nd edn. Wiley, Chichester (2001)
Garrett, J.H., Smailagic, A.: EG-SEA-AI 1996. LNCS, vol. 1454, pp. 146–164. Springer, Heidelberg (1998)
Kern, N., Schiele, B., Junker, H., Lukowicz, P., Tröster, G.: Wearable sensing to annotate meeting recordings. In: 6th Int’l Symposium on Wearable Computers, October 2002, pp. 186–193 (2002)
Kubala, F., Anastasakos, A., Makhoul, J., Nguyen, L., Schwartz, R., Zavaliagkos, G.: Comparative experiments on large vocabulary speech recognition. In: ICASSP, Adelaide, Australia (1994)
Lukowicz, P., Junker, H., Staeger, M., von Bueren, T., Troester, G.: WearNET: A distributed multi-sensor system for context aware wearables. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, pp. 361–370. Springer, Heidelberg (2002)
Mantyjarvi, J., Himberg, J., Seppanen, T.: Recognizing human motion with multiple acceleration sensors. In: 2001 IEEE International Conference on Systems, Man and Cybernetics, vol. 3494, pp. 747–752 (2001)
Peltonen, V., Tuomi, J., Klapuri, A., Huopaniemi, J., Sorsa, T.: Computational auditory scene recognition. In: IEEE Int’l. Conf. on Acoustics, Speech, and Signal Processing, vol. 2, pp. 1941–1944 (May 2002)
Rabiner, L.R., Juang, B.H.: An introduction to hidden Markov models. IEEE ASSP Magazine, 4–16 (January 1986)
Randell, C., Muller, H.: Context awareness by analysing accelerometer data. In: Digest of Papers, Fourth International Symposium on Wearable Computers, pp. 175–176 (2000)
Rehg, J.M., Kanade, T.: DigitEyes: vision-based human hand tracking. School of Computer Science Technical Report CMU-CS-93-220, Carnegie Mellon University (December 1993)
Schlenzig, J., Hunter, E., Jain, R.: Recursive identification of gesture inputs using hidden Markov models. In: Proc. Second Annual Conference on Applications of Computer Vision, December 1994, pp. 187–194 (1994)
Sims, D.: New realities in aircraft design and manufacture. Computer Graphics and Applications 14(2) (March 1994)
Stäger, M., Lukowicz, P., Perera, N., von Büren, T., Tröster, G., Starner, T.: Soundbutton: Design of a low power wearable audio classification system. In: 7th Int’l Symposium on Wearable Computers (2003)
Starner, T., Makhoul, J., Schwartz, R., Chou, G.: On-line cursive handwriting recognition using speech recognition methods. In: ICASSP, pp. 125–128 (1994)
Starner, T., Schiele, B., Pentland, A.: Visual contextual awareness in wearable computing. In: IEEE Intl. Symp. on Wearable Computers, Pittsburgh, PA, pp. 50–57 (1998)
Starner, T., Weaver, J., Pentland, A.: Real-time American Sign Language recognition using desk and wearable computer-based video. IEEE Trans. Patt. Analy. and Mach. Intell. 20(12) (December 1998)
Schiele, B., Antifakos, S., Michahelles, F.: Proactive instructions for furniture assembly. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, p. 351. Springer, Heidelberg (2002)
Van-Laerhoven, K., Cakmakci, O.: What shall we teach our pants? In: Digest of Papers, Fourth International Symposium on Wearable Computers, pp. 77–83 (2000)
Vogler, C., Metaxas, D.: ASL recognition based on a coupling between HMMs and 3D motion analysis. In: ICCV, Bombay (1998)
Wilson, D., Bobick, A.F.: Learning visual behavior for gesture analysis. In: Proc. IEEE Int’l. Symp. on Comp. Vis. Coral Gables, Florida (November 1995)
Young, S.: HTK: Hidden Markov Model Toolkit V1.5. Cambridge Univ. Eng. Dept. Speech Group and Entropic Research Lab. Inc., Washington DC (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lukowicz, P. et al. (2004). Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers. In: Ferscha, A., Mattern, F. (eds) Pervasive Computing. Pervasive 2004. Lecture Notes in Computer Science, vol 3001. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24646-6_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-24646-6_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21835-7
Online ISBN: 978-3-540-24646-6
eBook Packages: Springer Book Archive