Skip to main content
SpringerLink
Log in

Integration of audiovisual sensors and technologies in a smart room

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

At the Technical University of Catalonia (UPC), a smart room has been equipped with 85 microphones and 8 cameras. This paper describes the setup of the sensors, gives an overview of the underlying hardware and software infrastructure and indicates possibilities for high- and low-level multi-modal interaction. An example of usage of the information collected from the distributed sensor network is explained in detail: the system supports a group of students that have to solve a lab assignment related problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Josep R, Casas R, Stiefelhagen et al (2004) Multi-camera/multi-microphone system design for continuous room monitoring, CHIL-WP4-D4.1-V2.1-2004-07-08-CO, CHIL Consortium Deliverable D4.1

  2. Stanford V, Rochet C (2003) The NIST Mk-III microphone array, and applications of adaptive beam forming to speech. In: 5th international workshop on microphone array systems: theory and practice. (http://www.nist.gov/smartspace/cmaiii.html)

  3. Landabaso JL, Xu LO, Pardas M (2004) Robust tracking and object classification towards automated video surveillance. In: Proceedings of the international conference on image analysis and recognition ICIAR 2004, Porto, Portugal, September 29–October 1 2004, Part II, pp 463–470

  4. Landabaso JL, Pardàs M, Xu LQ (2005) Hierarchical representation of scenes using activity information. In: Proceedings of ICASSP, Philadelphia, 18–23 March 2005

  5. Josep R, Casas O, Garcia, et al (2004) Initial multi-sensor selection strategy to get the best camera/microphone at any time, CHIL-WP4-D4.2-V2.0-2004-10-18-CO, CHIL Deliverable D4.2, October

  6. Garcia O, Casas JR (2005) Functionalities for mapping 2D images and 3D world objects in a Multicamera Environment. In: 6th international workshop on image analysis for multimedia interactive services (WIAMIS), Montreux, Switzerland

  7. Laurentini A (1994) The visual hull concept for silhouette-based image understanding. IEEE Trans Pattern Anal Mach Intell 16(2):150–162

    Article  Google Scholar 

  8. Landabaso JL, Pardas M Foreground regions extraction and characterization towards real-time object tracking. In: Proceedings of joint workshop on multimodal interaction and related machine learning algorithms (MLMI ‘05), 2005. 3

  9. Padrell J, Macho D, Nadeu C (2005) Robust speech activity detection using LDA applied to FF parameters. In: Proceedings of ICASSP’05, Philadelphia

  10. Omologo M, Svaizer P (1994) Acoustic event localization using a crosspower-spectrum phase based technique. In: Proceedings of ICASSP’94, Adelaide

  11. Abad A, Macho D, Segura C, Hernando J, Nadeu C (2005) Effect of head orientation on the speaker localization performance in smart-room environment. In: Proceedings of INTERSPEECH–EUROSPEECH 2005, Lisbon

  12. Temko A, Macho D, Nadeu C (2005) Selection of features and combination of classifiers using a fuzzy approach for acoustic event classification. In: Proceedings of the 9th European Conference on speech communication and technology, Interspeech 2005, Lisbon

  13. Temko A, Macho D, Nadeu C (2006) Improving the performance of acoustic event classification by selecting and combining information sources using the fuzzy integral. Lecture notes in computer science (LNCS), vol 3869

  14. Temko A, Nadeu C (2006) Classification of Acoustic events using SVM-based clustering schemes. Pattern recognition. Elsevier, Amsterdam (in press)

  15. NIST smart space system. http://www.nist.gov/smartspace

  16. CHIL Deliverable D2.4 (2006) CHIL software architecture version 2.0

Download references

Author information

Authors and Affiliations

  1. Signal Theory and Communications Department, UPC—Technical University of Catalonia, Campus Nord edifici D5 Jordi Girona 1-3, 08034 , Barcelona, Spain

    Joachim Neumann, Josep R. Casas, Dušan Macho & Javier Ruiz Hidalgo

Authors
  1. Joachim Neumann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Josep R. Casas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dušan Macho
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Javier Ruiz Hidalgo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joachim Neumann.

Additional information

This work has been partially supported by the European Union, IP 506909 (CHIL)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Neumann, J., Casas, J.R., Macho, D. et al. Integration of audiovisual sensors and technologies in a smart room. Pers Ubiquit Comput 13, 15–23 (2009). https://doi.org/10.1007/s00779-007-0172-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-007-0172-1

Keywords

Search

Navigation