Skip to main content

Acoustic Source Localization for Robotics Networks

  • Chapter
  • First Online:
Robot Operating System (ROS)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 625))

  • 13k Accesses

Abstract

This chapter presents a technical research contribution in the audio for robotics field where ROS was used for validating the results. More specifically it deals with 2D Audio Localization using only the Directions of Arrival (DOAs) of a fixed acoustic source coming from an audio sensor network and proposes a method for estimating the position of the acoustic source using a Gaussian Probability over DOA approach (GP-DOA). This method was thought for robotics purposes and introduces a new perspective of the audio-video synergy using video sensor localization in the environment for extrinsic audio sensor calibration. Test results using Microsoft Kinects as DOA-sensors mounted on robots within the ROS framework, show that the algorithm is robust and modular and prove that the approach can be easily used for robotics applications. The second part is dedicated to the detailed description of the implemented ROS package.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The variance chart is omitted because resembles the one of the mean.

  2. 2.

    http://www.xbox.com/kinect.

  3. 3.

    Note: all figures has the following well-known common notation for 3D axes: x axes are in red, y axes are in green and z axes are in blue.

  4. 4.

    http://winnie.kuis.kyoto-u.ac.jp/HARK.

  5. 5.

    https://github.com/iaslab-unipd/multisensor_calibration.

  6. 6.

    Short video that shows one of the twenty tests made for the second test visible at url https://www.youtube.com/watch?v=TVAQ-sFSpF8.

  7. 7.

    http://www.hark.jp/wiki.cgi?page=HARK+Installation+Instructions.

  8. 8.

    http://www.hark.jp/wiki.cgi?page=HARK-KINECT+Installation+Instructions+%28as+a+USB+recording+device%29.

  9. 9.

    http://www.hark.jp/harkrepos/dists/precise/non-free.

  10. 10.

    https://github.com/iaslab-unipd/multisensor_calibration.

References

  1. P. Aarabi, The fusion of distributed microphone arrays for sound localization. EURASIP J. Adv. Sig. Process. 2003(4), 860465 (2003)

    Google Scholar 

  2. F. Basso, R. Levorato, E. Menegatti, Online calibration for networks of cameras and depth sensors, in OMNIVIS: The 12th Workshop on Non-classical Cameras, Camera Networks and Omnidirectional Vision—2014 IEEE International Conference on Robotics and Automation (ICRA 2014) (2014)

    Google Scholar 

  3. J.H. Di Biase, H.F. Silverman, M. Brandstein, Robust Localization in Reverberant Rooms, in Microphone Arrays: Signal Processing Techniques and Applications (Springer, New York, 2001)

    Google Scholar 

  4. D.R. Griffin, Listening in the Dark: The Acoustic Orientation of Bats and Men (Yale University Press, New Haven, 1958)

    Google Scholar 

  5. M. Hawkes, Arye Nehorai, Wideband source localization using a distributed acoustic vector-sensor array. IEEE Trans. Sig. Process. 51(6), 1479–1491 (2003). June

    Article  MathSciNet  Google Scholar 

  6. R. Levorato, E. Pagello, DOA acoustic source localization in mobile robot sensor networks, in 2015 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), pp. 71–76, Apr 2015

    Google Scholar 

  7. R. Levorato, E. Pagello, Probabilistic 2D Acoustic Source Localization using Direction of Arrivals in Robot Sensor Networks, in Simulation, Modeling, and Programming for Autonomous Robots, Lecture Notes in Computer Science, ed. by D. Brugali, J.F. Broenink, T. Kroeger, B.A. MacDonald (Springer International Publishing, Switzerland, 2014), pp. 474–485

    Google Scholar 

  8. K. Nakadai, T. Takahashi, H.G. Okuno, H. Nakajima, Y. Hasegawa, H. Tsujino, Design and implementation of robot audition system “hark”; open source software for listening to three simultaneous speakers. Adv. Robot. 24(5–6), 739–761 (2010)

    Article  Google Scholar 

  9. M. Omologo, R. De Mori, Acoustic Transduction, in Spoken Dialogue with Computers (Academic Press, New York, 1998)

    Google Scholar 

  10. P. Pertilä, Acoustic source localization in a room environment and at moderate distances. Ph.D. thesis, Tampere University of Technology, 2009

    Google Scholar 

  11. K.B. Petersen, M.S. Pedersen, The matrix cookbook, Nov 2012. Version 20121115

    Google Scholar 

  12. D. Salvati, Acoustic source localization using microphone arrays. Ph.D. thesis, Department of Mathematics and Computer Science, University of Udine, 2012

    Google Scholar 

  13. G. Valenzise, L. Gerosa, M. Tagliasacchi, E. Antonacci, A. Sarti, Scream and gunshot detection and localization for audio-surveillance systems, in IEEE Conference on Advanced Video and Signal Based Surveillance, 2007. AVSS 2007, Sept 2007, pp. 21–26

    Google Scholar 

  14. D.B. Ward, E.A. Lehmann, R.C. Williamson, Particle filtering algorithms for tracking an acoustic source in a reverberant environment. IEEE Trans. Speech Audio Process. 11(6):826–836 (2003)

    Google Scholar 

Download references

Acknowledgments

We strongly thank the Université Pierre-et-Marie-Curie (UPMC) and the Institut des Systèmes Intelligents et de Robotique (ISIR) for hosting Ph.D. Student Riccardo Levorato during the first phases of the project. A special thank goes to Prof. Mohamed Chetouani, Post-Doc Salvatore Maria Anzalone and Ph.D. student Stéphane Michelet for their indispensable support and help.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Riccardo Levorato .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Levorato, R., Pagello, E. (2016). Acoustic Source Localization for Robotics Networks. In: Koubaa, A. (eds) Robot Operating System (ROS). Studies in Computational Intelligence, vol 625. Springer, Cham. https://doi.org/10.1007/978-3-319-26054-9_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26054-9_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26052-5

  • Online ISBN: 978-3-319-26054-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics