Providing Common Time and Space in Distributed AV-Sensor Networks by Self-Calibration

  • R. Lienhart
  • I. Kozintsev
  • D. Budnikov
  • I. Chikalov
  • V. C. Raykar
Part of the Studies in Fuzziness and Soft Computing book series (STUDFUZZ, volume 168)


Array audio-visual signal processing algorithms require time-synchronized capture of AV-data on distributed platforms. In addition, the geometry of the array of cameras, microphones, speakers and displays is often required. In this chapter we present a novel setup involving network of wireless computing platforms with sensors and actuators onboard, and algorithms that can provide both synchronized I/O and self-localization of the I/O devices in 3D space. The proposed algorithms synchronize input and output for a network of distributed multi-channel audio sensors and actuators connected to general purpose computing platforms (GPCs) such as laptops, PDAs and tablets. IEEE 802.11 wireless network is used to deliver the global clock to distributed GPCs, while the interrupt timestamping mechanism is employed to distribute the clock between I/O devices. Experimental results demonstrate a precision in A/D D/A synchronization precision better than 50 μs (a couple of samples at 48 kHz). We also present a novel algorithm to automatically determine the relative 3D positions of the sensors and actuators connected to GPCs. A closed form approximate solution is derived using the technique of metric multidimensional scaling, which is further refined by minimizing a non-linear error function. Our formulation and solution account for the errors in localization, due to lack of temporal synchronization among different platforms. The performance limit for the sensor positions is analyzed with respect to the number of sensors and actuators as well as their geometry. Simulation results are reported together with a discussion of the practical issues in a real-time system.


distributed sensor networks self-localizing sensor networks multichannel signal processing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Elson, J., Girod, L., Estrin, D. (2000) Fine-grained network time synchronization using reference broadcasts. 5th Symposium on OS Design and Implementation.Google Scholar
  2. 2.
    Fancourt, C., Parra, L. (2001) The coherence function in blind source separation of convolutive mixtures of non-stationary signals. Proc IEEE Workshop on Neural Networks for Signal Processing, 303–312.Google Scholar
  3. 3.
    Gill, P., Murray, W., Wright, M. (1981) Practical Optimization.Google Scholar
  4. 4.
    Girod, L., Bychkovskiy, V., Elson, J., Estrin, D. (2002) Locating tiny sensors in time and space: A case study. Proc. International Conference on Computer Design.Google Scholar
  5. 5.
    Knapp, C., Carter, G. (1976) The generalized correlation method for estimation of time delay. IEEE Trans. Acoust., Speech, Signal Processing, ASSP-24(4), 320–327.CrossRefGoogle Scholar
  6. 6.
    Lamport, L., Melliar-Smith, P. (1985) Synchronizing clocks in the presence of faults. JACM, 32(1), 52–78.zbMATHMathSciNetCrossRefGoogle Scholar
  7. 7.
    Lienhart, R., Kozintsev, I., Wehr, S. (2003) Universal synchronization scheme for distributed audio-video capture on heterogeneous computing platforms. Proc 11th ACM Conf on Multimedia, 263–266.Google Scholar
  8. 8.
    Lienhart, R., Kozintsev, I., Wehr, S., Yeung, M. (2003) On the importance of exact synchronization for distributed audio processing. Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing.Google Scholar
  9. 9.
    Mills, D. (1991) Internet time synchronization: the network time protocol. IEEE Tran Comm, 39(10), 1482–1493.CrossRefGoogle Scholar
  10. 10.
    Mock, M., Frings, R., Nett, E., Trikaliotis, S. (2000) Clock synchronization for wireless local area networks. IEEE 12th Euromicro Conference on Real-Time Systems (Euromicro RTS 2000), 183–189.Google Scholar
  11. 11.
    Moses, R., Krishnamurthy, D., Patterson, R. (2003) A self-localization method for wireless sensor networks. Eurasip Journal on Applied Signal Processing Special Issue on Sensor Networks, 2003(4), 348–358.zbMATHGoogle Scholar
  12. 12.
    Press, H., Teukolsky, S., Vettring, W., Flannery, B. (1995) Numerical Recipes in C The Art of Scientific Computing. Cambridge University Press, 2 edition.Google Scholar
  13. 13.
    Raykar, V., Kozintsev, I., Lienhart, R. (2003) Self localization of acoustic sensors and actuators on distributed platforms. International Workshop on Multimedia Technologies in E-Learning and Collaboration (WOMTEC).Google Scholar
  14. 14.
    Rousseeuw, P. (1984) Least median-of-squares regression. JACM, 79, 871–880.zbMATHMathSciNetGoogle Scholar
  15. 15.
    Sachar, J., Silverman, H., Patterson, W. (2002) Position calibration of large-aperture microphone arrays. Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, 1797–1800.Google Scholar
  16. 16.
    Savvides, A., Han, C, Srivastava, M. (2001) Dynamic fine-grained localization in ad-hoc wireless sensor networks. Proc. International Conference on Mobile Computing and Networking.Google Scholar
  17. 17.
    Torgerson, W. (1952) Multidimensional scaling: I. theory and method. Psychometrika, 17, 401–419.zbMATHMathSciNetCrossRefGoogle Scholar
  18. 18.
    Van Trees, H. (2001) Detection, Estimation, and Modulation Theory, 1. Wiley-Interscience.Google Scholar
  19. 19.
    Weiss, A., Friedlander, B. (1989) Array shape calibration using sources in unknown locations-a maxilmum-likelihood approach. IEEE Trans. Acoust., Speech, Signal Processing, 37(12), 1958–1966.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • R. Lienhart
    • 1
  • I. Kozintsev
    • 1
  • D. Budnikov
    • 2
  • I. Chikalov
    • 2
  • V. C. Raykar
    • 3
  1. 1.Intel ResearchIntel CorporationSanta ClaraUSA
  2. 2.Intel ResearchIntel CorporationNizhny NovgorodRussia
  3. 3.Perceptual Interfaces and Realities Lab.University of MarylandCollege ParkUSA

Personalised recommendations