Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

IFIP International Conference on Distributed Applications and Interoperable Systems

DAIS 2012: Distributed Applications and Interoperable Systems pp 96–103Cite as

  1. Home
  2. Distributed Applications and Interoperable Systems
  3. Conference paper
Spectra: Robust Estimation of Distribution Functions in Networks

Spectra: Robust Estimation of Distribution Functions in Networks

  • Miguel Borges18,
  • Paulo Jesus18,
  • Carlos Baquero18 &
  • …
  • Paulo Sérgio Almeida18 
  • Conference paper
  • 664 Accesses

  • 4 Citations

Part of the Lecture Notes in Computer Science book series (LNCCN,volume 7272)

Abstract

The distributed aggregation of simple aggregates such as minima/maxima, counts, sums and averages have been studied in the past and are important tools for distributed algorithms and network coordination. Nonetheless, this kind of aggregates may not be comprehensive enough to characterize biased data distributions or when in presence of outliers, making the case for richer estimates.

This work presents Spectra, a distributed algorithm for the estimation of distribution functions over large scale networks. The estimate is available at all nodes and the technique depicts important properties: robustness when exposed to high levels of message loss, fast convergence speed and fine precision in the estimate. It can also dynamically cope with changes of the sampled local property and with churn, without requiring restarts. The proposed approach is experimentally evaluated and contrasted to a competing state of the art distribution aggregation technique.

Keywords

  • Cumulative Distribution Function
  • Large Scale Network
  • Fast Convergence Speed
  • Message Loss
  • Interpolation Interval

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Download conference paper PDF

References

  1. Almeida, P.S., Baquero, C., Farach-Colton, M., Jesus, P., Mosteiro, M.A.: Fault-Tolerant Aggregation: Flow-Updating Meets Mass-Distribution. In: Fernàndez Anta, A., Lipari, G., Roy, M. (eds.) OPODIS 2011. LNCS, vol. 7109, pp. 513–527. Springer, Heidelberg (2011)

    CrossRef  Google Scholar 

  2. Borges, M., Jesus, P., Baquero, C., Almeida, P.S.: Spectra: Robust estimation of distribution functions in networks. Tech. Rep. CoRR abs/1204.1373v1, HASLab / INESC TEC & Universidade do Minho (2012), http://arxiv.org/abs/1204.1373v1

  3. Cheng, S., Li, J., Ren, Q., Yu, L.: Bernoulli Sampling Based (ε, δ)-Approximate Aggregation in Large-Scale Sensor Networks. In: 29th IEEE Conference on Information Communications (INFOCOM), pp. 1–9 (2010)

    Google Scholar 

  4. Ganesh, A.J., Kermarrec, A.M., Le Merrer, E., Massoulié, L.: Peer counting and sampling in overlay networks based on random walks. Distributed Computing 20(4), 267–278 (2007)

    CrossRef  Google Scholar 

  5. Haridasan, M., van Renesse, R.: Gossip-based Distribution Estimation in Peer-to-Peer Networks. In: 7th International Conference on Peer-To-Peer Systems (IPTPS). USENIX Association (2008)

    Google Scholar 

  6. Jelasity, M., Montresor, A.: Epidemic-style proactive aggregation in large overlay networks. In: Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS 2004), pp. 102–109. IEEE Computer Society (2004)

    Google Scholar 

  7. Jelasity, M., Montresor, A., Babaoglu, O.: Gossip-based aggregation in large dynamic networks. ACM Transactions on Computer Systems 23(3), 219–252 (2005)

    CrossRef  Google Scholar 

  8. Jesus, P., Baquero, C., Almeida, P.S.: Fault-Tolerant Aggregation for Dynamic Networks. In: 29th IEEE Symposium on Reliable Distributed Systems, pp. 37–43 (2010)

    Google Scholar 

  9. Jesus, P., Baquero, C., Almeida, P.S.: A Survey of Distributed Data Aggregation Algorithms. Tech. Rep. CoRR abs/1110.0725, HASLab / INESC TEC & Universidade do Minho (2011), http://arxiv.org/abs/1110.0725

  10. Lynch, N.A.: Distributed algorithms, pp. 17–23. Kaufmann Publishers Inc. (1996)

    Google Scholar 

  11. Sacha, J., Napper, J., Stratan, C., Pierre, G.: Adam2: Reliable distribution estimation in decentralised environments. In: 2010 IEEE 30th International Conference on Distributed Computing Systems (ICDCS), pp. 697–707 (June 2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. HASLab / INESC TEC & Universidade do Minho, Campus de Gualtar, 4710-057, Braga, Portugal

    Miguel Borges, Paulo Jesus, Carlos Baquero & Paulo Sérgio Almeida

Authors
  1. Miguel Borges
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paulo Jesus
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carlos Baquero
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paulo Sérgio Almeida
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Information Systems, Vienna University of Technology, Argentinierstrasse 8/184-1, 1040, Vienna, Austria

    Karl Michael Göschka

  2. Swedish Institute of Computer Science, Isafjordsgatan 22, 164 29, Kista, Sweden

    Seif Haridi

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 IFIP International Federation for Information Processing

About this paper

Cite this paper

Borges, M., Jesus, P., Baquero, C., Almeida, P.S. (2012). Spectra: Robust Estimation of Distribution Functions in Networks. In: Göschka, K.M., Haridi, S. (eds) Distributed Applications and Interoperable Systems. DAIS 2012. Lecture Notes in Computer Science, vol 7272. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30823-9_8

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-30823-9_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30822-2

  • Online ISBN: 978-3-642-30823-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature