Skip to main content

AAA: A Massive Data Acquisition Approach in Large-Scale System Monitoring

  • Conference paper
  • First Online:
  • 785 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9495))

Abstract

The rapid development of information system proposes higher demand for monitoring. Usually we resort to a data acquisition system to collect variety of metrics from each device for real-time anomaly detection, alerting and analysis. It is a great challenge to realize real-time and reliable data collection and gathering in a data acquisition system for large-scale system. In this paper, we propose an Adaptive window Acquisition Algorithm (AAA) to support data acquisition on great amount of data sources. AAA can dynamically adjust its policy according to the number of data sources and the acquisition interval to achieve better performance. The algorithm has been applied to a large management system project. Experimental results show that with the help of dynamic adjusting mechanism, the proposed approach can provide reliable collection service for common data acquisition systems.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Amazon elastic compute cloud (EC2). http://aws.amazon.com/ec2/

  2. Boccardi, F., Huang, H.C.: Limited downlink network coordination in cellular networks. In: Proceedings of the IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC, Athens, Greece, pp. 1–5 (2007)

    Google Scholar 

  3. Chris, T.K.N., Huang, H.: Linear precoding in cooperative MIMO cellular networks with limited coordination clusters. IEEE J. Sel. Areas Commun. 28(9), 1446–1454 (2010)

    Article  Google Scholar 

  4. Endo, P.T., de Almeida Palhares, A.V., Pereira, N.C.V.N., Gonçalves, G.E., Sadok, D., Kelner, J., Melander, B., Mångs, J.: Resource allocation for distributed cloud: concepts and research challenges. IEEE Netw. 25(4), 42–46 (2011)

    Article  Google Scholar 

  5. Funke, D., Brosig, F., Faber, M.: Towards truthful resource reservation in cloud computing. In: 6th International ICST Conference on Performance Evaluation Methodologies and Tools, pp. 253–262 (2012)

    Google Scholar 

  6. Hoydis, J., Kobayashi, M., Debbah, M.: On the optimal number of cooperative base stations in network MIMO systems. CoRR abs/1003.0332 (2010)

    Google Scholar 

  7. Liu, J., Wang, D.: An improved dynamic clustering algorithm for multi-user distributed antenna system. In: Proceedings of International Conference on Wireless Communications and Singal Processing, pp. 1–5 (2009)

    Google Scholar 

  8. Papadogiannis, A., Gesbert, D., Hardouin, E.: A dynamic clustering approach in wireless networks with multi-cell cooperative processing. In: Proceedings of IEEE International Conference on Communication, pp. 4033–4037 (2008)

    Google Scholar 

  9. Pawar, C.S., Wagh, R.B.: A review of resource allocation policies in cloud computing. World J. Sci. Technol. 2(3), 165 (2012)

    Google Scholar 

  10. Sempolinski, P., Thain, D.: A comparison and critique of eucalyptus, opennebula and nimbus. In: Proceedings of the Second International Conference on Cloud Computing, pp. 417–426 (2010)

    Google Scholar 

  11. Venkatesan, S.: Coordinating base stations for greater uplink spectral efficiency in a cellular network. In: Proceedings of the IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC Athens, Greece, pp. 1–5 (2007)

    Google Scholar 

  12. Zhou, S., Gong, J., Niu, Z., Jia, Y., Yang, P.: A decentralized framework for dynamic downlink base station cooperation. In: Proceedings of the Global Communications Conference, 2009. GLOBECOM, pp. 1–6 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yanfei Lv .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhou, R., Lv, Y., Fan, D., Zhang, H., Zhu, C. (2016). AAA: A Massive Data Acquisition Approach in Large-Scale System Monitoring. In: Zhan, J., Han, R., Zicari, R. (eds) Big Data Benchmarks, Performance Optimization, and Emerging Hardware. BPOE 2015. Lecture Notes in Computer Science(), vol 9495. Springer, Cham. https://doi.org/10.1007/978-3-319-29006-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-29006-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-29005-8

  • Online ISBN: 978-3-319-29006-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics