Skip to main content
SpringerLink
Log in

Characterization and Benchmarking of Message-Oriented Middleware

  • Chapter
  • First Online:
Real-Time Intelligence for Heterogeneous Networks

  • 451 Accesses

Abstract

Message-oriented middleware are a crucial part of many distributed systems used to provide message-based communication across the system, and their development has become focused on achieving low latency, high performance, and reliability. In this paper, we focus on the methods of qualitative and quantitative evaluation of message-oriented middleware. We survey previously published researches to present a holistic view of message-oriented middleware evaluation methodologies concentrating on design and benchmarking of various message-oriented middleware. We identify, define, and describe the impact of essential metrics like throughput and latency in message-oriented middleware and the requirements of evaluating message-oriented middleware deployed in the cloud.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Souto, E., Guimaraes, G., Vasconcelos, G., Vieira, M., Rosa, N., & Ferraz, C. (2004). A message-oriented middleware for sensor networks. In Proceedings of the 2nd workshop on Middleware for pervasive and ad-hoc computing, pp. 127–134.

    Google Scholar 

  2. Bao, K., Mauser, I., Kochanneck, S., Xu, H., & Schmeck, H. (2016). A microservice architecture for the intranet of things and energy in smart buildings. In Proceedings of the 1st international workshop on mashups of things and APIs, pp. 1–6.

    Google Scholar 

  3. Subramoni, H., Marsh, G., Narravula, S., Lai, P., & Panda, D. K. (2008). Design and evaluation of benchmarks for financial applications using Advanced Message Queuing Protocol (AMQP) over InfiniBand. In 2008 workshop on high performance computational finance, pp. 1–8. IEEE.

    Google Scholar 

  4. Oliveira, J. P., & Pereira, J. (2013). Experience with a middleware´ infrastructure for service oriented financial applications. In Proceedings of the 28th annual ACM symposium on applied computing, pp. 479–484.

    Google Scholar 

  5. Folkerts, E., Alexandrov, A., Sachs, K., AlexandruIosup, Markl, V., & Tosun, C. (2012). Benchmarking in the cloud: What it should, can, and cannot be. In Technology conference on performance evaluation and benchmarking, pp. 173–188. Springer.

    Google Scholar 

  6. Sachs, K., Kounev, S., Bacon, J., & Buchmann, A. (2009). Performance evaluation of message-oriented middleware using the SPECjms2007 benchmark. Performance Evaluation, 66(8), 410–434.

    Article  Google Scholar 

  7. Hakiri, A., & Gokhale, A. (2016). Data-centric publish/subscribe routing middleware for realizing proactive overlay software-defined networking. In Proceedings of the 10th ACM international conference on distributed and event-based systems, pp. 246–257.

    Google Scholar 

  8. OpenMessaging. (n.d.). Retrieved from http://openmessaging.cloud/

  9. Maheshwari, P., & Pang, M. (2005). Benchmarking message-oriented middleware: TIB/RV versus SonicMQ. Concurrency and Computation: Practice and Experience, 17(12), 1507–1526.

    Article  Google Scholar 

  10. Dobbelaere, P., & Esmaili, K. S. (2017). Kafka versus RabbitMQ: A comparative study of two industry reference publish/subscribe implementations: Industry Paper. In Proceedings of the 11th ACM international conference on distributed and event-based systems, pp. 227–238.

    Google Scholar 

  11. John, V., & Liu, X. (2017). A survey of distributed message broker queues. arXiv preprint arXiv:1704.00411.

    Google Scholar 

  12. Ionescu, V. M. (2015). The analysis of the performance of RabbitMQ and ActiveMQ. In 2015 14th RoEduNet international conference networking in education and research (RoEduNet NER), pp. 132–137. IEEE.

    Google Scholar 

  13. Eugster, P. T., Felber, P. A., Guerraoui, R., & Kermarrec, A. M. (2003). The many faces of publish/subscribe. ACM computing surveys (CSUR), 35(2), 114–131.

    Article  Google Scholar 

  14. Rostanski, M., Grochla, K., & Seman, A. (2014). Evaluation of highly available and fault-tolerant middleware clustered architectures using RabbitMQ. In 2014 federated conference on computer science and information systems, pp. 879–884. IEEE.

    Google Scholar 

  15. Docs.nats.io. (2020). Introduction [online]. Available at: https://docs.nats.io/

  16. Pulsar.apache.org. (2020). Pulsar Overview · Apache Pulsar [online]. Available at: https://pulsar.apache.org/docs/en/concepts-overview/

  17. Documentation: Table of Contents – RabbitMQ [online] Available at: https://www.rabbitmq.com/documentation.html

  18. ActiveMQ [online]. Available at: https://activemq.apache.org/clustering.html

  19. Ahuja, S. P., & Mupparaju, N. (2014). Performance evaluation and comparison of distributed messaging using message oriented middleware. Computer and information science, 7(4), 9.

    Article  Google Scholar 

  20. Tran, P., Greenfield, P., & Gorton, I. (2002). Behavior and performance of message-oriented middleware systems. In Proceedings 22nd international conference on distributed computing systems workshops, pp. 645–650. IEEE.

    Google Scholar 

  21. Appel, S., Sachs, K., & Buchmann, A. (2010). Towards benchmarking of AMQP. In Proceedings of the fourth ACM international conference on distributed event-based systems, pp. 99–100.

    Google Scholar 

  22. Luzuriaga, J. E., Perez, M., Boronat, P., Cano, J. C., Calafate, C., & Manzoni, P. (2015). A comparative evaluation of AMQP and MQTT protocols over unstable and mobile networks. In 12th annual IEEE consumer communications and networking conference (CCNC), pp. 931–936. IEEE.

    Google Scholar 

  23. van Steen, M., & Tanenbaum, A. S. (2017). Distributed systems (3rd Ed.). distributed-systems.net

  24. Perry, M., Delporte, C., Demi, F., Ghosh, A., & Luong, M. (2001). MQSeries publish/subscribe applications. IBM Redbook.

    Google Scholar 

  25. https://mosquitto.org/ChangeLog.txt. (2020). Introduction. [online] Available at: https://mosquitto.org/ChangeLog.txt

  26. Sachs, K., Kounev, S., Appel, S., & Buchmann, A. (2009). Benchmarking of message-oriented middleware. In Proceedings of the third ACM international conference on distributed event-based systems, pp. 1–2.

    Google Scholar 

  27. Sachs, K., Kounev, S., Appel, S., & Buchmann, A. (2009). A performance test harness for publish/subscribe middleware. In SIGMETRICS/Performance.

    Google Scholar 

  28. Sachs, K., Kounev, S., Bacon, J., & Buchmann, A. (2007). Workload characterization of the SPECjms2007 benchmark. In European performance engineering workshop, pp. 228–244. Springer.

    Google Scholar 

  29. Sachs, K., Kounev, S., & Buchmann, A. (2013). Performance modeling and analysis of message-oriented event-driven systems. Software Systems Modeling, 12(4), 705–729.

    Article  Google Scholar 

  30. Sachs, K., Appel, S., Kounev, S., & Buchmann, A. (2010). Benchmarking publish/subscribe-based messaging systems. In International conference on database systems for advanced applications, pp. 203–214. Springer.

    Google Scholar 

  31. The OpenMessaging Benchmark. (n.d.). Retrieved from http://openmessaging.cloud/docs/benchmarks/

Download references

Author information

Authors and Affiliations

  1. Bharati Vidyapeeth’s College of Engineering, New Delhi, India

    Aarush Ahuja, Vanita Jain & Dharmender Saini

Authors
  1. Aarush Ahuja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vanita Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dharmender Saini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vanita Jain .

Editor information

Editors and Affiliations

  1. Artificial intelligence Engineering Department, Research Center for AI and IoT, Near East University, Mersin, Turkey

    Fadi Al-Turjman

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ahuja, A., Jain, V., Saini, D. (2021). Characterization and Benchmarking of Message-Oriented Middleware. In: Al-Turjman, F. (eds) Real-Time Intelligence for Heterogeneous Networks. Springer, Cham. https://doi.org/10.1007/978-3-030-75614-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-75614-7_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-75613-0

  • Online ISBN: 978-3-030-75614-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation