Abstract
Performance testing of communicating protocols is a qualitative and quantitative test of a system, aiming at verifying whether the performance requirements of the protocol have been satisfied under certain conditions. On the other hand, conformance testing of communicating protocols is a functional test which verifies whether the behaviours of the protocol satisfy defined requirements. It raises the interesting issue of how to accurately formalize the performance requirements and how to converge these two kinds of tests by using the same formal approach. In this paper, we present a novel logic-based approach to distributively test the conformance and performance of a protocol, through real execution traces and formally specified properties. In order to evaluate and assess our methodology, we have designed a distributed testing framework and developed a prototype for testing network protocols. Finally, the relevant verdicts of experiments with a set of IMS/SIP properties and discussions are provided.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lee, D., Miller, R.: Network protocol system monitoring-a formal approach with passive testing. IEEE/ACM Transactions on Networking 14(2), 424–437 (2006)
Lalanne, F., Maag, S.: A formal data-centric approach for passive testing of communication protocols. IEEE / ACM Transactions on Networking (2012)
Hierons, R.M., Krause, P., Luttgen, G., Simons, A.J.H.: Using formal specifications to support testing. ACM Computing Surveys 41(2), 176 (2009)
Lalanne, F., Che, X., Maag, S.: Data-centric property formulation for passive testing of communication protocols. In: Proceedings of the 13th IASME/WSEAS, ACC 2011/MMACTEE 2011, pp. 176–181 (2011)
Che, X., Lalanne, F., Maag, S.: A logic-based passive testing approach for the validation of communicating protocols. In: Proceedings of the 7th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2012, Wroclaw, Poland, pp. 53–64 (2012)
Bauer, A., Leucker, M., Schallhart, C.: Runtime verification for ltl and tltl. ACM Transactions on Software Engineering and Methodology 20, 14 (2011)
Weyuker, E.J., Vokolos, F.I.: Experience with performance testing of software systems: Issues, an approach, and case study. IEEE Trans. Software Eng. 26, 1147–1156 (2000)
Hofmann, R., Klar, R., Mohr, B., Quick, A., Siegle, M.: Distributed performance monitoring: Methods, tools and applications. IEEE Transactions on Parallel and Distributed Systems 5, 585–597 (1994)
Dumitrescu, C., Raicu, I., Ripeanu, M., Foster, I.: Diperf: An automated distributed performance testing framework. In: 5th International Workshop in Grid Computing, pp. 289–296. IEEE Computer Society (2004)
Denaro, G., Bicocca, U.D.M., Polini, A., Emmerich, W.: Early performance testing of distributed software applications. In: SIGSOFT Software Engineering Notes, pp. 94–103 (2004)
Aguilera, M.K., Mogul, J.C., Wiener, J.L., Reynolds, P., Muthitacharoen, A.: Performance debugging for distributed systems of black boxes. SIGOPS Oper. Syst. Rev. 37, 74–89 (2003)
Yilmaz, C., Krishna, A.S., Memon, A., Porter, A., Schmidt, D.C., Gokhale, A., Natarajan, R.: Main effects screening: a distributed continuous quality assurance process for monitoring performance degradation in evolving software systems. In: ICSE 2005: Proceedings of the 27th International Conference on Software Engineering, pp. 293–302. ACM Press (2005)
Yuen, C.H., Chan, S.H.: Scalable real-time monitoring for distributed applications. IEEE Transactions on Parallel and Distributed Systems 23, 2330–2337 (2012)
Taufer, M., Stricker, T.: A performance monitor based on virtual global time for clusters of pcs. In: Proceedings of IEEE International Conference on Cluster Computing, pp. 64–72 (2003)
Emden, M.V., Kowalski, R.: The semantics of predicate logic as a programming language. Journal of the ACM 23(4), 733–742 (1976)
9646-1, I.: ISO/IEC information technology - open systems interconnection - conformance testing methodology and framework - part 1: General concepts. Technical report, ISO (1994)
Shin, M., Park, M., Oh, D., Kim, B., Lee, J.: Clock synchronization for one-way delay measurement: A survey. In: Kim, T.H., Adeli, H., Robles, R., Balitanas, M. (eds.) ACN 2011. CCIS, vol. 199, pp. 1–10. Springer, Heidelberg (2011)
Mills, D.L.: Internet time synchronization: the network time protocol. IEEE Transactions on Communications 39, 1482–1493 (1991)
Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston, A., Peterson, J.: Sip: Session initiation protocol (2002)
Alliance, O.M.: Internet messaging and presence service features and functions (2005)
Alliance, O.M.: Push to talk over cellular requirements (2006)
Hewlett-Packard: SIPp (2004), http://sipp.sourceforge.net/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Che, X., Maag, S. (2013). Testing Distributed Communication Protocols by Formal Performance Monitoring. In: Filipe, J., Maciaszek, L.A. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE 2013. Communications in Computer and Information Science, vol 417. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54092-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-54092-9_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-54091-2
Online ISBN: 978-3-642-54092-9
eBook Packages: Computer ScienceComputer Science (R0)