Precision, Recall, and Sensitivity of Monitoring Partially Synchronous Distributed Systems

  • Sorrachai YingchareonthawornchaiEmail author
  • Duong N. Nguyen
  • Vidhya Tekken Valapil
  • Sandeep S. Kulkarni
  • Murat Demirbas
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10012)


Runtime verification focuses on analyzing the execution of a given program by a monitor to determine if it is likely to violate its specifications. There is often an impedance mismatch between the assumptions/model of the monitor and that of the underlying program. This constitutes problems especially for distributed systems, where the concept of current time and state are inherently uncertain. A monitor designed with asynchronous system model assumptions may cause false-positives for a program executing in a partially synchronous system: the monitor may flag a global predicate that does not actually occur in the underlying system. A monitor designed with a partially synchronous system model assumption may cause false negatives as well as false positives for a program executing in an environment where the bounds on partial synchrony differ (albeit temporarily) from the monitor model assumptions.

In this paper we analyze the effects of the impedance mismatch between the monitor and the underlying program for the detection of conjunctive predicates. We find that there is a small interval where the monitor assumptions are hypersensitive to the underlying program environment. We provide analytical derivations for this interval, and also provide simulation support for exploring the sensitivity of predicate detection to the impedance mismatch between the monitor and the program under a partially synchronous system.


False Positive Rate Linear Temporal Logic Clock Synchronization Impedance Mismatch Asynchronous System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work is supported in part by NSF CNS-1329807, NSF CNS-1318678, NSF XPS-1533870, and NSF XPS-1533802.


  1. 1.
    Fan, R., Lynch, N.: Gradient clock synchronization. In: PODC, pp. 320–327 (2004)Google Scholar
  2. 2.
    Patt-Shamir, B., Rajsbaum, S.: A theory of clock synchronization (extended abstract). In: ACM Symposium on Theory of Computing (STOC), pp. 810–819 (1994)Google Scholar
  3. 3.
    Sheehy, J.: There is no now. Commun. ACM 58(5), 36–41 (2015)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Mills, D.: A brief history of NTP time: memoirs of an internet timekeeper. ACM SIGCOMM Comput. Commun. Rev. 33(2), 9–21 (2003)CrossRefGoogle Scholar
  5. 5.
    Lamport, L.: Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21(7), 558–565 (1978)CrossRefzbMATHGoogle Scholar
  6. 6.
    Yingchareonthawornchai, S., Nguyen, D., Valapil, V.T., Kulkarni, S.S., Demirbas, M.: Precision, recall, sensitivity of monitoring partially synchronous distributed systems. CoRR, abs/1607.03369 (2016).
  7. 7.
    Garg, V.K., Chase, C.: Distributed algorithms for detecting conjunctive predicates. In: International Conference on Distributed Computing Systems, pp. 423–430, June 1995Google Scholar
  8. 8.
    Lu, H., Veeraraghavan, K., Ajoux, P., Hunt, J., Song, Y.-J., Tobagus, W., Kumar, S., Lloyd, W.: Existential consistency: measuring and understanding consistency at Facebook. In: Proceedings of the 25th Symposium on Operating Systems Principles, pp. 295–310. ACM (2015)Google Scholar
  9. 9.
    Sigelman, B., Barroso, L., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., Jaspan, S., Shanbhag, C.: Dapper, a large-scale distributed systems tracing infrastructure. Google Inc., Technical report (2010).
  10. 10.
    Chow, M., Meisner, D., Flinn, J., Peek, D., Wenisch, T.: The mystery machine: end-to-end performance analysis of large-scale internet services. In: 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2014), pp. 217–231 (2014)Google Scholar
  11. 11.
    Cooper, R., Marzullo, K.: Consistent detection of global predicates. ACM SIGPLAN Not. 26(12), 167–174 (1991)CrossRefGoogle Scholar
  12. 12.
    Verissimo, P.: Real-time communication. In: Distributed Systems, vol. 2 (1993)Google Scholar
  13. 13.
    Stoller, S.: Detecting global predicates in distributed systems with clocks. Distrib. Comput. 13(2), 85–98 (2000)CrossRefGoogle Scholar
  14. 14.
    Kulkarni, S.S., Demirbas, M., Madappa, D., Avva, B., Leone, M.: Logical physical clocks. In: Aguilera, M.K., Querzoni, L., Shapiro, M. (eds.) OPODIS 2014. LNCS, vol. 8878, pp. 17–32. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-14472-6_2 Google Scholar
  15. 15.
    Demirbas, M., Kulkarni, S.: Beyond truetime: using augmentedtime for improving google spanner. In: 7th Workshop on Large-Scale Distributed Systems and Middleware, LADIS (2013)Google Scholar
  16. 16.
    Charron-Bost, B.: Concerning the size of logical clocks in distributed systems. Inf. Process. Lett. 39(1), 11–16 (1991)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Yingchareonthawornchai, S., Kulkarni, S., Demirbas, M.: Analysis of bounds on hybrid vector clocks. In: 19th International Conference on Principles of Distributed Systems, OPODIS (2015)Google Scholar
  18. 18.
    Zhang, H., Diao, Y., Immerman, N.: Recognizing patterns in streams with imprecise timestamps. Proc. VLDB Endow. 3(1–2), 244–255 (2010). CrossRefGoogle Scholar
  19. 19.
    Wang, S., Ayoub, A., Sokolsky, O., Lee, I.: Runtime verification of traces under recording uncertainty. In: Khurshid, S., Sen, K. (eds.) RV 2011. LNCS, vol. 7186, pp. 442–456. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-29860-8_35 CrossRefGoogle Scholar
  20. 20.
    Mostafa, M., Bonakdarpour, B.: Decentralized runtime verification of LTL specifications in distributed systems. In: 2015 IEEE International Parallel, Distributed Processing Symposium, IPDPS 2015, 25–29 May 2015 Hyderabad, India, pp. 494–503 (2015).
  21. 21.
    Basin, D., Klaedtke, F., Marinovic, S., Zălinescu, E.: On real-time monitoring with imprecise timestamps. In: Bonakdarpour, B., Smolka, S.A. (eds.) RV 2014. LNCS, vol. 8734, pp. 193–198. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-11164-3_16 Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Sorrachai Yingchareonthawornchai
    • 1
    Email author
  • Duong N. Nguyen
    • 1
  • Vidhya Tekken Valapil
    • 1
  • Sandeep S. Kulkarni
    • 1
  • Murat Demirbas
    • 2
  1. 1.Department of Computer Science and EngineeringMichigan State UniversityEast LansingUSA
  2. 2.Department of Computer Science and EngineeringUniversity at Buffalo, The State University of New YorkBuffaloUSA

Personalised recommendations