Skip to main content

Issues and Ongoing Work on State-Driven Workload Generation for Distributed Systems

  • Conference paper
Dependable Computing (EWDC 2013)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 7869))

Included in the following conference series:

Abstract

The dependability of a complex distributed system needs to be assured against the several conditions, namely states, in which it can operate. Generating a workload able to cover a desired target state of a distributed system is still a difficult task, since the relationship between the workload and states is nontrivial due to system complexity and non-deterministic factors. This work discusses our ongoing work on a state-driven workload generation approach for distributed systems, based on an evolutionary algorithm, and its preliminary implementation for testing a fault-tolerant distributed system for flight data processing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Chillarege, R., Iyer, R.: An experimental study of memory fault latency. IEEE Trans. Computers 38(6), 869–874 (1989)

    Article  Google Scholar 

  2. Czeck, E., Siewiorek, D.: Observations on the Effects of Fault Manifestation as a Function of Workload. IEEE Trans. Computers 41(5), 559–566 (1992)

    Article  Google Scholar 

  3. Meyer, J., Wei, L.: Analysis of workload influence on dependability. In: Proc. Intl. Fault-Tolerant Computing Symp., pp. 84–89 (1988)

    Google Scholar 

  4. Lefever, R., Cukier, M., Sanders, W.: An experimental evaluation of correlated network partitions in the Coda distributed file system. In: Proc. Intl. Symp. Reliable Distributed Systems, pp. 273–282 (2003)

    Google Scholar 

  5. Chandra, R., Lefever, R., Joshi, K., Cukier, M., Sanders, W.: A Global-State-Triggered Fault Injector for Distributed System Evaluation. IEEE Trans. Parallel and Distributed Sys. 15(7), 593–605 (2004)

    Article  Google Scholar 

  6. Vieira, M., Madeira, H.: A dependability benchmark for OLTP application environments. In: Proc. 29th Intl. Conf. on Very Large Data Bases, pp. 742–753 (2003)

    Google Scholar 

  7. Arlat, J., Aguera, M., Amat, L., Crouzet, Y., Fabre, J., Laprie, J., Martins, E., Powell, D.: Fault injection for dependability validation: A methodology and some applications. IEEE Trans. Software Eng. 16(2), 166–182 (1990)

    Article  Google Scholar 

  8. Meling, H., Montresor, A., Helvik, B., Babaoglu, O.: Jgroup/ARM: a distributed object group platform with autonomous replication management. Software: Practice and Experience 38(9), 885–923 (2008)

    Article  Google Scholar 

  9. Tsai, T., Hsueh, M., Zhao, H., Kalbarczyk, Z., Iyer, R.: Stress-Based and Path-Based Fault Injection. IEEE Trans. Computers 48(11), 1183–1201 (1999)

    Article  Google Scholar 

  10. Kiskis, D., Shin, K.: Swsl: A synthetic workload specification language for real-time systems. IEEE Transactions on Software Engineering 20(10), 798–811 (1994)

    Article  Google Scholar 

  11. Duraes, J., Madeira, H.: Generic faultloads based on software faults for dependability benchmarking. In: 2004 International Conference on Dependable Systems and Networks, pp. 285–294. IEEE (2004)

    Google Scholar 

  12. Kalakech, A., Kanoun, K., Crouzet, Y., Arlat, J.: Benchmarking the Dependability of Windows NT4, 2000 and XP. In: 2004 International Conference on Dependable Systems and Networks, pp. 681–686. IEEE (2004)

    Google Scholar 

  13. Zhang, F., Cheung, T.Y.: Optimal transfer trees and distinguishing trees for testing observable nondeterministic finite-state machines. IEEE Transactions on Software Engineering 29(1), 1–14 (2003)

    Article  Google Scholar 

  14. Nachmanson, L., Veanes, M., Schulte, W., Tillmann, N., Grieskamp, W.: Optimal strategies for testing nondeterministic systems. ACM SIGSOFT Software Engineering Notes 29(4), 55–64 (2004)

    Article  Google Scholar 

  15. McMinn, P.: Search-based software test data generation: a survey. Software Testing, Verification and Reliability 14(2), 105–156 (2004)

    Article  Google Scholar 

  16. Clarke, E.M., Grumberg, O., Peled, D.A.: Model checking. MIT Press (2000)

    Google Scholar 

  17. Holzmann, G.J., Smith, M.H.: An automated verification method for distributed systems software based on model extraction. IEEE Transactions on Software Engineering 28(4), 364–377 (2002)

    Article  Google Scholar 

  18. Kerbrat, A., Jéron, T., Groz, R.: Automated test generation from sdl specifications. In: The Next Millennium–Proceedings of the 9th SDL Forum, pp. 135–152 (1999)

    Google Scholar 

  19. Fernandez, J.-C., Mounier, L., Pachon, C.: A model-based approach for robustness testing. In: Khendek, F., Dssouli, R. (eds.) TestCom 2005. LNCS, vol. 3502, pp. 333–348. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  20. Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Software Testing, Verification and Reliability (2012)

    Google Scholar 

  21. Jain, R.: The art of computer systems performance analysis. John Wiley & Sons New York (1991)

    Google Scholar 

  22. Avritzer, A., Weyuker, E.J.: Deriving workloads for performance testing. Software: Practice and Experience 26(6), 613–633 (1996)

    Article  Google Scholar 

  23. Weyuker, E.J., Vokolos, F.I.: Experience with performance testing of software systems: issues, an approach, and case study. IEEE Transactions on Software Engineering 26(12), 1147–1156 (2000)

    Article  Google Scholar 

  24. Kiskis, D.L., Shin, K.G.: A synthetic workload for a distributed real-time system. Real-Time Systems 11(1), 5–18 (1996)

    Article  Google Scholar 

  25. Arlat, J., Aguera, M., Crouzet, Y., Fabre, J., Martins, E., Powell, D.: Experimental evaluation of the fault tolerance of an atomic multicast system. IEEE Transactions on Reliability 39(4), 455–467 (1990)

    Article  Google Scholar 

  26. Basile, C., Wang, L., Kalbarczyk, Z., Iyer, R.: Group communication protocols under errors. In: Proceedings of the 22nd International Symposium on Reliable Distributed Systems, pp. 35–44. IEEE (2003)

    Google Scholar 

  27. Dawson, S., Jahanian, F., Mitton, T., Tung, T.: Testing of fault-tolerant and real-time distributed systems via protocol fault injection. In: Proc. Fault Tolerant Computing Symp., pp. 404–414 (1996)

    Google Scholar 

  28. Hoarau, W., Tixeuil, S.: A language-driven tool for fault injection in distributed systems. In: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, pp. 194–201 (2005)

    Google Scholar 

  29. Coulouris, G., Dollimore, J., Kindberg, T.: Distributed Systems: Concepts and Design. Addison-Wesley (2001)

    Google Scholar 

  30. Poirier, B., Roy, R., Dagenais, M.: Accurate offline synchronization of distributed traces using kernel-level events. ACM SIGOPS Operating Systems Review 44(3), 75–87 (2010)

    Article  Google Scholar 

  31. De Jong, K.A.: Evolutionary computation: a unified approach. MIT Press (2006)

    Google Scholar 

  32. Natella, R., Scippacercola, F.: State-Driven Workload Generation in Distributed Systems: System Model of an FDPS. Technical report (2013), http://wpage.unina.it/roberto.natella/reports/

  33. Natella, R., Cotroneo, D.: Emulation of transient software faults for dependability assessment: A case study. In: Proc. European Dependable Computing Conf., pp. 23–32 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Natella, R., Scippacercola, F. (2013). Issues and Ongoing Work on State-Driven Workload Generation for Distributed Systems. In: Vieira, M., Cunha, J.C. (eds) Dependable Computing. EWDC 2013. Lecture Notes in Computer Science, vol 7869. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38789-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38789-0_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38788-3

  • Online ISBN: 978-3-642-38789-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics