Advertisement

DART: Distributed Automated Regression Testing for Large-Scale Network Applications

  • Brent N. Chun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3544)

Abstract

This paper presents DART, a framework for distributed automated regression testing of large-scale network applications. DART provides programmers writing distributed applications with a set of primitives for writing distributed tests and a runtime that executes distributed tests in a fast and efficient manner over a network of nodes. It provides a programming environment, scripted execution of multi-node commands, fault injection, and performance anomaly injection. We have implemented a prototype implementation of DART that implements a useful subset of the DART architecture and is targeted at the Emulab network emulation environment. Our prototype is functional, fast, and is currently being used to test the correctness, robustness, and performance of PIER, a distributed relational query processor.

Keywords

Packet Loss Network Topology Fault Injection Test Execution Query Processor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Andersen, D., Balakrishnan, H., Kaashoek, F., Morris, R.: Resilient Overlay Networks. In: Proceedings of the 18th ACM Symposium on Operating Systems Principles (October 2001)Google Scholar
  2. 2.
    Andersen, D.G., Balakrishnan, H., Kaashoek, M.F., Morris, R.: Experience with an Evolving Overlay Network Testbed. ACM Computer Communications Review 33(3), 13–19 (2003)CrossRefGoogle Scholar
  3. 3.
    Arpaci-Dusseau, R.H.: Performance Availability for Networks of Workstations. PhD thesis, University of California, Berkeley (1999)Google Scholar
  4. 4.
    Beck, K.: Extreme Programming Explained: Embrace Change, October 1999. Addison-Wesley Professional, Reading (1999)Google Scholar
  5. 5.
    Dabek, F., Kaashoek, M.F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In: Proceedings of the 18th ACM Symposium on Operating Systems Principles (October 2001)Google Scholar
  6. 6.
    Demers, A., Keshav, S., Shenker, S.: Anaylsis and Simulation of a Fair Queueing Algorithm. In: Proceedings of the 35th IEEE Computer Society International Conference (COMPCON), March 1990, pp. 380–386 (1990)Google Scholar
  7. 7.
    Ellen, W., Zegura, K.C., Bhattacharjee, S.: How to Model an Internetwork. In: Proceedings of IEEE Infocom 1996 (March 1996)Google Scholar
  8. 8.
    Freedman, M., Freudenthal, E., Mazières, D.: Democratizing Content Publication with Coral. In: Proceedings of the 1st Symposium on Networked Systems Design and Implementation (March 2004)Google Scholar
  9. 9.
    Hand, S.: Self-Paging in the Nemesis Operating System. In: Proceedings of the 3rd USENIX Symposium on Operating Systems Design and Implementation (February 1999)Google Scholar
  10. 10.
    Huebsch, R., Hellerstein, J.M., Lanham, N., Loo, B.T., Shenker, S., Stoica, I.: Querying the Internet with PIER. In: Proceedings of the 29th International Conference on Very Large Data Bases (September 2003)Google Scholar
  11. 11.
    Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Weimer, W., Wells, C., Zhao, B.: OceanStore: An Architecture for Global-Scale Persistent Storage. In: Proceedings of the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems (November 2002)Google Scholar
  12. 12.
    Muthitacharoen, A., Morris, R., Gil, T., Chen, B.: Ivy: A Read/Write Peer-to-peer File System. In: Proceedings of the 5th USENIX Symposium on Operating Systems Design and Implementation (December 2002)Google Scholar
  13. 13.
    Oppenheimer, D., Vatkovskiy, V., Patterson, D.A.: Towards a Framework for Automated Robustness Evaluation of Distributed Services. In: Proceedings of the 2nd Bertinoro Workshop on Future Directions in Distributed Computing (FuDiCo II): Survivability: Obstacles and Solutions (June 2004)Google Scholar
  14. 14.
    Pai, V.S., Wang, L., Park, K., Pang, R., Peterson, L.: The Dark Side of the Web: An Open Proxy’s View. In: Proceedings of the 2nd Workshop on Hot Topics in Networks (November 2003)Google Scholar
  15. 15.
    Peterson, L., Culler, D., Anderson, T., Roscoe, T.: A Blueprint for Introducing Disruptive Technology into the Internet. In: Proceedings of HotNets-I (October 2002)Google Scholar
  16. 16.
    Petrou, D., Rodrigues, S.H., Vahdat, A., Anderson, T.E.: GLUnix: A Global Layer Unix for a Network of Workstations. In: Software - Practice and Experience 28, pp. 929–961 (1998)Google Scholar
  17. 17.
    Ramasubramanian, V., Sirer, E.G.: The Design and Implementation of a Next Generation Name Service for the Internet. In: Proceedings of the ACM SIGCOMM 2004 Conference on Communications Architectures and Protocols (August 2004)Google Scholar
  18. 18.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A Scalable Content-Addressable Network. In: Proceedings of the ACM SIGCOMM 2001 Conference on Communications Architectures and Protocols (August 2001)Google Scholar
  19. 19.
    Rhea, S., Geels, D., Roscoe, T., Kubiatowicz, J.: Handling Churn in a DHT. In: Proceedings of the USENIX 2004 Annual Technical Conference (June 2004)Google Scholar
  20. 20.
    Rizzo, L.: Dummynet and Forward Error Correction. In: Proceedings of the USENIX 1998 Annual Technical Conference (FREENIX Track) (June 1998)Google Scholar
  21. 21.
    Rowstron, A., Druschel, P.: Pastry: Scalable, Distributed Object Location and Routing for Large-scale Peer-to-peer Systems. In: Proceedings of the 18th IFIP/ACM International Conference on Distributed Systems Platforms (November 2001)Google Scholar
  22. 22.
    Saroiu, S., Gummadi, K.P., Gribble, S.D.: Measuring and Analyzing the Characteristics of Napster and Gnutella Hosts. Multimedia Systems 9, 170–184 (2003)Google Scholar
  23. 23.
    Shenoy, P., Vin, H.M.: Cello: A Disk Scheduling Framework for Next Generation Operating Systems. In: Proceedings of the 1998 ACM SIGMETRICS Conference, June 1998, pp. 44–55 (1998)Google Scholar
  24. 24.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup service for internet applications. In: Proceedings of the ACM SIGCOMM 2001 Conference on Communications Architectures and Protocols (September 2001)Google Scholar
  25. 25.
    Subramanian, L., Stoica, I., Balakrishnan, H., Katz, R.: OverQoS: An Overlay Based Architecture for Enhancing Internet QoS. In: Proceedings of the 1st Symposium on Networked Systems Design and Implementation (March 2004)Google Scholar
  26. 26.
    Vahdat, A., Yocum, K., Walsh, K., Mahadevan, P., Kostic, D., Chase, J., Becker, D.: Scalability and Accuracy in a Large-Scale Network Emulator. In: Proceedings of the 5th USENIX Symposium on Operating Systems Design and Implementation (December 2002)Google Scholar
  27. 27.
    Vogels, W.: TestZilla: a Framework for the Testing of Large-Scale Distributed Systems, Available from http://www.cs.cornell.edu/vogels/TestZilla/default.htm
  28. 28.
    Waldspurger, C.A., Weihl, W.E.: Lottery Scheduling: Flexible Proportional-Share Resource Management. In: Proceedings of the 1st USENIX Symposium on Operating Systems Design and Implementation, pp. 1–11 (1994)Google Scholar
  29. 29.
    Wawrzoniak, M., Peterson, L., Roscoe, T.: Sophia: An Information Plane for Networked Systems. In: Proceedings of the 2nd Workshop on Hot Topics in Networks (November 2003)Google Scholar
  30. 30.
    White, B., Lepreau, J., Stoller, L., Ricci, R., Guruprasad, S., Newbold, M., Hibler, M., Barb, C., Joglekar, A.: An Integrated Experimental Environment for Distributed Systems and Networks. In: Proceedings of the 5th USENIX Symposium on Operating Systems Design and Implementation (December 2002)Google Scholar
  31. 31.
    Zhao, B.Y., Kubiatowicz, J.D., Joseph, A.D.: Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing. Tech. Rep. CSD-01-1141, University of California, Berkeley, Computer Science Division (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Brent N. Chun
    • 1
  1. 1.Intel Research BerkeleyBerkeleyUSA

Personalised recommendations