A Management Architecture for Measuring and Monitoring the Behavior of Digital Libraries

  • Sarantos Kapidakis
  • Sotirios Terzis
  • Jakka Sairamesh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1513)

Abstract

In this paper, we investigate issues of performance management in Digital Libraries. We defined a management architecture for measuring and monitoring the behavior of digital libraries as they operate, so that we can make performance conclusions using real life digital library load. Our architecture can be easily applied on any digital library system, introducing minimal overhead to digital library performance, and requiring minimal changes to the digital library code. We implemented this architecture over a testbed of Dienst servers using real data and workload. We defined the relevant parameters for investigating the performance of the servers and we made visualization tools to study the performance results. We also demonstrated how the performance results can be used by the digital library itself, to produce advanced unattended operations, like load balancing and dynamic timeout adaptation.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ziya Aral and Ilya Gertner, Non-intrusive and interactive profiling in Parasight, Proceedings of the ACM/SIGPLAN PPEALS, p. 21–30, July 1988.Google Scholar
  2. 2.
    Daniel E. Atkins, The University of Michigan Digital Library Project: The Testbed, D-Lib Magazine, July/August 1996.Google Scholar
  3. 3.
    Continuous Profiling Infrastructure, Product Description, Digital Equipment Corp., June 1997.Google Scholar
  4. 4.
    Digital Libraries, special issue, Communications of the ACM, 38(4), April 1995.Google Scholar
  5. 5.
    D. Ferguson and L. Georgiadis and C. Nikolaou, “Satisfying Response Time goals in a Transaction Processing System,” Proceedings of the Conference on Parallel and Distributed Information Systems, 1993.Google Scholar
  6. 6.
    D. Ferguson, J. Sairamesh and R. Cieslak, “Black Holes, Sacrificial Lambs, and a Robust Approach to Transaction Routing, ” Proceedings of the International Conference on Parallel and Distributed Computing, 1995.Google Scholar
  7. 7.
    James Few, Michael Freeston, Randall B. Kemp, Jason Simpson, Terence Smith, Alex Wells and Qi Zeng, The Alexandria Digital Library Testbed, D-Lib Magazine, July/August 1996.Google Scholar
  8. 8.
    Weiming Gu, Jeffrey Vetter and Karsten Schwan, An Annotated Bibliography of Interactive Program Steering, SIGPLAN Notices, September 1994.Google Scholar
  9. 9.
    M. A. Hearst, Research in Support of Digital Libraries at Xerox PARC, D-Lib Magazine, May 1996.Google Scholar
  10. 10.
    J. L. Klavans, New Center at Columbia University for Digital Library Research, D-Lib Magazine, March 1996.Google Scholar
  11. 11.
    Carl Lagoze and Jim Davis, Dienst: An Architecture for Distributed Documents Libriaries, Communications of the ACM, 38(4), April 1995, p. 47.Google Scholar
  12. 12.
    C. Lagoze, E. Shaw, J. R. Davis and D. B. Krafft, iDienst: Implementation Reference Manual, TR95-1514, Cornell University, May 5th, 1995.Google Scholar
  13. 13.
    Frank Lange, Reinold Kroeger and Martin Gergeleit, JEWEL: Design and Implementation of a Distributed Measurement System, IEEE Transactions on Parallel and Distributed Systems, Volume 6, No 2, May 1992.Google Scholar
  14. 14.
    M. Litzkow, M. Livny, and M. W. Mutka, “Condor-A Hunter of Idle Workstations, ” Proceedings of the 8th International Conference of Distributed Computing Systems, pp. 104–111, June, 1988.Google Scholar
  15. 15.
    Managing Application Performance with TME10, Technical White Paper, Tivoli Systems, 1996.Google Scholar
  16. 16.
    B. P. Miller, M. D. Callaghan, J. M. Cargille, J. H. Hollingsworth, R. B. Irvin, K. L. Karavanic, K. Kunchithapadam and T. Newhall, The Paradyn Parallel Performance Measurement Tools, IEEE Computer, 28(11), November 1995.Google Scholar
  17. 17.
    C. Nikolaou, S. Kapidakis and G. Georgianakis, Towards a Paneuropean Scientific Digital Library, TR96-0167, Institute of Computer Science-FORTH, May 1996.Google Scholar
  18. 18.
    Andreas Paepcke, Summary of Stanford’s Digital Library Testbed Design and Status, D-Lib Magazine, July/August 1996.Google Scholar
  19. 19.
    POLYCENTER Performance Advisor for Unix, Product Description, Computer Associates, Digital Equipment Corp., 1996.Google Scholar
  20. 20.
    D. A. Reed, R. J. Noe, K. A. Shields and B. W. Schwartz, An Overview of the Pablo Performance Analysis Environment, Department of Computer Science, University of Illinois, Urbana Illinois, November 1992.Google Scholar
  21. 21.
    Resource Management Facility, IBM Corp., June 1995.Google Scholar
  22. 22.
    Richard Snodgrass, A Relational Approach to Monitoring Complex Systems, ACM Transactions on Computer Systems, Volume 6, No 2, May 1988.Google Scholar
  23. 23.
    Chris Rusbridge, The UK Electronic Libraries Programme, D-Lib Magazine, December 1995.Google Scholar
  24. 24.
    J. Sairamesh, S. Kapidakis and C. Nikolaou, Architectures for QoS based Retrieval in Digital Libraries, Workshop on Networked Information Retrieval, SIGIR’96.Google Scholar
  25. 25.
    J. Sairamesh, S. Kapidakis, S. Terzis and C. Nikolaou, Performance Framework for QoS based Searching and Retrieval in Digital Libraries, TR97-0204, Institute of Computer Science-FORTH, August 1997.Google Scholar
  26. 26.
    Beth A. Sroeder, On-Line Monitoring: A Tutorial, IEEE Computer, June 1995.Google Scholar
  27. 27.
    A.N. Tantawi and D. Towsley, “Optimal Static Load Balancing in Distributed Computer Systems, ” Journal of the ACM, April, 1985, pg. 445–465.Google Scholar
  28. 28.
    S. Terzis. Performance Monitoring in Digital Library Systems Master thesis, TR97-0210, Institute of Computer Science-FORTH, October 1997.Google Scholar
  29. 29.
    UMA Technical Information, Performance Management Working Group, March 1994.Google Scholar
  30. 30.
    A+UMA Performance Data Manager Technical Overview, Amdahl Corp., October 1996.Google Scholar
  31. 31.
    I. H. Witten, S. J. Cunningham and M. D. Apperley, The New Zealand Digital Library Project, D-Lib Magazine, November 1996.Google Scholar
  32. 32.
    Phillip S. Yu and Avraham Leff and Yann-Hang Lee, “On Robust Transaction Routing and Load Sharing, ” ACM Transactions on Database Systems, pg. 476–512, sept. 1991.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • Sarantos Kapidakis
    • 1
  • Sotirios Terzis
    • 2
  • Jakka Sairamesh
    • 3
  1. 1.Institute of Computer ScienceFORTHHeraklion, CreteGreece
  2. 2.DSG Computer Science Department Trinity CollegeUniversity of DublinDublin 2Ireland
  3. 3.IBM T. J. Watson Research CenterHawthorneUSA

Personalised recommendations