Test and evaluation of distributed information system networks
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
As information services become increasingly ubiquitous, and are being charged for, users are demanding the ability to choose the quality of an information service based on its cost. In this environment, delivering the right information to the right user at the right time, and with appropriate quality, is the challenge. In addition, resource optimizations must be performed to the degree possible. In this paper we introduce the concept of information quality based system evaluation. The key contribution is a framework in which user/application needs for information quality can be quantified in terms of rigorously defined metrics, existing systems can be evaluated against these metrics, and the tradeoffs between information quality and its cost of provisioning can be examined. Further, this provides an approach to developing information quality aware policies and mechanisms for the system. This framework has been partially validated by applying it to the provisioning of continuous media services, i.e., audio and video, in a distributed environment. This paper presents the case study in detail. Finally, the paper outlines a research program in the area of information quality based system evaluation.
This revised version was published online in June 2006 with corrections to the Cover Date.
Boehm, B. (1978), Characteristics of Software Quality, American Elsevier, New York.
Chee, C.L., C.V. Ramamoorthy and R.A. Paul (1994), “RiskExpert: An Expert STEP Metrics Analyzer,” IEEE COMPSAC, Taiwan.
Grady, R. (1992), Practical Software Metrics for Project Management and Process Improvement, Prentice-Hall, Englewood Cliffs, NJ.
Grady, R. (1994), “Successfully Applying Software Metrics,” IEEE Computer, September.
Lawrence, T.F. (1997), “Metrics for Quality of Service (QoS),” Rome Laboratory working paper.
Mayer-Patel, K. and L. Rowe (1997), “Design and Performance of the Berkeley Continuous Media Toolkit (CMT),” In Proceedings of Multimedia Computing and Networking, pp. 194–206.
Oppenheim, A.N. (1983), Questionnaire Design and Attitude Measurement, Heinemann.
Parikh, S.S. (1997), “StreamGroups: A Mechanism for the Synchronized Delivery of Continuous Media Streams,” M.S. project, Computer Science and Engineering, University of Minnesota, December.
Paul, R.A. (1998), “Metrics Based Software Project Management,” Ph.D. thesis, Computer Science Department, University of Tokyo, Japan.
Part-Enander, E., A. Sjoberg, B. Melin, and P. Isaksson (1996), The Matlab Handbook, Addison-Wesley, Reading, MA.
Porter, A. and R.W. Selby (1990), “Empirically Guided Software Development Using Metric-Based Classification Trees,” IEEE Software, March.
Ramanathan, S. and P.V. Rangan (1993), “Feedback Techniques for ultra-Media Continuity and Inter-Media Synchronization in Distributed Multimedia Systems,” The Computer Journal 36,1, 19–33.CrossRef
Shinagawa, Y. (1995), “Multiresolution Analysis of Metric Data for Software Engineering,” Internal Technical Report, Purdue University.
Smith, B., L.A. Rowe and S. Yen (1993), “Tcl Distributed Programming,” In Proceedings of the 1993 Tcl/Tk Workshop.
Smith, B. (1996), “Cyclic-UDP: A New Protocol for Continuous Media Communication,” http://www.cs.cornell.edu/Info/Faculty/Brian_Smith.html/Publications.
Sreenan, CJ. (1992), “Synchronization Services for Digital Continuous Media,” Ph.D. thesis, University of Cambridge, UK, October 1992.
Steinmetz, R., N.D. Georganas, and T. Nakagawa (1996), “Guest Editorial: Synchronization Issues in Multimedia Communications,” IEEE Journal on Selected Areas in Communication 14,1 1–4.CrossRef
Vogel, A., B. Kerherve, G. v. Bochmann, and J. Gecsei (1995), “Distributed Multimedia and QoS: A Survey,” IEEE Multimedia Magazine 3, 10–19.CrossRef
Weller, E. (1994), “Using Metrics to Manage Software Projects,” IEEE Computer, 27–33.
Wijesekera, D. and J. Srivastava (1996), “Quality of Service Metrics for Continuous Media,” International Journal on Multimedia Tools and Applications 3,1, 127–166.CrossRef
Wijesekera, D. (1997), “Quality of Service for Continuous Media: Metrics, Validation, Evaluation, and Mechanisms,” Ph.D. dissertation, Computer Science & Engineering, University of Minnesota, December.
Wijesekera, D., S. Varadarajan, S.S. Parikh, and J. Srivastava (1998), “Quality of Service (QoS) Based Evaluation of the Berkeley Continuous Media Toolkit (CMT),” submitted to the ACM/Springer-Verlag Multimedia Systems Journal.
- Test and evaluation of distributed information system networks
Annals of Software Engineering
Volume 8, Issue 1-4 , pp 289-311
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers
- Additional Links
- Author Affiliations
- 1. Office of the Secretary of Defense (Acquisition & Technology), 3000 Defense, Pentagon, Washington, DC, 20301, USA
- 2. Department of Computer Science and Engineering, University of Minnesota, 200 Union Street SE, Minneapolis, MN, 55455, USA
- 3. Honeywell Space Systems, Satellite & Adv. Proc. Avionics, 13350, US Highway 19 North, Clearwater, FL, 36424‐7290, USA