Evaluating an Eye Screening Test
Field evaluation of AI systems or software systems in general is a challenging research topic. During the last few years we have developed a software-based eye screening system. In this paper we describe our work on evaluating several important aspects of the system.We have systematically studied the key issues involved in evaluating software quality and carried out the evaluations using different strategies. After a brief introduction of the system, this work is described from a data-analysis problem-solving perspective, involving problem analysis, data collection, and data analysis.
KeywordsOptic Neuritis Receiver Operator Characteristic Analysis Screening System Test Record Optic Nerve Disease
Unable to display preview. Download preview PDF.
- 1.Basili, V, Selby, R and Hutchens, D, Experimentation in Software Engineering. IEEE Transactions on Software Engineering, SE-12 (1988) 733–743.Google Scholar
- 3.Cheng, G, Liu, X, Wu, J X, Jones, B and Hitchings, R, Discovering Knowledge from Visual Field Data: Results in Optic Nerve Diseases. Medical Informatics Europe’ 96, (1996), 629–633.Google Scholar
- 5.Cohen, P R, Empirical Methods for Artificial Intelligence. MIT Press, (1995).Google Scholar
- 6.Hand, D J, Deconstructing Statistical Questions (with discussion). Journal of the Royal Statistical Society, Series A, 157 (1994) 317–56.Google Scholar
- 7.Hanely, J X and McNeil, B J, The Meaning and Use of the Area under a Receiver Operator Characteristic (ROC) Curve. Radiology, 143 (1982) 29–36.Google Scholar
- 8.ISO International Standard, Information Technology-Software Product Evaluation-Quality Characteristics and Guidelines for Their Use. ISO/IEC 9126, (1991).Google Scholar
- 10.Liu, X., Cheng, G. and Wu, J. X.: Noise and Uncertainty Management in Intelligent Data Modelling. Proc. of 12th National Conference on Artificial Intelligence (AAAI-94), 263–268Google Scholar
- 12.Wu, J X, Visual Screening for Blinding Diseases in the Community Using Computer Controlled Video Perimetry, PhD thesis, University of London, (1993).Google Scholar
- 13.Wu, J X, Fitzke, F, Poinoosawmy, D, Hitchings, R, and Johnson, G, Variability in Glaucomatous Visual Damage Measured with Motion Detection. Investigative Ophthalmology and Visual Science, 34 (1993) 1475.Google Scholar
- 14.Wu, J X, Jones, B, Cassels-Brown, A, Murdoch, I, Adeniyi, F, Alexander, N, Minassian, D, and Abiose, A, Preliminary Report on the Use of Laptop Computer Perimetry with a Motion Sensitivity Screening Test to Detect Optic Nerve Disease in Onchocercal Communities of Rural Nigeria. Perimetry Update 1992/93, (1992) 323–329.Google Scholar
- 15.Wyatt, J and Spiegelhalter, D, Field Trials of Medical Decision-Aids: Potential Problems and Solutions. Proc. of the 15th Symposium on Computer Application in Medical Care, Washington, 3–7, (1991).Google Scholar