Australasian Plant Pathology

, Volume 43, Issue 3, pp 267–286 | Cite as

The structure of diagnostic information



Diagnosis is characterized as an exercise in classification, where the task is to assign a crop to a risk group as a basis for evidence-based crop protection decision making. Underlying the process of diagnostic decision making is Bayesian updating of probabilities. Alongside updating of probabilities, assessments of diagnostic information allow further description of the characteristics of diagnostic tests, and of the predictions made on the basis of test outcomes. This is illustrated analytically, graphically (by means of iso-information contour plots and information graphs) and by discussion of example epidemiological scenarios.


Bayes’ theorem Entropy Expected mutual information Specific information Relative entropy Weight of evidence 


  1. Agresti A (2012) Categorical data analysis, 3rd edn. Wiley, ChichesterGoogle Scholar
  2. Amblard P-O, Michel OJJ, Morfu S (2005) Revisiting the asymmetric binary channel: joint noise-enhanced detection and information transmission through threshold devices. In: Kish LB, Lindenberg K, Gingl Z (eds) Noise in complex systems and stochastic dynamics III, proceedings of the SPIE, vol 5845., pp 50–60. doi:10.1117/12.609436 CrossRefGoogle Scholar
  3. Asch DA, Patton JP, Hershey JC (1990) Knowing for the sake of knowing: the value of prognostic information. Med Decis Making 10:47–57PubMedCrossRefGoogle Scholar
  4. Asch DA, Patton JP, Hershey JC (1991) Prognostic information versus accuracy: once more with meaning. Med Decis Making 11:45–47PubMedCrossRefGoogle Scholar
  5. Attneave F (1959) Applications of information theory to psychology: a summary of basic concepts, methods, and results. Holt, Rinehart and Winston, New YorkGoogle Scholar
  6. Bavaud F (2009) Information theory, relative entropy and statistics. In: Sommaruga G (ed) Formal theories of information: from Shannon to semantic information theory and general concepts of information. Lecture notes in computer science, vol 5363. Springer-Verlag, Berlin, pp 54–78CrossRefGoogle Scholar
  7. Benish WA (1999) Relative entropy as a measure of diagnostic information. Med Decis Making 19:202–206PubMedCrossRefGoogle Scholar
  8. Benish WA (2002) The use of information graphs to evaluate and compare diagnostic tests. Meth Inf Med 41:114–118Google Scholar
  9. Benish WA (2003) Mutual information as an index of diagnostic test performance. Meth Inf Med 42:260–264Google Scholar
  10. Benish WA (2012) The channel capacity of a diagnostic test as a function of test sensitivity and test specificity. Stat Methods Med Res. doi:10.1177/0962280212439742 PubMedGoogle Scholar
  11. Binmore K (2009) Rational decisions. Princeton University Press, PrincetonGoogle Scholar
  12. Cover TM, Thomas JA (2006) Elements of information theory, 2nd edn. Wiley-Interscience, HobokenGoogle Scholar
  13. D’Arcy CJ, Eastburn DM, Schumann GL (2001) Illustrated glossary of plant pathology. Plant Health Instr. doi:10.1094/PHI-I-2001-0219-01 Google Scholar
  14. De Wolf ED, Madden LV, Lipps PE (2003) Risk assessment models for wheat Fusarium head blight epidemics based on within-season weather data. Phytopathology 93:428–435PubMedCrossRefGoogle Scholar
  15. DelSole T (2004) Predictability and information theory. Part I: measures of predictability. J Atmos Sci 61:2425–2440CrossRefGoogle Scholar
  16. Devorshak C (2012) Information and pest risk analysis. In: Devorshak C (ed) Plant pest risk analysis: concepts and application. CAB International, Wallingford, pp 57–64CrossRefGoogle Scholar
  17. DeWeese MR, Meister M (1999) How to measure the information gained from one symbol. Netw Comput Neural Syst 10:325–340CrossRefGoogle Scholar
  18. Diamond GA (1991) Point of information. Med Decis Making 11:42–44PubMedCrossRefGoogle Scholar
  19. Diamond GA, Hirsch M, Forrester JS, Staniloff HM, Vas R, Halpern SW, Swan HJ (1981) Application of information theory to clinical diagnostic testing: the electrocardiographic stress test. Circulation 63:915–921PubMedCrossRefGoogle Scholar
  20. Drummond H (2001) The art of decision making: mirrors of imagination, masks of fate. John Wiley and Sons Ltd, ChichesterGoogle Scholar
  21. Ebell MH (2009) Diagnosis: making the best use of medical data. Am Fam Physician 79:478–480PubMedGoogle Scholar
  22. Gent D, Mahaffee W, McRoberts N, Pfender W (2013) The use and role of predictive systems in disease management. Annu Rev Phytopathol 51:267–289PubMedCrossRefGoogle Scholar
  23. Good IJ (1985) Weight of evidence: a brief survey. In: Bernardo JM, DeGroot MH, Lindley DV, Smith AFM (eds) Bayesian statistics 2. Elsevier Science Publishers B.V. (North-Holland), The Netherlands, pp 249–269Google Scholar
  24. Good IJ (1991) Weight of evidence and the Bayesian likelihood ratio. In: Aitken CGG, Stoney DA (eds) The use of statistics in forensic science. Ellis Horwood Limited, Chichester, pp 85–106Google Scholar
  25. Hughes G (2012) Applications of information theory to epidemiology. APS Press, St PaulGoogle Scholar
  26. Kendell RE (1975) The role of diagnosis in psychiatry. Blackwell Scientific Publications, OxfordGoogle Scholar
  27. Kullback S (1968) Information theory and statistics, 2nd edn. Dover Publications, New YorkGoogle Scholar
  28. Lee W-C (1999) Selecting diagnostic tests for ruling out or ruling in disease: the use of the Kullback–Leibler distance. Int J Epidemiol 28:521–525PubMedCrossRefGoogle Scholar
  29. Madden LV (2006) Botanical epidemiology: some key advances and its continuing role in disease management. Eur J Plant Pathol 115:3–23CrossRefGoogle Scholar
  30. Makowski D, Taverne M, Bolomier J, Ducarne M (2005) Comparison of risk indicators for sclerotinia control in oilseed rape. Crop Prot 24:527–531CrossRefGoogle Scholar
  31. Makowski D, Denis J-B, Ruck L, Penaud A (2008) A Bayesian approach to assess the accuracy of a diagnostic test based on plant disease measurement. Crop Prot 27:1187–1193CrossRefGoogle Scholar
  32. Martin EA (2010) Concise medical dictionary, 8th edn. Oxford University Press, OxfordGoogle Scholar
  33. McGill WJ (1954) Multivariate information transmission. Psychometrika 19:97–116CrossRefGoogle Scholar
  34. McRoberts N, Hughes G, Savary S (2003) Integrated approaches to understanding and control of diseases and pests in field crops. Australas Plant Pathol 23:167–180CrossRefGoogle Scholar
  35. McRoberts N, Hall C, Madden LV, Hughes G (2011) Perceptions of disease risk: from social construction of subjective judgments to rational decision making. Phytopathology 101:654–665PubMedCrossRefGoogle Scholar
  36. Metz CE, Goodenough DJ, Rossmann K (1973) Evaluation of receiver operating characteristic curve data in terms of information theory, with applications in radiography. Radiology 109:297–303PubMedGoogle Scholar
  37. Nielsen F, Nock R (2011) Entropies and cross-entropies of exponential families. Proceedings of the IEEE 17th International Conference on Image Processing, September 26–29 2010, Hong Kong, pp 3621–3624Google Scholar
  38. Quinlan JR (1986) Induction of decision trees. Mach Learn 1:81–106Google Scholar
  39. Renyi A (1965) On the foundations of information theory. Rev Int Stat Inst 33:1–14CrossRefGoogle Scholar
  40. Sackett DL, Haynes RB, Guyatt GH, Tugwell P (1991) Clinical epidemiology: a basic science for clinical medicine, 2nd edn. Little, Brown Book Group, LondonGoogle Scholar
  41. Shannon CE, Weaver W (1949) The mathematical theory of communication. University of Illinois Press, UrbanaGoogle Scholar
  42. Silverman RA (1955) On binary channels and their cascades. IRE Trans Inf Theory 1:19–27CrossRefGoogle Scholar
  43. Somoza E, Mossman D (1992) Comparing and optimizing diagnostic tests: an information-theoretical approach. Med Decis Making 12:179–188PubMedCrossRefGoogle Scholar
  44. Stern VM, Smith RM, van den Bosch R, Hagen KS (1959) The integrated control concept. Hilgardia 29:81–99Google Scholar
  45. Theil H (1967) Economics and information theory. North-Holland, AmsterdamGoogle Scholar
  46. Tribus M (1969) Rational descriptions, designs and decisions. Pergamon Press, New YorkGoogle Scholar
  47. Tribus M, McIrvine EC (1971) Energy and information. Sci Am 225:179–188CrossRefGoogle Scholar
  48. Twengström E, Sigvald R, Svensson C, Yuen J (1998) Forecasting Sclerotinia stem rot in spring sown oilseed rape. Crop Prot 17:405–411CrossRefGoogle Scholar
  49. Vidal E, Moreno A, Bertolini E, Cambra M (2012) Estimation of the accuracy of two diagnostic methods for the detection of Plum pox virus in nursery blocks by latent class models. Plant Pathol 61:413–422CrossRefGoogle Scholar
  50. Youden WJ (1950) Index for rating diagnostic tests. Cancer 3:32–35PubMedCrossRefGoogle Scholar
  51. Yuen J (2003) Bayesian approaches to plant disease forecasting. Plant Health Prog. doi:10.1094/PHP-2003-1113-06-RV Google Scholar
  52. Yuen JE, Hughes G (2002) Bayesian analysis of plant disease prediction. Plant Pathol 51:407–412CrossRefGoogle Scholar
  53. Yuen J, Twengström E, Sigvald R (1996) Calibration and verification of risk algorithms using logistic regression. Eur J Plant Pathol 102:847–854CrossRefGoogle Scholar

Copyright information

© Australasian Plant Pathology Society Inc. 2014

Authors and Affiliations

  1. 1.Crop and Soil SystemsSRUCEdinburghUK
  2. 2.Plant Pathology DepartmentUniversity of CaliforniaDavisUSA

Personalised recommendations