Avoid common mistakes on your manuscript.
Introduction
Much of the work of a scientist or engineer involves taking measurements. For example, a radiation oncology medical physicist measures the absorbed dose in a water phantom. However any measurement has some limit in the accuracy of the final value you obtain. This is due to limits in the accuracy of the measuring equipment, any bias in the measurements, calibration issues or simple mistakes you make. All of these contribute to an uncertainty in the value of the parameter you are measuring. For example, the absorbed dose of radiation from a linear accelerator can be measured in a water phantom using a well characterised ionisation chamber. In this particular case of radiation dose measurement, there will be uncertainties due to the equipment consisting of an ionisation chamber, electrometer and the water phantom. There will also be uncertainties in the setup of the equipment, the linear accelerator. Traditionally these uncertainties are characterised as random errors or systematic errors. Random errors can be minimised by taking multiple measurements while the reduction of systematic uncertainties requires a good understanding of the equipment. Systematic errors are often “fixed” by application of some calibration factor or may be even missed.
The method used to determine the uncertainty of a measurement is widely varied. For example, you can repeat the measurements a number of times usually between 3 and 5, and from this calculate the standard deviation. A more systematic approach is to determine random and systematic errors and summate these together to give the final uncertainty in your parameter. This takes a bit more time and requires that you have a good understanding of your equipment. Finally, you can ignore your errors, assume your equipment is working correctly and just quote your results. A review of published papers in any medical physics or biomedical engineering journal will show a similar variation in reporting of uncertainties. This can give the impression of a much lower uncertainty in your measurements. For example, the IAEA TRS 398 dosimetry protocol reports that the estimated relative uncertainty in the dose calibration of megavoltage X-ray beams is ±1.5 % [1]. Therefore any absolute dose measurements using these X-ray beams must have an uncertainty larger than this.
There is a more uniform approach for uncertainty analysis as prescribed by the International Organization for Standardization (ISO). The ISO has published a document called the “Guide to the expression of uncertainties in measurement”, more simply known as ISO GUM [2, 3]. An excellent summary of the ISO GUM is found in Appendix D in the IAEA TRS 398 dosimetry protocol which is free to download [1]. The ISO GUM is routinely used in standards laboratories such as ARPANSA or NPL but in fact can also be used in the clinical or research environment.
The ISO GUM indicates that the quantity of interest is uncertainty and not error [1]. All uncertainties are divided into type A and type B uncertainties. Type A uncertainties are those that are evaluated by statistical analysis and can be reduced by increasing the number of measurements. Type B uncertainties are those determined by other methods and can include correction factors and influence quantities such as those used in radiation dosimetry. Type B uncertainties are often estimated from information from measuring equipment, published factors or by other means. The summary in the IAEA TRS 398 protocol states that the physicist should use the best of their knowledge and experience to estimate these type B uncertainties [1]. The final uncertainty in any measurement should then be expressed as the estimated relative standard deviation based on a summation of the type A and type B uncertainties.
The practical application of the ISO GUM can be achieved by the development of an uncertainty budget or an uncertainty analysis table. An example of an uncertainty budget is given in Table 1 where Gafchromic EBT2 film was used to determine backscatter factors in water (Bw) for kilovoltage X-ray beams [4]. The total uncertainty in the values of Bw was estimated to be 4.0 % based on the different components of uncertainty as listed in the table.
There are a number of good references on the ISO GUM which the reader is referred to in developing an uncertainty budget. Firstly, a review paper published in this journal in 2005 by Gregory et al. [5]. There is an excellent book summarising the ISO GUM published by the National Measurement Institute of Australia [6]. Finally, there are a number of medical physics papers that have used the ISO GUM methodology to determine an uncertainty budget [7–11].
I would like to make a number of recommendations most of which are easily achievable and would lead to a more rigorous understanding of the scientific process involved in measurements we are take:
-
1.
The APESM journal should adopt the ISO GUM methodology as the standard process for reporting uncertainties. All papers published in the APESM journal should include an uncertainty budget.
-
2.
Presentations at the annual ACPSEM conferences should include details of the uncertainty budget using the ISO GUM.
-
3.
The ISO GUM should be included in the syllabus for science and engineering courses. This includes postgraduate courses in medical physics and biomedical engineering in Australia and NZ.
-
4.
The ISO GUM should be a part of the TEAP training for medical physics registrars.
References
Andreo P, Burns DT, Hohlfield K, Huq MS, Kanai T, Laitano F, Smyth V, Vynckier S (2000) Absorbed dose determination in external beam radiotherapy, an international code of practice for dosimetry based on standards of absorbed dose to water, vol 398. International Atomic Energy Agency, Vienna
ISO (1995) Guide to the expression of uncertainties in measurement. International Organisation for Standardization, Geneva, Switzerland
BIPM IEC IFCC ILAC ISO IUPAC IUPAP OIML (2008) Guide to the expression of uncertainty in measurement—GUM 1995 with minor corrections, JCGM 100:2008. http://www.bipm.org/utils/common/documents/jcgm/JCGM_100_2008_E.pdf. Accessed March 2013
Smith L, Hill R, Nakano M, Kim J, Kuncic Z (2011) The measurement of backscatter factors of kilovoltage X-ray beams using Gafchromic™ EBT2 film. Australas Phys Eng Sci Med 34:261–266
Gregory K, Bibbo G, Pattison JE (2005) A standard approach to measurement uncertainties for scientists and engineers in medicine. Australas Phys Eng Sci Med 28:131–139
Bentley RE (2005) Uncertainty in measurement: the ISO guide, 11th edn. National Measurement Institute, Lindfield
Hill R, Mo Z, Haque M, Baldock C (2009) An evaluation of ionization chambers for the relative dosimetry of kilovoltage X-ray beams. Med Phys 36:3971–3981
Kim J, Hill R, Claridge Mackonis E, Kuncic Z (2010) An investigation of backscatter factors for kilovoltage X-rays: a comparison between Monte Carlo simulations and Gafchromic EBT film measurements. Phys Med Biol 55:783–797
La Russa DJ, McEwen M, Rogers DWO (2007) An experimental and computational investigation of the standard temperature-pressure correction factor for ion chambers in kilovoltage X-rays. Med Phys 34:4690–4699
McEwen MR, Kawrakow I, Ross CK (2008) The effective point of measurement of ionization chambers and the build-up anomaly in MV X-ray beams. Med Phys 35:950–958
Claridge Mackonis E, Suchowerska N, Naseri P, McKenzie D (2012) Optimisation of exposure conditions for in vitro radiobiology experiments. Australas Phys Eng Sci Med 35:151–157
Acknowledgments
Elizabeth Claridge-Mackonis and Johnny Morales from Royal Prince Alfred Hospital, Sydney are acknowledged for providing useful comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hill, R. Reporting uncertainties in measurement: what approach should be followed?. Australas Phys Eng Sci Med 36, 1–3 (2013). https://doi.org/10.1007/s13246-013-0190-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13246-013-0190-4