Skip to main content
SpringerLink
Log in

A Matter of Trust: Data Quality and Information Integrity

  • Chapter
  • First Online:
The Palgrave Handbook of Global Health Data Methods for Policy and Practice

Abstract

Macfarlane and AbouZahr describe how data producers can assure users about the quality and integrity of information. They provide guidance about preventing, detecting, addressing and documenting errors and omissions that may compromise data quality whatever the source. They suggest how users can interrogate a dataset to determine whether quality assurance techniques have been implemented, from the design stage, to the processes of gathering, compiling, cleaning and analysing data, and to the eventual transformation of data into statistics and information for policy and programme use. The authors explore how data can be shared, combined, linked and triangulated to multiply information. Finally, they draw attention to the need to build and maintain trust in statistical information as central to decision-making and a core public good.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Karp P. Census controversy shows ABS ‘needs to do better’, says Statistical Society. 2016 [cited 2018 8th April]. Available from: https://www.theguardian.com/australia-news/2016/aug/09/census-controversy-shows-abs-needs-to-do-better-says-statistical-society

  2. SBS News. Census 2016: Fake names given amid privacy fears. 2017 [cited 2018 8th April]. Available from: https://www.sbs.com.au/news/census-2016-fake-names-given-amid-privacy-fears

  3. Groves RM, Lyberg L. Total survey error past, present, and future. Public Opinion Quarterly. 2010 Jan 1;74(5):849–79. Available from: http://dx.doi.org/10.1093/poq/nfq065

  4. Canadian Institute for Health Information. The CIHI Data Quality Framework. Ottawa, Canada: CIHI. 2009 [cited 2018 5th November]. Available from: https://www.cihi.ca/en/data_quality_framework_2009_en.pdf

  5. Canadian Institute for Health Information. CIHI’s Information Quality Framework. Ottawa, Canada: CIHI. 2017 [cited 2018 5th November]. Available from: https://www.cihi.ca/sites/default/files/document/iqf-summary-july-26-2017-en-web_0.pdf

  6. Biemer P. Total Error: Adapting the paradigm for big data. 2014 [cited 2018 8th April]. Available from: https://www.niss.org/sites/default/files/biemer_ITSEW2014_Presentation.pdf

  7. Groves RM, Fowler Jr. FJ, Couper Mick P, Lepkowski JM, Singer E, Tourangeau R. Survey methodology. Second ed. Hoboken, USA: John Wiley & Sons, Inc.; 2009.

    Google Scholar 

  8. Zhang Chun. Topics of statistical theory for register-based statistics and data integration. Statistica Neerlandica. 2012;66(1):41–63. Available from: http://dx.doi.org/10.1111/stan.508

  9. World Health Organization, World health statistics 2018, page 57. [cited 2018 5th November]. Available from http://www.who.int/gho/publications/world_health_statistics/2018/en/

  10. World Health Organization. WHO methods and data sources for global burden of disease estimates 2000–2015. 2017 [cited 2018 8th April]. Available from: http://www.who.int/healthinfo/global_burden_disease/GlobalDALYmethods_2000_2015.pdf

  11. Van den Broeck J, Argeseanu Cunningham S, Eeckels R, Herbst K. Data cleaning: Detecting, diagnosing, and editing data abnormalities. PLoS Medicine. 2005 Sep 6;2(10):e267. Available from: http://dx.doi.org/10.1371/journal.pmed.0020267

  12. The DHS Program. Data processing. [cited 2018 8th April]. Available from: https://dhsprogram.com/data/data-processing.cfm

  13. Statistics South Africa. Census 2011 Post-enumeration survey results and methodology. 2012 [cited 2018 8th April]. Available from: http://www.statssa.gov.za/census/census_2011/census_products/Census_2011_PES.pdf

  14. United Nations Statistical Commission. Guidelines for the template for a generic National Quality Assurance Framework (NQAF). 2012 [cited 2018 8th April]. Available from: https://unstats.un.org/unsd/statcom/doc12/BG-NQAF.pdf

  15. Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, et al. Who counts? Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007 Nov;370(9599):1653–63. Available from: http://dx.doi.org/10.1016/s0140-6736(07)61308-7

  16. Statistics South Africa. P0309.3. Mortality and causes of death in South Africa, 2016: Findings from death notification. 2018 [cited 2018 8th April]. Available from: http://www.statssa.gov.za/?page_id=1854&PPN=P0309.3&SCH=7308

  17. Canadian Institute for Health Information. Privacy and security risk management framework. 2015 [cited 2018 8th April]. Available from: https://www.cihi.ca/sites/default/files/psrm_framework_enweb_0.pdf

  18. United Nations, Department of Economic and Social Affairs, Statistics Division. Handbook on the management of population and housing censuses. Second Revision. New York, USA: United Nations. 2016 [Cited 2018 5th November]. Available from: https://unstats.un.org/unsd/demographic-social/Standards-and-Methods/files/Principles_and_Recommendations/Population-and-Housing-Censuses/Series_M67Rev2-E.pdf

  19. World Health Organization. Improving the quality and use of birth, death and cause-of-death information: guidance for a standards-based review of country practices. 2010 [cited 2018 8th April]. Available from: http://whqlibdoc.who.int/publications/2010/9789241547970_eng.pdf

  20. United Nations, Department of Economic and Social Affairs, Statistics Division. Principles and recommendations for a vital statistics system. Revision 3. 2014 [cited 2018 8th April]. Available from: https://unstats.un.org/unsd/demographic/standmeth/principles/M19Rev3en.pdf

  21. World Health Organization. What is the Health Information and Intelligence Platform (HIIP). 2014 [cited 2018 9th March]. Available from: http://hiip.wpro.who.int/portal/default.aspx

  22. Aqil A LT, Moussa T, Barry A. Prism tools user guide. 2012 [cited 2018 8th April]. Available from: https://www.measureevaluation.org/resources/publications/ms-12-51

  23. Health Metrics Network. Framework and standards for country health information systems. Second ed. [cited 2018 8th April]. Available from: http://www.who.int/healthinfo/country_monitoring_evaluation/who-hmn-framework-standards-chi.pdf

  24. World Health Organization. World health statistics 2006. Geneva, Switzerland: World Health Organization. 2006 [cited 2018 5th November]. Available from: http://www.who.int/whosis/whostat2006/en/

  25. Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems. MMWR Recommendations and Reports. 2001;50(13):1–35. [cited 2018 5th November]. Available from: https://www.cdc.gov/mmwr/preview/mmwrhtml/rr5013a1.htm

  26. World Health Organization. The WHO STEPwise approach to surveillance of noncommunicable diseases (STEPS). 2003 [cited 2018 8th April]. Available from: http://www.who.int/ncd_surveillance/en/steps_framework_dec03.pdf

  27. World health Organization. Recommended format for a research protocol. [cited 2018 8th April]. Available from: http://www.who.int/rpc/research_ethics/format_rp/en/

  28. Equator Network. Enhancing the quality and transparency of health research. [cited 2018 8th April]. Available from: http://www.equator-network.org/

  29. Organization of Economic Co-operation and Development. OECD health statistics 2017. Definitions, sources and methods. 2017 [cited 2018 8th April]. Available from: http://www.oecd.org/els/health-systems/Table-of-Content-Metadata-OECD-Health-Statistics-2017.pdf

  30. United Nations, Department of Economic and Social Affairs, Statistics Division. SDG indicators metadata repository. [cited 2018 8th April]. Available from: https://unstats.un.org/sdgs/metadata/?Text=&Goal=17&Target=

  31. Leek JT, Peng RD. Statistics: P values are just the tip of the iceberg. Nature. 2015 Apr 28;520(7549):612–612. Available from: http://dx.doi.org/10.1038/520612a

  32. Hosseinpoor A, AbouZahr C. Graphical presentation of relative measures of association (correspondence). Lancet. 2010 Apr;375(9722):1254. Available from: http://dx.doi.org/10.1016/s0140-6736(10)60541-7

  33. Duquia RP, Bastos JL, Bonamigo RR, González-Chica DA, Martínez-Mesa J. Presenting data in tables and charts. Anais Brasileiros de Dermatologia. 2014 Apr;89(2):280–5. Available from: http://dx.doi.org/10.1590/abd1806-4841.20143388

  34. United Nations Economic Commission for Europe. Making data meaningful. Part 2. A guide to presenting statistics. 2009 [cited 2018 8th April]. Available from: http://www.unece.org/stats/documents/writing/MDM_Part2_English.pdf

  35. Spiegelhalter D, Pearson M, Short I. Visualizing uncertainty about the future. Science. 2011 Sep 8;333(6048):1393–400. Available from: http://dx.doi.org/10.1126/science.1191181

  36. Nepal Ministry of Health, New ERA, ICF. Nepal Demographic and Health Survey 2016. Kathmandu, Nepal: Ministry of Health, Nepal; 2017 [cited 2018 5th November]. Available from: https://www.dhsprogram.com/pubs/pdf/fr336/fr336.pdf

  37. World Health Organization. Addressing and managing conflicts of interest in the planning and delivery of nutrition programmes at country level. Report of a technical consultation convened in Geneva, Switzerland, on 8–9 October 2015. [Cited 2018 5th November]. Available at http://www.who.int/nutrition/publications/COI-report/en/

  38. IPUMS CPS. [cited 2018 10th April]. Available from: https://cps.ipums.org/cps/

  39. DHS Program. Available datasets, [cited 2018 8th April]. Available from: https://dhsprogram.com/data/available-datasets.cfm

  40. Fabic M, Yoon Joung C, Bird S. A systematic review of Demographic and Health Surveys: data availability and utilization for research. Bulletin of the World Health Organization. 2012 Aug 1;90(8):604–12. Available from: http://dx.doi.org/10.2471/blt.11.095513

  41. Rutherford GW, McFarland W, Spindler H, White K, Patel SV A, Berle-Grasse J, et al. Public health triangulation: approach and application to synthesizing data to understand national and local HIV epidemics. BioMed Central Public Health. 2010 Jul 29;10(1). Available from: http://dx.doi.org/10.1186/1471-2458-10-447

  42. Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, Karimov R, et al. WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bulletin of the World Health Organization. 2009 Jul 1;87(7):535–41. Available from: http://dx.doi.org/10.2471/blt.08.053819

  43. Murray C. Towards good practice for health statistics: Lessons from the Millennium Development Goal health indicators. Lancet. 2007;369:862–73.

    Google Scholar 

  44. Japec L, Kreuter F, Berg M, Biemer P, Decker P, Lampe C, et al. Big data in survey research. Public Opinion Quarterly. 2015;79(4):839–80. Available from: http://dx.doi.org/10.1093/poq/nfv039

  45. Organization of Economic Co-operation and Development. Measuring trust in official statistics: Cognitive testing. Report to the OECD of the Electronic Working Group on Measuring Trust in Official Statistics. 2011 [cited 2018 10th April]. Available from: https://www.oecd.org/sdd/50027008.pdf

Download references

Author information

Authors and Affiliations

  1. Department of Epidemiology and Biostatistics, School of Medicine, and Institute for Global Health Sciences, University of California San Francisco, San Francisco, CA, USA

    Sarah B. Macfarlane

  2. CAZ Consulting Sarl, Bloomberg Data for Health Initiative, Geneva, Switzerland

    Carla AbouZahr

Authors
  1. Sarah B. Macfarlane
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carla AbouZahr
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sarah B. Macfarlane .

Editor information

Editors and Affiliations

  1. Department of Epidemiology and Biostatistics School of Medicine, and Institute for Global Health Sciences, University of California San Francisco, San Francisco, CA, USA

    Sarah B. Macfarlane

  2. CAZ Consulting Sarl, Bloomberg Data for Health Initiative, Geneva, Switzerland

    Carla AbouZahr

Copyright information

© 2019 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Macfarlane, S.B., AbouZahr, C. (2019). A Matter of Trust: Data Quality and Information Integrity. In: Macfarlane, S., AbouZahr, C. (eds) The Palgrave Handbook of Global Health Data Methods for Policy and Practice. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-137-54984-6_22

Download citation

  • DOI: https://doi.org/10.1057/978-1-137-54984-6_22

  • Published:

  • Publisher Name: Palgrave Macmillan, London

  • Print ISBN: 978-1-137-54983-9

  • Online ISBN: 978-1-137-54984-6

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation