Skip to main content

Reporting and Transparency in Big Data: The Nexus of Ethics and Methodology

  • Chapter
  • First Online:

Part of the book series: Law, Governance and Technology Series ((LGTS,volume 29))

Abstract

Examples of biomedical big data are routinely-collected health data. These may include information collected in electronic health records (EHRS), disease registries, or health administrative datasets. The ability to use this information for research has raised important questions regarding security and confidentiality. However, we suggest that a neglected area of discussion pertains to post-analytic aspects of research using biomedical big data. Specifically, there has been a lack of attention paid to the ethical obligation of transparent and complete reporting of studies using large-scale health-related datasets.

In this chapter we argue that improving the transparency and quality of reporting is ethically important for a number of practical as well as principled reasons. From a practical perspective the accurate reporting of methods allows for appropriate peer review and critical evaluation of studies; facilitates reproduction and replication of research findings; may help to reduce waste, and avoid redundancy and unnecessary repetition; and may facilitate public trust in scientific research. We may also have principled reasons to improve the reporting of studies using routinely-collected health data; reasons that may relate to researcher integrity and population benefits such as the fair use of resources, minimising risk of harms, and maximising benefits.

We conclude this chapter by presenting the recommendations from the RECORD (REporting of studies Conducted using Observational Routinely-collected Data) Statement (http://record-statement.org/), an international collaboration involving stakeholders using routinely-collected health data, together with a reflection on the way in which reporting guidelines improve the quality of reporting and where there is still more to do.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Our focus here is limited to steps to improve the transparency and completeness of reporting as part of an effort to improve standards of reporting. As such, we do not engage in discussion of deliberate acts of research misconduct, such as the falsification or fabrication of research results. In the subsequent sections we limit our discussion to the former, but acknowledge that biomedical big data also potentially presents important issues pertaining to the latter – particularly with respect to the ease with which data may be manipulated – that require further consideration.

References

  • Altman, D.G., and D. Moher. 2013. Declaration of transparency for each research article. British Medical Journal 347: f4796. doi:10.1136/bmj.f4796.

    Article  Google Scholar 

  • Altman, D.G., and D. Moher. 2014. Importance of transparent reporting of health research. In Guidelines for reporting health research: A user’s manual, ed. D. Moher, D.G. Altman, K.F. Schulz, I. Simera, and E. Wager, 3–13. Hoboken: Wiley.

    Google Scholar 

  • Altman, D.G., and I. Simera. 2014. Using reporting guidelines effectively to ensure good reporting of health research. In Guidelines for reporting health research: A user’s manual, ed. D. Moher, D.G. Altman, K.F. Schulz, I. Simera, and E. Wager, 32–40. Hoboken: Wiley.

    Google Scholar 

  • Anderson, J.A., M. Eijkholt, and J. Illes. 2013. Ethical reproducibility: Towards transparent reporting in biomedical research. Nature Methods 10(9): 843–845. doi:10.1038/nmeth.2564.

    Article  Google Scholar 

  • Anderson, J.A., B. Sawatzky-Girling, M. McDonald, D. Pullman, R. Saginur, H.A. Sampson, and D.J. Willison. 2011. Research ethics broadly writ: Beyond REB review. Health Law Review 19(3): 12–24.

    Google Scholar 

  • Armstrong, R., E. Waters, L. Moore, E. Riggs, L.G. Cuervo, P. Lumbiganon, and P. Hawe. 2008. Improving the reporting of public health intervention research: Advancing TREND and CONSORT. Journal of Public Health (Oxford, England) 30(1): 103–109. doi:10.1093/pubmed/fdm082.

    Article  Google Scholar 

  • Beauchamp, T.L. 1996. Moral foundations. In Ethics and epidemiology, ed. S. Coughlin and T.L. Beauchamp, 24–52. New York: Oxford University Press.

    Google Scholar 

  • Benchimol, E.I., D.G. Manuel, T. To, A.M. Griffiths, L. Rabeneck, and A. Guttmann. 2011. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. Journal of Clinical Epidemiology 64(8): 821–829. doi:10.1016/j.jclinepi.2010.10.006.

    Article  Google Scholar 

  • Benchimol, E.I., L. Smeeth, A. Guttman, K. Harron, D.G. Moher, I. Petersen, H.T. Sørensen, E. von Elm, S.M. Langan, and RECORD Working Committee. 2015. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement. PLoS Medicine 12(10): e1001885. doi:10.1371/journal.pmed.1001885.

    Article  Google Scholar 

  • Bossuyt, P.M., J.B. Reitsma, D.E. Bruns, C.A. Gatsonis, P.P. Glasziou, L.M. Irwig, J.G. Lijmer, et al. 2003. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. British Medical Journal 326: 41–44.

    Article  Google Scholar 

  • Butler, D. 2013. When Google got flu wrong. Nature 494: 155–156.

    Article  Google Scholar 

  • Canadian Institutes of Health Research. 2011. Canada’s Strategy for Patient-Oriented Research. Improving health outcomes through evidence-informed care. Ottawa: Canadian Institutes of Health Research.

    Google Scholar 

  • Carter, P., G. T. Laurie, and M. Dixon-Woods. 2015. The social licence for research: Why care.data ran into trouble. Journal of Medical Ethics. doi:10.1136/medethics-2014-102374.

    Google Scholar 

  • Chalmers, I., and P. Glasziou. 2009. Avoidable waste in the production and reporting of research evidence. Lancet 374: 86–89. doi:10.1016/s01406736(09)60329-9.

    Article  Google Scholar 

  • Cohen, I.G., R. Amarasingham, A. Shah, B. Xie, and B. Lo. 2014. The legal and ethical concerns that arise from using complex predictive analytics in health care. Health Affairs 33(7): 1139–1147. doi:10.1377/hlthaff.2014.0048.

    Article  Google Scholar 

  • Collins, F.S., and L.A. Tabak. 2014. Policy: NIH plans to enhance reproducibility. Nature 505(7485): 612–613.

    Article  Google Scholar 

  • Cook, J.A., and G.S. Collins. 2015. The rise of big clinical databases. British Journal of Surgery 102(2): e93–e101. doi:10.1002/bjs.9723.

    Article  Google Scholar 

  • Cook, S., C. Conrad, A.L. Fowlkes, and M.H. Mohebbi. 2011. Assessing Google flu trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS One 6(8), e23610. doi:10.1371/journal.pone.0023610.t001.

    Article  Google Scholar 

  • Copeland, P., R. Romano, T. Zhang, G. Hecht, D. Zigmond, and C. Stefansen. 2013. Google disease trends: An update. Paper presented at the International Society of Neglected Tropical Disease (ISNTD) Bites, London, October 17, 2012.

    Google Scholar 

  • Council of Canadian Academies. 2015. Accessing health and health-related data in Canada. Ottawa (ON): The expert panel on timely access to health and social data for health research and health System innovation, Council of Canadian Academies.

    Google Scholar 

  • Currie, J. 2013. “Big Data” versus “Big Brother”: On the appropriate use of large-scale data collections in pediatrics. Pediatrics 131(Suppl 2): S127–S132. doi:10.1542/peds.2013-0252c.

    Article  Google Scholar 

  • Damschroder, L.J., J.L. Pritts, M.A. Neblo, R.J. Kalarickal, J.W. Creswell, and R.A. Hayward. 2007. Patients, privacy and trust: Patients’ willingness to allow researchers to access their medical records. Social Science and Medicine 64(1): 223–235. doi:10.1016/j.socscimed.2006.08.045.

    Article  Google Scholar 

  • Davenport, P., W. Cragg, M. Crago, D. Fanelli, J.-M. Fleury, L.M. Given, R. Heslegrave, et al. 2010. Honesty, accountability and trust: Fostering research integrity in Canada. Ottawa: Council of Canadian Academies.

    Google Scholar 

  • de Lusignan, Simon, and Chris van Weel. 2006. The use of routinely-collected computer data for research in primary care: Opportunities and challenges. Family Practice 23(2): 253–263.

    Article  Google Scholar 

  • Dean, Bonnie B., Lam Jessica, Jaime L. Natoli, Butler Qiana, Aguilar Daniel, and Robert J. Nordyke. 2009. Review: Use of electronic medical records for health outcomes research A literature review. Medical Care Research and Review 66(6): 611–638.

    Article  Google Scholar 

  • Elliott, K.C., and D.B. Resnik. 2014. Science, policy, and the transparency of values. Environmental Health Perspectives 122(7): 647–650. doi:10.1289/ehp.1408107.

    Google Scholar 

  • Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network. Essential resources for writing and publishing health research. http://www.equator-network.org/. Accessed 21 Sept 2015.

  • Feynman, R.P. 1998. Cargo cult science. In The art and science of analog circuit design, ed. J. Williams. Wolburn: Butterworth-Heinemann.

    Google Scholar 

  • Franklin, S.S., M.G. Larson, S.A. Khan, N.D. Wong, E.P. Leip, W.B. Kannel, and D. Levy. 2001. Does the relation of blood pressure to coronary heart disease risk with aging? The Framingham Heart study. Circulation 103: 1245–1249.

    Article  Google Scholar 

  • Friedman, S.L. 2007. Finding treasure: Data sharing and secondary analysis in developmental science. Journal of Applied Developmental Psychology 28(5-6): 384–389. doi:10.1016/j.appdev.2007.07.001.

    Article  Google Scholar 

  • Glasziou, Paul, Douglas G. Altman, Patrick Bossuyt, Isabelle Boutron, Mike Clarke, Steven Julious, Susan Michie, David Moher, and Elizabeth Wager. 2014. Reducing waste from incomplete or unusable reports of biomedical research. The Lancet 383(9913): 267–276. doi:10.1016/s0140-6736(13)62228-x.

    Article  Google Scholar 

  • Groves, T. 2008. Enhancing the quality and transparency of health research. British Medical Journal 337: a718. doi:10.1136/bmj.a718.

    Article  Google Scholar 

  • Guttmann, A., M. Nakhla, M. Henderson, T. To, D. Daneman, K. Cauch-Dudek, X. Wang, K. Lam, and J. Hux. 2010. Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatric Diabetes 11(2): 122–128. doi:10.1111/j.1399-5448.2009.00539.x.

    Article  Google Scholar 

  • Harpe, Spencer E. 2009. Using secondary data sources for pharmacoepidemiology and outcomes research. Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy 29(2): 138–153.

    Article  Google Scholar 

  • Hemkens L.G., E.I. Benchimol, S.M. Langan, M. Briel, B. Kasenda , J.M. Januel , E. Herrett, and E. von Elm. The reporting of studies using routinely collected health data is often insufficient: Systematic literature analysis. Journal of Clinical Epidemiology, in press.

    Google Scholar 

  • Hoffman, S., and A. Podgurski. 2013. The use and misuse of biomedical data: Is bigger really better? American Journal of Law and Medicine 39: 497–538.

    Google Scholar 

  • Institute of Medicine. 2015. Sharing clinical trial data: Maximizing benefits, minimizing risk. Washington, D.C.: Institute of Medicine.

    Google Scholar 

  • Ioannidis, J.P.A. 2012. The importance of potential studies that have not existed and registration of observational data sets. JAMA 308(6): 575–576.

    Article  Google Scholar 

  • Jacobs, J.P., R.J. Cerfolio, and R.M. Sade. 2009. The ethics of transparency: Publication of cardiothoracic surgical outcomes in the lay press. Annals of Thoracic Surgery 87(3): 679–686. doi:10.1016/j.athoracsur.2008.12.043.

    Article  Google Scholar 

  • Kilkenny, C., W.J. Browne, I.C. Cuthill, M. Emerson, and D.G. Altman. 2010. Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research. PLoS Biology 8(6): e1000412. doi:10.1371/journal.pbio.1000412.t001.

    Article  Google Scholar 

  • King, G. 2016. Preface: Big data is not about the data. In Computational social science: Discovery and prediction, ed. R.M. Alvarez. Cambridge: Cambridge University Press.

    Google Scholar 

  • Kreuter, F., and R.D. Peng. 2014. Extracting information from Big Data: Issues of measurement, inference and linkage. In Privacy, big data, and the public good. Frameworks for engagement, ed. J. Lane, S. Stodden, S. Bender, and H. Nissenbaum, 11–20. Cambridge: Cambridge University Press.

    Google Scholar 

  • Lane, Julia, Victoria Stodden, Stefan Bender, and Helen Nissenbaum. 2014. Editors’ Introduction. In Privacy, big data, and the public good. Frameworks for engagement, ed. J. Lane, S. Stodden, S. Bender, and H. Nissenbaum, 11–20. Cambridge: Cambridge University Press.

    Chapter  Google Scholar 

  • Langan, S.M., E.I. Benchimol, A. Guttmann, D. Moher, I. Petersen, L. Smeeth, H.T. Sorensen, F. Stanley, and E. Von Elm. 2013. Setting the RECORD straight: Developing a guideline for the REporting of studies Conducted using Observational Routinely-collected Data. Clinical Epidemiology 5: 29–31. doi:10.2147/CLEP.S36885.

    Google Scholar 

  • Last, J. 1996. Professional standards of conduct for epidemiologists. In Ethics and epidemiology, ed. S. Coughlin and T.L. Beauchamp, 53–75. New York: Oxford University Press.

    Google Scholar 

  • Lazer, D., R. Kennedy, G. King, and A. Vespignani. 2014a. Big data. The parable of Google Flu: Traps in big data analysis. Science 343(6176): 1203–1205. doi:10.1126/science.1248506.

    Article  Google Scholar 

  • Lazer, D., R. Kennedy, G. King, and A. Vespignani. 2014b. Google flu trends still appears sick: An evaluation of the 2013–2014 flu season. Available at SSRN 2408560.

    Google Scholar 

  • Maeng, M., H.H. Tilsted, L.O. Jensen, L.R. Krusell, A. Kaltoft, H. Kelbaek, A.B. Villadsen, et al. 2014. Differential clinical outcomes after 1 year versus 5 years in a randomised comparison of zotarolimus-eluting and sirolimus-eluting coronary stents (the SORT OUT III study): A multicentre, open-label, randomised superiority trial. Lancet 383(9934): 2047–2056. doi:10.1016/s0140-6736(14)60405-0.

    Article  Google Scholar 

  • Manson, N.C. 2010. Why do patients want information if not to take part in decision making? Journal of Medical Ethics 36(12): 834–837. doi:10.1136/jme.2010.036491.

    Article  Google Scholar 

  • Manuel, D.G., L.C. Rosella, and T.A. Stukel. 2010. Importance of accurately identifying disease in studies using electronic health records. British Medical Journal 341: c4226. doi:10.1136/bmj.c4226.

    Article  Google Scholar 

  • Masic, I. 2012. Ethical aspects and dilemmas of preparing, writing and publishing of the scientific papers in the biomedical journals. Acta Informatica Medica 20(3): 141–148. doi:10.5455/aim.2012.20.141-148.

    Article  Google Scholar 

  • Mittelstadt, B.D., and L. Floridi. 2016. The ethics of big data: Current and foreseeable issues in biomedical contexts. Science and Engineering Ethics 22(2): 303–341. doi:10.1007/s11948-015-9652-2.

    Google Scholar 

  • Moher, D. 2007. Reporting research results: A moral obligation for all researchers. Canadian Journal of Anesthesia 54(5): 331–335.

    Article  Google Scholar 

  • Moher, D., D.J. Cook, S. Eastwood, I. Olkin, D. Rennie, and D.F. Stroup. 1999. Improving the quality of reports of meta-analyses of randomised controlled trials: The QUOROM statement. Quality of Reporting of Meta-analyses. Lancet 354(9193): 1896–1900.

    Article  Google Scholar 

  • Moher, D., I. Simera, K.F. Schulz, J. Hoey, and D.G. Altman. 2008. Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. BMC Medicine 6: 13. doi:10.1186/1741-7015-6-13.

    Article  Google Scholar 

  • Moher, D., A. Liberati, J. Tetzlaff, D.G. Altman, and The PRISMA Group. 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 6(7): e1000097. doi:10.1371/.

    Article  Google Scholar 

  • Moher, D., K.F. Schulz, I. Simera, and D.G. Altman. 2010. Guidance for developers of health research reporting guidelines. PLoS Medicine 7(2): e1000217. doi:10.1371/journal.pmed.1000217.t001.

    Article  Google Scholar 

  • Needleman, I., D. Moher, D.G. Altman, K.F. Schulz, D.R. Moles, and H. Worthington. 2008. Improving the clarity and transparency of reporting health research: A shared obligation and responsibility. Journal of Dental Research 87(10): 894–895.

    Article  Google Scholar 

  • Nicholls, S.G., P. Quach, E. von Elm, A. Guttmann, D. Moher, I. Petersen, H.T. Sørensen, L. Smeeth, S.M. Langan, and E.I. Benchimol. 2015. The REporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) Statement: Methods for Arriving at Consensus and Developing Reporting Guidelines. PLoS One 10(5): e0125620. doi:10.1371/journal.pone.0125620. 10.5061/dryad.7d65n.

    Article  Google Scholar 

  • Nuffield Council on Bioethics. 2015. The collection, linking and use of data in biomedical research and health care: Ethical issues. London: Nuffield Council on Bioethics.

    Google Scholar 

  • O’Connor, A. 2010. Reporting guidelines for primary research: Saying what you did. Preventive Veterinary Medicine 97(3-4): 144–149. doi:10.1016/j.prevetmed.2010.09.010.

    Article  Google Scholar 

  • O’Neill, O. 2002. Autonomy and trust in bioethics. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Prady, S.L., S.J. Richmond, V.M. Morton, and H. Macpherson. 2008. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One 3(2): e1577. doi:10.1371/journal.pone.0001577.

    Article  Google Scholar 

  • Sciencewise. 2014. Big Data. Public views on the collection, sharing and use of personal data by government and companies: Sciencewise Expert Resource Centre, London: UK. http://www.sciencewiseerc.org.uk/cms/assets/Uploads/SocialIntelligenceBigData.pdf.

  • Simera, I., D.G. Altman, D. Moher, K.F. Schulz, and J. Hoey. 2008. Guidelines for reporting health research: The EQUATOR network’s survey of guideline developers. PLoS Medicine 5(6): e139. doi:10.1371/journal.pmed.0050139.t001.

    Article  Google Scholar 

  • Simera, I., D. Moher, A. Hirst, J. Hoey, K.F. Schulz, and D.G. Altman. 2010a. Transparent and accurate reporting increases reliability, utility, and impact of your research: Reporting guidelines and the EQUATOR Network. BMC Medicine 8: 24. doi:10.1186/1741-7015-8-24.

    Article  Google Scholar 

  • Simera, I., D. Moher, J. Hoey, K.F. Schulz, and D.G. Altman. 2010b. A catalogue of reporting guidelines for health research. European Journal of Clinical Investigation 40(1): 35–53. doi:10.1111/j.1365-2362.2009.02234.x.

    Article  Google Scholar 

  • Sorensen, A.A., R.D. Wojahn, M.C. Manske, and R.P. Calfee. 2013. Using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement to assess reporting of observational trials in hand surgery. Journal of Hand Surgery. American Volume 38(8): 1584–1589. doi:10.1016/j.jhsa.2013.05.008. e1582.

    Article  Google Scholar 

  • Taylor, Mark. 2014. Information governance as a force for good? Lessons to be learnt from care.data. SCRIPTed 11(1). doi:10.2966/scrip.110114.1. https://scripted.org/article/information-governance-force-good-lessons-learnt-care-data/.

  • ter Meulen, R.H.J., A.J. Newson, M.-R. Kennedy, and B. Schofield. 2011. Background paper: Genomics, health records, database linkage and privacy. London: Nuffield Council on Bioethics.

    Google Scholar 

  • Thompson, P.A., and A. Burnett. 2012. Reproducible research. CORE Issues in Professional and Research Ethics, Issue 1, Paper 6. https://nationalethicscenter.org/resources/734/download/Thompson.pdf.

  • Turner, L., L. Shamseer, D. G. Altman, L. Weeks, J. Peters, T. Kober, S. Dias, K. F. Schulz, A. C. Plint, and D. Moher. 2012. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database of Systematic Reviews 11:Mr000030. doi:10.1002/14651858.MR000030.pub2.

  • Vasilevsky, N.A., M.H. Brush, H. Paddock, L. Ponting, S.J. Tripathy, G.M. Larocca, and M.A. Haendel. 2013. On the reproducibility of science: Unique identification of research resources in the biomedical literature. PeerJ 1: e148. doi:10.7717/peerj.148.

    Article  Google Scholar 

  • Vayena, E., M. Salathe, L.C. Madoff, and J.S. Brownstein. 2015. Ethical challenges of big data in public health. PLoS Computational Biology 11(2): e1003904. doi:10.1371/journal.pcbi.1003904.

    Article  Google Scholar 

  • von Elm, E., D.G. Altman, M. Egger, S.J. Pocock, P.C. Gotzsche, and J.P. Vandenbroucke. 2007. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. Epidemiology 18(6): 800–804. doi:10.1097/EDE.0b013e3181577654.

    Article  Google Scholar 

  • Wager, E., and S. Kleinert. 2011. Responsible research publication: International standards for authors. A position statement at the 2nd World Conference on Research Integrity, Singapore, July 22–24, 2010. In Promoting research integrity in a global environment, ed. T. Mayer and N. Steneck, 309–316. Singapore: Imperial College Press/World Scientific Publishing.

    Google Scholar 

  • Wang, W., and E. Krishnan. 2014. Big data and clinicians: A review on the state of the science. JMIR Med Inform 2(1): e1. doi:10.2196/medinform.2913.

    Article  Google Scholar 

  • Weiskopf, N.G., and C. Weng. 2013. Methods and dimensions of electronic health record data quality assessment: Enabling reuse for clinical research. Journal of the American Medical Informatics Association 20(1): 144–151. doi:10.1136/amiajnl-2011-000681.

    Article  Google Scholar 

  • World Medical Association. 2013. WMA declaration of Helsinki – Ethical principles for medical research involving human subjects. Fortaleza: World Medical Association.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stuart G. Nicholls .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Nicholls, S.G., Langan, S.M., Benchimol, E.I. (2016). Reporting and Transparency in Big Data: The Nexus of Ethics and Methodology. In: Mittelstadt, B., Floridi, L. (eds) The Ethics of Biomedical Big Data. Law, Governance and Technology Series, vol 29. Springer, Cham. https://doi.org/10.1007/978-3-319-33525-4_15

Download citation

Publish with us

Policies and ethics