Skip to main content

Advertisement

Log in

Trust and Justice in Big Data Analytics: Bringing the Philosophical Literature on Trust to Bear on the Ethics of Consent

  • Research Article
  • Published:
Philosophy & Technology Aims and scope Submit manuscript

Abstract

Much bioethical literature and policy guidances for big data analytics in biomedical research emphasize the importance of trust. It is essential that potential participants trust so they will allow their data to be used to further research. However, comparatively, little guidance is offered as to what trustworthy oversight mechanisms are, or how policy should support them, as data are collected, shared, and used. Generally, “trust” is not characterized well enough, or meaningfully enough, for the term to be systematically applied in policy development. Yet points made in the philosophical literature on trust can help. They allow us, not only to better distinguish the different ways the term “trust” may be interpreted, but also to better determine how different approaches to trust can align with policy and governance—in what ways they may relate to key bioethical concepts and related laws, and in what ways they can help to balance individual and group interests in data sharing. This article draws from the philosophical literature on trust to identify a relationship among consent, trust, and justice. Specifically, parallels are drawn between “character-trustworthiness” and “natural justice,” a set of widely held legal safeguards intended to ensure decision-makers follow a pattern of procedural fairness which protects the rights of the individual and thereby maintains public confidence in the decision-making process. Relevance to traditional bioethical principles, established laws, and consent procedures are addressed throughout. In conclusion, policy actions are suggested.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. Big data analytics (BDA) is a broad term. There are cases where new forms of data-enabled research in biomedicine concern new analytical capabilities which allow for an exponential increase in the volume of similar kinds of data. A paradigmatic example in genomics is genome-wide association studies (GWAS). And there are also cases where they concern analytic abilities in the “cross-matching” of multiple data types. Though, depending on the ethical legal considerations surrounding different kinds of data sets, the logistical and regulatory differences between them can be great; for simplicity’s sake, I use “BDA” to refer to both of these forms of data-enabled research.

  2. Adherence to this priority helps ensure practices remain in accordance with the Universal Declaration of Human Rights (United Nations 1948) and related UNESCO Declarations on the human genome, human genetic data, and bioethics (UNESCO 1997, 2003, 2005), as well as with ethical duties, legal instruments, and official guidelines consistent with these, such as the recent Declaration of Taipei (World Medical Association 2016).

  3. “Mission drift” is where consent conditions, the original parameters of an agreement to have one’s data collected and used, become decoupled from actual usage of the data.

  4. The ethical considerations underlying different forms of consent is a source of great debate, yet that topic is beyond the scope of this article.

  5. We see this desire to share personal data, for instance, among participants who seek to advance research on rare or undiagnosed diseases.

  6. In addition to transparency, participation, and inclusion, protection of individuals is stressed. In language very similar to that found in UNESCO declarations on bioethics, the human genome, and genetic data, it also states, “Governance should be designed so the rights of individuals prevail over the interests of other stakeholders and science.”

  7. The meanings of and distinctions between “trust,” “trusting,” and “trustworthiness” can vary in the philosophical literature, depending upon what theory is being applied. For the purposes of this article, “trust” is a relation between one who “trusts” and another person or entity who is “trustworthy.” The trust relation holds only where the former deems the latter to be trustworthy.

  8. In the decades since it was introduced by Beauchamp and Childress, the influence of the four principles approach has steadily grown. But it is not without its critics. One point of contention is whether or not deliberation as to how to best balance them in any given context a rational or an intuitive process. Another is whether or not the principles are merely cultural constructs, susceptible to the same relativizing critiques as any other normative framework. The epistemic and metaethical status of the principles themselves is subject to debate.

  9. For instance, the International Ethical Guidelines for Biomedical Research Involving Human Subjects Council for International Organizations of Medical Sciences.

  10. For instance, beneficence applied in isolation from autonomy amounts to no more than a consequentialist approach. Potential participants in research have no say on the “good” being pursued in a type of research, as one does when considering whether or not to support a particular research mission statement (below). Attempting to isolate beneficence in this way stands opposed to the rights-based, deontological frameworks put in place by traditional bioethics and much related law (below), making it quite difficult to come to any agreement as to how the principle of justice should apply, let alone how justice should be administered in policy, practice, or law.

  11. For instance, informed consent procedures may sometimes be in place to protect biobanks against potential litigation, rather than for the participant’s benefit.

  12. In addition to the data, algorithms themselves need to be governed (Ananny 2016; Crawford 2016; Neyland 2016; Zarsky 2016; Ziewitz 2016).

  13. “Dynamic consent,” in a general sense, refers to a consent process where individuals can give, revoke, or modify their permissions over time whenever their samples or data may be used in new research projects. It allows for different kinds of consent for different kinds of research. Here, the term also refers to a specific project in the field which is developing ICT interfaces of this type that satisfy regulatory requirements for consent (Kaye et al. 2015).

  14. “By advancing scientific knowledge, the research community reciprocates and ‘pays back’ the participant’s volunteerism. A sense of community among participants can help bridge the gap between societal and individual rewards” (Erlich et al. 2014). However, their approach to dynamic consent prevents the model from being entirely based on these encapsulated interests.

  15. A case in point, where exactly these kinds of factors need to be considered, is the UK’s care.data initiative, where personal medical data are released for broader research purposes (Woolley et al. 2016; Sterckx et al. 2016; Carter et al. 2015; Nature Editorial, 2014).

  16. For more on this last point, see the insightful analysis of risk by Jonathan Wolff (Wolff 2010).

  17. For instance, one may have an interest in marketing cigarettes to children, while another may have an interest in protecting the health of his child, while that child might have an interest in learning to smoke.

  18. See for example, the International Ethical Guidelines for Biomedical Research Involving Human Subjects Council for International Organizations of Medical Sciences.

  19. It is worth noting that, while this can be quite a difficult process, it is not unlike what a typical ethics oversight committee routinely does when approving biomedical research proposals.

  20. For instance, if one is to adjudicate over the interests involved in marketing cigarettes to children, the adjudicator should not have a financial interest in the selling of cigarettes and should instead be motivated by concern for the rights and well-being of all stakeholders.

  21. This usage of “good” is in keeping with Aristotle’s, Mill’s, Kant’s, and Rawls’ initial uses, prior to the application of eudaimonic, utilitarian, and deontological constraints, respectively. Some may say this “economic” approach of reducing values to interests has little consequence for either rational or moral arguments, that it is no more than a method of “analytical book-keeping” (Simpson 2013). They would be right. And this is the intent. The point is to abstain from making any judgements about value systems at the individual level by divesting any one value system from a claim to moral absoluteness. Instead, moral judgments are to be made at the societal level by applying the constraints of natural justice. This is key to addressing issues of governance in that it ensures that both rational and normative arguments remain at the societal level, and can easily be distinguished from the individual level.

  22. The claim is it is rational not to trust B when B has no interest in being trustworthy. It is not a claim that trust must be understood as being purely rationally-based. As noted above, trust may have many dimensions, rationality being only one. Baier, for instance, holds that trust is not something abstract and rationally determined so much as, following in the vein of David Hume, a result of the cultivation of relationships through virtuous character traits, such as sympathy or compassion. Perception of these may be better attributed to “emotional” rather than “rational” intelligence. Yet, here too, one can speak in terms of goodwill toward another’s interest, although in ways different than in rationalistic or contractarian frameworks. One would not say is it “not rational” to trust, rather one might say “trustworthiness is in doubt” (before a trust relation is established) or “trust is betrayed” (when a trust relation breaks down).

  23. Such as in cases where there are in immediate dangers to public health and safety due to spread of infectious diseases and pandemics.

  24. https://www.hl7.org/fhir/consent.html

  25. https://duos.broadinstitute.org/

References

  • Aicardi, C., Del Savio, l., Dove, E., Lucivero, Niccolò Tempini, F., & Prainsack, B. (2016). Emerging ethical issues regarding digital health data. On the World Medical Association Draft Declaration on Ethical Considerations Regarding Health Databases and Biobanks. Croatian Medical Journal, 57(2), 207.

    Article  Google Scholar 

  • Ananny, M. (2016). Toward an ethics of algorithms: convening, observation, probability, and timeliness. Science, Technology, and Human Values, 41(1), 93–117.

    Article  Google Scholar 

  • Angrist, M. (2009). Eyes wide open: the personal genome project, citizen science and veracity in informed consent. Personalized Medicine, 6, 691.

    Article  Google Scholar 

  • Baier, A. (1995). Moral prejudices: essays on ethics. Cambridge: Harvard University Press.

    Google Scholar 

  • Beauchamp, T. L., & Childress, J. F. (2001). Principles of biomedical ethics. Oxford University Press.

  • Carter, P., Laurie, G. T., Dixon-Woods, M. (2015). The social licence for research: why care.data ran into trouble. Journal of Medical Ethics. https://doi.org/10.1136/medethics-2014-102374.

  • Coakley, M., Leerkes, M., Barnett, J., et al. (2013). Unlocking the power of big data at the national institutes of health. Big Data, 1(3), 183–186.

    Article  Google Scholar 

  • Coleman, J. S. (1990). Foundations of social theory. Cambridge: Belknap Press.

    Google Scholar 

  • Crawford, K. (2016). Can an algorithm be agonistic? Ten scenes from life in calculated publics. Science, Technology, and Human Values, 41(1), 77–92.

    Article  Google Scholar 

  • de Vries, J., Williams, T., Bojang, K., Kwiatkowski, D., Fitzpatrick, R., & Parker, M. (2014). Knowing who to trust: exploring the role of ‘ethical metadata’ in mediating risk of harm in collaborative genomics research in Africa. BMC Medical Ethics, 15(1), 62.

    Article  Google Scholar 

  • Dove, E. S., Knoppers, B. M., & Ma'n, H. Z. (2014). Towards an ethics safe harbor for global biomedical research. Journal of Law and the Biosciences, 1(1), 3–51.

    Article  Google Scholar 

  • Dyke, S., Philippakis, A., Rambla De Argila, J., Paltoo, D., Luetkemeier, et al. (2016). Consent codes: upholding standard data use conditions. PLoS Genetics, 12(1), e1005772.

    Article  Google Scholar 

  • Erlich, Y., Williams, J. B., Glazer, D., Yocum, K., Farahany, N., Olson, M., Narayanan, A., Stein, L. D., Witkowski, J. A., & Kain, R. C. (2014). Redefining genomic privacy: trust and empowerment. PLoS Biology, 12(11), e1001983.

    Article  Google Scholar 

  • Faulkner, P. (2014). The practical rationality of trust. Synthese, 191(9), 1975–1989.

    Article  Google Scholar 

  • Federal Register (2017). Revisions to US Federal Policy for the Protection of Human Subjects, originally promulgated as a Common Rule in 1991. https://s3.amazonaws.com/public-inspection.federalregister.gov/2017-01058.pdf.

  • Global Alliance for Genomics & Health (GA4GH) and International Rare Disease Research Consortium (IRDiRC) (2016). Automatable Discovery and Access Matrix (“ADA-M”) v1.0. Guidance document. https://genomicsandhealth.org/work-products-demonstration-projects/automatable-discovery-and-access-matrix.

  • Global Alliance for Genomics and Health (2017). Global Ethics Review Recognition Policy. Policy Document. https://genomicsandhealth.org/work-products-demonstration-projects/ethics-review-recognition-policy.

  • Green, E. D., Guyer, M. S., & National Human Genome Research Institute. (2011). Charting a course for genomic medicine from base pairs to bedside. Nature, 470, 204–213.

    Article  Google Scholar 

  • Hardin, R. (2002). Trust and trustworthiness. Russell Sage Foundation.

  • Holton, R. (1994). Deciding to trust, coming to believe. Australasian Journal of Philosophy, 72(1), 63–76.

    Article  Google Scholar 

  • Ioannidis, J. P. A. (2013). Informed consent, big data, and the oxymoron of research that is not research. The American Journal of Bioethics, 13(4), 40–42.

    Article  Google Scholar 

  • Juengst, E., McGowan, M., Fishman, J., & Settersten, R. (2016). From “personalized” to “precision” medicine: the ethical and social implications of rhetorical reform in genomic medicine. Hastings Center Report, 46(5), 21–33.

    Article  Google Scholar 

  • Karlsen, J. R., Solbakk, J. H., & Holm, S. (2011). Ethical endgames: broad consent for narrow interests; open consent for closed minds. Cambridge Quarterly of Healthcare Ethics, 20(4), 572–583.

    Article  Google Scholar 

  • Kaye, J., Whitley, E. A., Lund, D., Morrison, M., Teare, H., & Melham, K. (2015). Dynamic consent: a patient interface for twenty-first century research networks. European Journal of Human Genetics, 23(2), 141–146.

    Article  Google Scholar 

  • Knoppers, B., Harris, J., Budin-Ljøsne, I., & Dove, E. (2014). A human rights approach to an international code of conduct for genomic and clinical data sharing. Human Genetics, 133(7), 895–903.

    Article  Google Scholar 

  • Leetaru, K. (2016). Are research ethics obsolete in the era of big data?. https://www.forbes.com/forbes/welcome/?toURL=https://www.forbes.com/sites/kalevleetaru/2016/06/17/are-research-ethics-obsolete-in-the-era-of-big-data/&refURL=https://www.google.co.uk/&referrer=https://www.google.co.uk/

  • Lunshof, J. E., Chadwick, R., Vorhaus, D. B., & Church, G. M. (2008). From genetic privacy to open consent. Nature Reviews Genetics, 9(5), 406–411.

    Article  Google Scholar 

  • Manyika J, Chui M, Farrell D, et al. (2013). Open data: unlocking innovation and performance with liquid information. McKinsey Global Institute. 21.

  • Metcalf, J. (2017). Letter on Proposed Changes to the Common Rule. Council for Big Data, Ethics, and Society. Accessed July 17, 2017. http://bdes.datasociety.net/council-output/letter-on-proposed-changes-to-the-common-rule/. Al-Rodhan, Nayef. The Social Contract 2.0: Big Data and the Need to Guarantee Privacy and Civil Liberties. Harvard International Review (2014).

  • Mills, P. (2015). Comments on WMA Declaration on Ethical Considerations regarding Health Databases and Biobanks (Draft 2015–03-18). Nuffield Council on Bioethics. https://nuffieldbioethics.org/wp-content/uploads/WMA-health-databases-declaration_Nuffield-Council-on-Bioethics-June-2015.pdf.

  • Mittelstadt, B., and Floridi, L. (2016). The ethics of big data: current and foreseeable issues in biomedical contexts. In B. Mittelstadt and L. Floridi (Eds.), The ethics of biomedical big data. Volume 29 of the series Law, Governance and Technology Series (pp. 455–480). Springer International Publishing.

  • National Institute of Health, ‘About the All of Us Research Program’ (2017). https://allofus.nih.gov/about/about-all-us-research-program.

  • Nature Editorial. (2014). Power to the people: NHS medical records policy. Nature, 50(5), 261.

    Google Scholar 

  • Neyland, D. (2016). Bearing account-able witness to the ethical algorithmic system. Science, Technology, and Human Values, 41(1), 50–76.

    Article  Google Scholar 

  • Nickel, P. J. (2007). Trust and obligation-ascription. Ethical Theory and Moral Practice, 10(3), 309–319.

    Article  Google Scholar 

  • O'Neill, O. (2002). Autonomy and trust in bioethics. Cambridge: Cambridge University Press.

  • O'Neill, O. (2003). Some limits of informed consent. Journal of Medical Ethics, 29(1), 4–7.

    Article  Google Scholar 

  • Prainsack, B., & Buyx, A. (2011). Solidarity: reflections on an emerging concept in bioethics. London: Nuffield Council on Bioethics.

    Google Scholar 

  • Prainsack, B., & Buyx, A. (2012). Understanding solidarity (with a little help from your friends) response to Dawson and Verweij. Public Health Ethics., 5(2), 206–210.

    Article  Google Scholar 

  • Prainsack, B., & Buyx, A. (2013). A solidarity-based approach to the governance of research biobanks. Medical Law Review, 1(1), 71–91.

    Article  Google Scholar 

  • Prainsack, B., & Buyx, A. (2016). Solidarity in Biomedicine and Beyond (Vol. 33). Cambridge University Press.

  • Richards, M. R., Anderson, S., Hinde, J., Kaye, J., Lucassen, A., Matthews, P., Parker, M., et al. (2015). The collection, linking and use of data in biomedical research and health care: ethical issues. London: Nuffield Council on Bioethics https://nuffieldbioethics.org/wp-content/uploads/Biological_and_health_data_web.pdf.

    Google Scholar 

  • Sankar, P.L., and Parker, L.S. (2016). The precision medicine initiative’s all of us research program: an agenda for research on its ethical, legal, and social issues. Genetics in Medicine 19, 743–750. https://doi.org/10.1038/gim.2016.183.

  • Shabani, M., & Borry, P. (2016). “You want the right amount of oversight”: interviews with data access committee members and experts on genomic data access. Genetics in Medicine, 18(9), 892–897.

    Article  Google Scholar 

  • Sheehan, M. (2011a). Broad consent is informed consent. BMJ, 343, d6900.

    Article  Google Scholar 

  • Sheehan, M. (2011b). Can broad consent be informed consent? Public Health Ethics, 4, 226–235 phr020.

    Article  Google Scholar 

  • Shrack, T. D., Ruff, A. M. and Johnson, M. T. (2015). Proposed revisions to the common rule receive harsh criticism from industry stakeholders. http://www.lexology.com/library/detail.aspx?g=2a59a3ee-c9ee-40d4-91a4-b7b5d698d76c.

  • Simpson, T. (2012). What Is Trust?. Pacific Philosophical Quarterly, 93(4), 550–569.

  • Simpson, T. (2013). Trustworthiness and moral character. Ethical Theory and Moral Practice, 16(3), 543–557.

    Article  Google Scholar 

  • Sterckx, S., Cockbain, J., Howard, H., Huys, I., & Borry, P. (2013). “Trust is not something you can reclaim easily”: patenting in the field of direct-to-consumer genetic testing. Genetics in Medicine, 15(5), 382–387.

    Article  Google Scholar 

  • Sterckx, S., Rakic, V., Cockbain, J., & Borry, P. (2016). “You hoped we would sleep walk into accepting the collection of our data”: controversies surrounding the UK care.data scheme and their wider relevance for biomedical research. Medicine, Health Care and Philosophy., 19(2), 177–190. https://doi.org/10.1007/s11019-015-9661-6.

    Article  Google Scholar 

  • UK’s Department for Business Innovation and Skills (2011). The Strategy for UK Life Sciences. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/32457/11-1429-strategy-for-uk-life-sciences.pdf.

  • UNESCO (1997). Declaration on the Human Genome and Human Rights. http://www.unesco.org/new/en/social-and-human-sciences/themes/bioethics/human-genome-and-human-rights/.

  • UNESCO (2003). International Declaration on and Human Genetic Data. http://www.unesco.org/new/en/social-and-human-sciences/themes/bioethics/human-genetic-data/.

  • UNESCO (2005). Universal Declaration on Bioethics and Human Rights. http://www.unesco.org/new/en/social-and-human-sciences/themes/bioethics/bioethics-and-human-rights/.

  • United Nations (1948). International Declaration of Human Rights. http://www.un.org/en/universal-declaration-human-rights/.

  • Vayena, E., Brownsword, R., Edwards, S. J., Greshake, B., Kahn, J. P., Ladher, N, Montgomery, J. et al. (2015). Research led by participants: a new social contract for a new kind of research. Journal of Medical Ethics. medethics-2015.

  • Wolff, J. (2010). Five types of risky situation. Law, Innovation and Technology, 2(2), 151–163.

    Article  Google Scholar 

  • Woolley, J. P. (2016). How data are transforming the landscape of biomedical ethics: the need for ELSI metadata on consent. In B. Mittelstadt and L. Floridi (Eds.), The ethics of biomedical big data. Volume 29 of the series Law, Governance and Technology Series (pp. 171–197). Springer International Publishing.

  • Woolley, J. P., McGowan, M., Teare, H., Coathup, V., Fishman, J., Settersten, R., et al. (2016). Citizen science or scientific citizenship? Disentangling the uses of public engagement rhetoric in national research initiatives. BMC Medical Ethics, 17(1), 1.

    Article  Google Scholar 

  • World Medical Association (2016). Declaration of Taipei on Ethical Considerations regarding Health Databases and Biobanks. http://www.wma.net/en/30publications/10policies/d1/.

  • Zarsky, T. (2016). The trouble with algorithmic decisions: an analytic road map to examine efficiency and fairness in automated and opaque decision making. Science, Technology, and Human Values, 41(1), 118–132.

    Article  Google Scholar 

  • Ziewitz, M. (2016). Governing algorithms: myth, mess, and methods. Science, Technology, and Human Values, 41(1), 3–16.

    Article  Google Scholar 

Download references

Acknowledgments

This work was made possible by a Fellowship at Harris Manchester College, University of Oxford and the Center for Health, Law, and Emerging Technologies (HeLEX), Nuffield Department of Population Health, University of Oxford. My thanks go to Tom Simpson for sharing his unpublished essay discussed in this article, and to the reviewers of this article whose feedback helped to improve it substantially.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Patrick Woolley.

Ethics declarations

Conflict of Interest

The author is a member of the Global Alliance for Genomics and Health and has helped produce some of the policy documents and ICT tools highlighted in the article.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Woolley, J.P. Trust and Justice in Big Data Analytics: Bringing the Philosophical Literature on Trust to Bear on the Ethics of Consent. Philos. Technol. 32, 111–134 (2019). https://doi.org/10.1007/s13347-017-0288-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13347-017-0288-9

Keywords

Navigation