Skip to main content
SpringerLink
Log in
Book cover

Software Engineering for Robotics pp 165–187Cite as

Robot Accident Investigation: A Case Study in Responsible Robotics

Abstract

Robot accidents are inevitable. Although rare, they have been happening since assembly line robots were first introduced in the 1960s. But a new generation of social robots is now becoming commonplace. Equipped with sophisticated embedded artificial intelligence (AI), social robots might be deployed as care robots to assist elderly or disabled people to live independently. Smart robot toys offer a compelling interactive play experience for children, and increasingly capable autonomous vehicles (AVs) offer the promise of hands-free personal transport and fully autonomous taxis. Unlike industrial robots, which are deployed in safety cages, social robots are designed to operate in human environments and interact closely with humans; the likelihood of robot accidents is therefore much greater for social robots than industrial robots. This chapter sets out a draft framework for social robot accident investigation, a framework that proposes both the technology and processes that would allow social robot accidents to be investigated with no less rigour than we expect of air or rail accident investigations. The chapter also places accident investigation within the practice of responsible robotics and makes the case that social robotics without accident investigation would be no less irresponsible than aviation without air accident investigation.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Air Accident Investigation Branch, AAIB Centenary Conference (2015)

    Google Scholar 

  2. H. Alemzadeh, J. Raman, N. Leveson, Z. Kalbarczyk, R.K. Iyer, Adverse events in robotic surgery: a retrospective study of 14 years of FDA data. PloS One 11, 4 (2016)

    CrossRef  Google Scholar 

  3. ATSB, Analysis, causality and proof in safety investigations. Technical Report, Canberra: Australian Transport Safety Bureau (2007)

    Google Scholar 

  4. M. Boden, J. Bryson, D. Caldwell, K. Dautenhahn, L. Edwards, S. Kember, P. Newman, V. Parry, G. Pegman, T. Rodden, T. Sorrell, M. Wallis, B. Whitby, A. Winfield, Principles of robotics: regulating robots in the real world. Connect. Sci. 29, 124–129 (2017)

    CrossRef  Google Scholar 

  5. E. Broadbent, Interactions with robots: the truths we reveal about ourselves. Ann. Rev. Psychol. 2017(68-1), 627–652 (2017)

    CrossRef  Google Scholar 

  6. J. Bryson, A. Winfield, Standardizing ethical design for artificial intelligence and autonomous systems. Computer 50(5), 116–119 (2017)

    CrossRef  Google Scholar 

  7. BSI, BS8611:2016 Robots and Robotic Devices, Guide to the Ethical Design and Application of Robots and Robotic Systems. British Standards Institute (2016)

    Google Scholar 

  8. B.S. Dhillon, Robot accidents, in Robot Reliability and Safety (Springer, New York, 1991)

    CrossRef  Google Scholar 

  9. M.C. Elish, Moral crumple zones: cautionary tales in human-robot interaction. Engag. Sci. Technol. Soc. 5, 40–60 (2019)

    CrossRef  Google Scholar 

  10. EU, Regulation No 996/2010 of the European Parliament and of the Council of 20 October 2010 on the investigation and prevention of accidents and incidents in civil aviation and repealing Directive 94/56/EC. Official Journal of the European Union, 12.11.2010 (2010)

    Google Scholar 

  11. R.P. Fisher, R.E. Geiselman, Memory Enhancing Techniques for Investigative Interviewing: The Cognitive Interview (Charles C Thomas Publishe, Springfield, 1992)

    Google Scholar 

  12. H. Gabler, C. Hampton, J. Hinch, Crash severity: A comparison of event data recorder measurements with accident reconstruction estimates. SAE Technical Paper 2004-01-1194 (2004)

    Google Scholar 

  13. D.R. Grossi, Aviation recorder overview, national transportation safety board [NTSB]. J. Accid. Investig. 2(1), 31–42 (2006)

    Google Scholar 

  14. IEEE, The IEEE global initiative on ethics of autonomous and intelligent systems. ethically aligned design: A vision for prioritizing human well-being with autonomous and intelligent systems, first edition. Technical Report, IEEE (2019)

    Google Scholar 

  15. International Civil Aviation Authority, Annex 13 to the Convention on International Civil Aviation, Aircraft Accident and Incident Investigation (ICAO, Montreal, 2007)

    Google Scholar 

  16. International Federation of Robotics (IFR), Executive Summary World Robotics 2019 Industrial Robots (2019)

    Google Scholar 

  17. International Standards Organisation, ISO 13482:2015: Robots and robotic devices - Safety requirements for Personal Care Robots (ISO, Geneva, 2014)

    Google Scholar 

  18. A. Jobin, M. Ienca, E. Vayena, The global landscape of AI ethics guidelines. Nat. Mach. Intell. 1, 389–399 (2019)

    CrossRef  Google Scholar 

  19. P.B. Ladkin, Causal System Analysis (Springer, Heidelberg, 2001)

    Google Scholar 

  20. P.B. Ladkin, J. Sanders, T. Paul-Stueve, The WBA Workbook (Causalis in der IIT GmbH, Bielefeld, 2005). https://rvs-bi.de/research/WBA/TheWBACaseBook.pdf

  21. C. Macrae, Making risks visible: Identifying and interpreting threats to airline flight safety. J. Occup. Organ. Psychol. 82(2), 273–293 (2010)

    CrossRef  Google Scholar 

  22. C. Macrae, Close Calls: Managing Risk and Resilience in Airline Flight Safety (Palgrave, London, 2014)

    CrossRef  Google Scholar 

  23. C. Macrae, The problem with incident reporting. BMJ Qual. Saf. 25(2), 71–75 (2016)

    CrossRef  Google Scholar 

  24. C. Macrae, C. Vincent, Investigating for improvement. building a national safety investigator for healthcare. clinical human factors group thought paper. Technical Report (2017)

    Google Scholar 

  25. T. Malm, J. Viitaniemi, J. Latokartano, et al., Safety of interactive robotics - learning from accidents. Int. J. Soc. Rob. 2, 221–227 (2010)

    CrossRef  Google Scholar 

  26. R. Moore, A bayesian explanation of the uncanny valley - effect and related psychological phenomena. Sci. Rep. 2, 864 (2012)

    CrossRef  Google Scholar 

  27. National Transportation Safety Board, Collision Between a Car Operating With Automated Vehicle Control Systems and a Tractor-Semitrailer Truck Near Williston, Florida. Washington (2016)

    Google Scholar 

  28. National Transportation Safety Board, Preliminary Report for Crash Involving Pedestrian. Washington (2018)

    Google Scholar 

  29. NHS, NaPSIR quarterly data summary April-June 2019. Technical Report, NHS (2019)

    Google Scholar 

  30. C. O’Donovan, Explicitly ethical standards for robotics. Technical Report, Working paper for the international symposium: Post-automation, democratic alternatives to Industry 4.0 SPRU - Science Policy Research Unit, University of Sussex, 11–13 September, 2019 (2020)

    Google Scholar 

  31. R. Owen, The UK engineering and physical sciences research council’s commitment to a framework for responsible innovation. J. Res. Innov. 1(1), 113–117 (2014)

    Google Scholar 

  32. A.K. Pandey, R. Gelin, A mass-produced sociable humanoid robot: pepper: the first machine of its kind. IEEE Rob. Autom. Mag. 25(3), 40–48 (2018)

    CrossRef  Google Scholar 

  33. I. Radun, H. Summala, Sleep-related fatal vehicle accidents: characteristics of decisions made by multidisciplinary investigation teams. Sleep 27(2), 224–227 (2004)

    CrossRef  Google Scholar 

  34. J.T. Reason, Managing the Risks of Organisational Accidents (Ashgate, Aldershot, 1997)

    Google Scholar 

  35. J. Sanders, Introduction to Why Because Analysis (Bielefeld University, 2012). http://rvs.uni-bielefeld.de/research/WBA/WBA_Introduction.pdf

  36. S. Spiekermann, T. Winkler, Value-based Engineering for Ethics by Design (2020). https://arxiv.org/abs/2004.13676

  37. N.A. Stanton, P.M. Salmon, L.A. Rafferty, G.H. Walker, C. Baber, D.P. Jenkins, Human Factors Methods: A Practical Guide for Engineering and Design (Routledge, London, 2013)

    Google Scholar 

  38. P. Underwood, P. Waterson, Systems thinking, the Swiss cheese model and accident analysis: a comparative systemic analysis of the Grayrigg train derailment using the ATSB, AcciMap and STAMP models. Accid. Anal. Prev. 68, 75–94 (2014)

    CrossRef  Google Scholar 

  39. H. Webb, M. Jirotka, A.F. Winfield, K. Winkle, Human-robot relationships and the development of responsible social robots, in Proceeding of the Halfway to the Future Symposium 2019 (HTTF 2019), NY, 2019. Association for Computing Machinery Article 12, pp. 1–7

    Google Scholar 

  40. A. Winfield, Ethical standards in robotics and AI. Nat. Electron. 2(2), 46–48 (2019)

    CrossRef  Google Scholar 

  41. A.F. Winfield, M. Jirotka, The case for an ethical black box, in Towards Autonomous Robotic Systems (TAROS 2017) Lecture Notes in Computer Science Vol. 10454, ed. by Y. Gao, S. Fallah, Y. Jin, C. Lekakou (Springer, Cham, 2017), pp. 262–273

    CrossRef  Google Scholar 

  42. A.F. Winfield, M. Jirotka, Ethical governance is essential to building trust in robotics and artificial intelligence systems, phil. Trans. R. Soc. A 376 (2018). https://doi.org/10.1098/rsta.2018.0085

Download references

Acknowledgements

The work of this chapter has been conducted within EPSRC project RoboTIPS, grant reference EP/S005099/1 RoboTIPS: Developing Responsible Robots for the Digital Economy. CM’s contribution to this work was supported by the Wellcome Trust [213632/Z/18/Z].

Author information

Authors and Affiliations

  1. Bristol Robotics Lab, UWE Bristol, Bristol, UK

    Alan F. T. Winfield

  2. School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden

    Katie Winkle

  3. Department of Computer Science, University of Oxford, Oxford, UK

    Helena Webb, Ulrik Lyngs & Marina Jirotka

  4. Nottingham University Business School, University of Nottingham, Nottingham, UK

    Carl Macrae

Authors
  1. Alan F. T. Winfield
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Katie Winkle
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Helena Webb
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ulrik Lyngs
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marina Jirotka
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Carl Macrae
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alan F. T. Winfield .

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of York, York, UK

    Prof. Ana Cavalcanti

  2. University of Surrey, Guildford, UK

    Dr. Brijesh Dongol

  3. University of Sheffield, Sheffield, UK

    Prof. Rob Hierons

  4. University of Sunderland, Sunderland, UK

    Prof. Jon Timmis

  5. Department of Computer Science, University of York, York, UK

    Prof. Dr. Jim Woodcock

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Winfield, A.F.T., Winkle, K., Webb, H., Lyngs, U., Jirotka, M., Macrae, C. (2021). Robot Accident Investigation: A Case Study in Responsible Robotics. In: Cavalcanti, A., Dongol, B., Hierons, R., Timmis, J., Woodcock, J. (eds) Software Engineering for Robotics. Springer, Cham. https://doi.org/10.1007/978-3-030-66494-7_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-66494-7_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-66493-0

  • Online ISBN: 978-3-030-66494-7

  • eBook Packages: Computer ScienceComputer Science (R0)

search

Navigation