Skip to main content
SpringerLink
Log in

Coverage-Driven Verification —

An Approach to Verify Code for Robots that Directly Interact with Humans

  • Conference paper
  • First Online:
Hardware and Software: Verification and Testing (HVC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 9434))

Included in the following conference series:

Abstract

Collaborative robots could transform several industries, such as manufacturing and healthcare, but they present a significant challenge to verification. The complex nature of their working environment necessitates testing in realistic detail under a broad range of circumstances. We propose the use of Coverage-Driven Verification (CDV) to meet this challenge. By automating the simulation-based testing process as far as possible, CDV provides an efficient route to coverage closure. We discuss the need, practical considerations, and potential benefits of transferring this approach from microelectronic design verification to the field of human-robot interaction. We demonstrate the validity and feasibility of the proposed approach by constructing a custom CDV testbench and applying it to the verification of an object handover task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.ros.org/.

  2. 2.

    http://gazebosim.org/.

  3. 3.

    http://moveit.ros.org/.

  4. 4.

    http://www.uppaal.org/.

  5. 5.

    http://www.cprover.org/cbmc/.

  6. 6.

    http://javapathfinder.sourceforge.net/.

  7. 7.

    http://nedbatchelder.com/code/coverage/.

References

  1. Alexander, R., Hawkins, H., Rae, D.: Situation Coverage - A Coverage Criterion for Testing Autonomous Robots. Department of Computer Science, University of York, Technical Report (2015)

    Google Scholar 

  2. Armoni, R., Korchemny, D., Tiemeyer, A., Vardi, M.Y., Zbar, Y.: Deterministic dynamic monitors for linear-time assertions. In: Havelund, K., Núñez, M., Roşu, G., Wolff, B. (eds.) FATES 2006 and RV 2006. LNCS, vol. 4262, pp. 163–177. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  3. Bordini, R.H., Fisher, M., Sierhuis, M.: Formal verification of human-robot teamwork. In: Proceedings of ACM/IEEE HRI, pp. 267–268 (2009)

    Google Scholar 

  4. Boren, J., Cousins, S.: The SMACH high-level executive. IEEE Robot. Autom. Mag. 17(4), 18–20 (2010)

    Article  Google Scholar 

  5. Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. MIT Press, Cambridge (1999)

    Google Scholar 

  6. Cowley, A., Taylor, C.J.: Towards language-based verification of robot behaviors. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4776–4782. IEEE (2011)

    Google Scholar 

  7. Eder, K., Harper, C., Leonards, U.: Towards the safety of human-in-the-loop robotics: challenges and opportunities for safety assurance of robotic co-workers. In: Proceedings of IEEE ROMAN, pp. 660–665 (2014)

    Google Scholar 

  8. Foster, H.D., Krolnik, A.C., Lacey, D.J.: Assertion-Based Design, 2nd edn. Springer, Heidelberg (2004)

    Google Scholar 

  9. Grigore, E.C., Eder, K., Lenz, A., Skachek, S., Pipe, A.G., Melhuish, C.: Towards safe human-robot interaction. In: Groß, R., Alboul, L., Melhuish, C., Witkowski, M., Prescott, T.J., Penders, J. (eds.) TAROS 2011. LNCS, vol. 6856, pp. 323–335. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  10. Haedicke, F., Le, H., Grosse, D., Drechsler, R.: CRAVE: an advanced constrained random verification environment for System C. In: Proceedings of SoC, pp. 1–7 (2012)

    Google Scholar 

  11. Hartmanns, A., Hermanns, H.: A modest approach to checking probabilistic timed automata. In: Proceedings of QEST, pp. 187–196 (2009)

    Google Scholar 

  12. Havelund, K., Roşu, G.: Synthesizing monitors for safety properties. In: Katoen, J.-P., Stevens, P. (eds.) TACAS 2002. LNCS, vol. 2280, pp. 342–356. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  13. Ioannides, C., Eder, K.I.: Coverage-directed test generation automated by machine learning - a review. ACM Trans. Des. Autom. Electron. Syst. 17(1), 7:1–7:21 (2012)

    Article  Google Scholar 

  14. Kouskoulas, Y., Renshaw, D.W., Platzer, A., Kazanzides, P.: Certifying the safe design of a virtual fixture control algorithm for a surgical robot. In: Belta, C., Ivancic, F. (eds.) Proceedings of Hybrid Systems: Computation and Control (HSCC), pp. 263–272. ACM (2013)

    Google Scholar 

  15. Lackner, H., Schlingloff, B.: Modeling for automated test generation a comparison. In: Proceedings of MBEES Workshop (2012)

    Google Scholar 

  16. Lakhotia, K., McMinn, P., Harman, M.: Automated test data generation for coverage: haven’t we solved this problem yet? In: Proceedings TAIC (2009)

    Google Scholar 

  17. Lenz, A., Skachek, S., Hamann, K., Steinwender, J., Pipe, A., Melhuish, C.: The BERT2 infrastructure: an integrated system for the study of human-robot interaction. In: Proceedings of IEEE-RAS Humanoids, pp. 346–351 (2010)

    Google Scholar 

  18. Milner, R.: A Calculus of Communicating Systems. LNCS. Springer, Heidelberg (1980)

    Book  MATH  Google Scholar 

  19. Mohammed, A., Furbach, U., Stolzenburg, F.: Multi-robot systems: modeling, specification, and model checking. In: Robot Soccer, pp. 241–265 (2010)

    Google Scholar 

  20. Muradore, R., Bresolin, D., Geretti, L., Fiorini, P., Villa, T.: Robotic surgery. IEEE Robot. Autom. Mag. 18(3), 24–32 (2011)

    Article  Google Scholar 

  21. Nielsen, B., Skou, A.: Automated test generation from timed automata. Int. J. Softw. Tools Technol. Transfer 5, 59–77 (2003)

    Article  MATH  Google Scholar 

  22. Nielsen, B.: Towards a method for combined model-based testing and analysis. In: Proceedings of MODELSWARD, pp. 609–618 (2014)

    Google Scholar 

  23. Piziali, A.: Functional Verification Coverage Measurement and Analysis. Kluwer Academic, Boston (2004)

    Google Scholar 

  24. Trojanek, P., Eder, K.: Verification and testing of mobile robot navigation algorithms: a case study in SPARK. In: Proceedings of IROS, pp. 1489–1494 (2014)

    Google Scholar 

  25. Webster, M., Dixon, C., Fisher, M., Salem, M., Saunders, J., Koay, K.L., Dautenhahn, K.: Formal verification of an autonomous personal robotic assistant. In: Proceedings of AAAI FVHMS 2014, pp. 74–79 (2014)

    Google Scholar 

  26. Wile, B., Goss, J.C., Roesner, W.: Comprehensive Functional Verification. Morgan Kaufmann, San Francisco (2005)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the EPSRC grants EP/K006320/1 and EP/K006223/1 “Trustworthy Robotic Assistants”.

We are grateful for the productive discussions with Yoav Hollander, Yaron Kashai, Ziv Binyamini and Mike Bartley.

Author information

Authors and Affiliations

  1. Department of Computer Science and Bristol Robotics Laboratory, University of Bristol, Bristol, UK

    Dejanira Araiza-Illan, David Western & Kerstin Eder

  2. Faculty of Engineering Technology and Bristol Robotics Laboratory, University of the West of England, Bristol, UK

    Anthony Pipe

Authors
  1. Dejanira Araiza-Illan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Western
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anthony Pipe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kerstin Eder
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kerstin Eder .

Editor information

Editors and Affiliations

  1. University of Leicester, Leicester, United Kingdom

    Nir Piterman

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Araiza-Illan, D., Western, D., Pipe, A., Eder, K. (2015). Coverage-Driven Verification —. In: Piterman, N. (eds) Hardware and Software: Verification and Testing. HVC 2015. Lecture Notes in Computer Science(), vol 9434. Springer, Cham. https://doi.org/10.1007/978-3-319-26287-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26287-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26286-4

  • Online ISBN: 978-3-319-26287-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation