Overcoming Non-determinism in Testing Smart Devices: A Case Study

  • Peter Bishop
  • Lukasz Cyra
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6351)


This paper presents a case study in ”black-box” assessment of a ”smart” device where, based only on the user manuals and the instrument itself, we try to build confidence in smart device reliability. To perform the black-box assessment, we developed a test environment which automates the generation of test data, their execution and interpretation of the results. The assessment was made more complex by the inherent non-determinism of the device. For example, non-determinism can arise due to inaccuracy in an analogue measurement made by the device when two alternative actions are possible depending on the measured value. This non-determinism makes it difficult to predict the output values that are expected from a test sequence of analogue input values. The paper presents two approaches to dealing with this difficulty: (1) based on avoidance of test values that could have multiple responses, (2) based on consideration of all possible interpretations of input data. To support the second approach we use advanced modelling and simulation techniques to predict all the likely interpretations and check whether any of them is observed at the smart device output.


testing non-determinism smart instruments safety 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bishop, P., Bloomfield, R., Guerra, S., Tourlas, K.: Justification of Smart Sensors for Nuclear Applications. In: Winther, R., Gran, B.A., Dahll, G. (eds.) SAFECOMP 2005. LNCS, vol. 3688, pp. 194–207. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  2. 2.
    Alur, R., Henzinger, T.: A Really Temporal Logic. Journal of the ACM (JACM) 41(1), 181–203 (1994)MATHCrossRefMathSciNetGoogle Scholar
  3. 3.
    National Instruments, LabVIEW, http://www.ni.com/labview (visited on 24/02/2010)
  4. 4.
    Krichen, M., Tripakis, S.: Black-Box Conformance Testing for Real-Time Systems. In: Graf, S., Mounier, L. (eds.) SPIN 2004. LNCS, vol. 2989, pp. 109–126. Springer, Heidelberg (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Peter Bishop
    • 1
    • 2
  • Lukasz Cyra
    • 2
  1. 1.Centre for Software ReliabilityCity UniversityLondonUnited Kingdom
  2. 2.Adelard LLPLondonUnited Kingdom

Personalised recommendations