Matching Context Aware Software Testing Design Techniques to ISO/IEC/IEEE 29119

  • Santiago MatalongaEmail author
  • Felyppe Rodrigues
  • Guilherme H. Travassos
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 526)


A software system is context aware when it uses contextual information to help actors (users or other systems) to achieve their tasks. Testing this type of software can be a challenge since context and its variabilities cannot be controlled by the software tester. The ISO/IEC/IEEE 29119 intended to cover testing of any software system. It provides a common language and process for testing software systems, including a categorization of conventional testing techniques. This paper contains the initial results of our ongoing efforts to understand the testing of context aware software, Specifically, we evaluate whether the observed techniques for testing context aware software can be matched against the ISO/IEC/IEEE 29119 categories or if they represent a new breed of testing techniques. The results indicate that using conventional techniques variations to test context aware software systems does not produce evidence on their feasibility to test the context awareness features in such systems.


Context awareness Testing ISO 29119:2013 Systematic literature review 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Software and systems engineering Software testing Part 1:Concepts and definitions. ISO/IEC/IEEE 29119-1:2013. 1–64 (2013)Google Scholar
  2. 2.
    Malik, N., Mahmud, U., Javed, Y.: Future challenges in context-aware computing. In: Proc. IADIS Int. Conf. 306–310 (2007)Google Scholar
  3. 3.
    Rodrigues, F., Matalonga, S., Travassos, G.H.: Systematic literature review protocol: Investigating context aware software testing strategies.Rio de Janeiro (2014)
  4. 4.
    Travassos, G.H., Santos, P.S.M. dos, Mian, P.G., Neto, A.C.D., Biolchini, J.: An Environment to Support Large Scale Experimentation in Software Engineering. In: 13th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 2008), pp. 193–202. IEEE (2008)Google Scholar
  5. 5.
    Pai, M., Mcculloch, M., Gorman, J.D., Pai, N., Enanoria, W., Kennedy, G., Tharyan, P., Colford Jr, J.M., Colford, J.M.: Systematic reviews and meta-analyses: an illustrated, step-by-step guide. Natl. Med. J. India 17, 86–95 (2004)Google Scholar
  6. 6.
    Alsos, O.A., Dahl, Y.: Toward a best practice for laboratory-based usability evaluations of mobile ICT for hospitals. In: Proc. 5th Nord. Conf. Human-computer Interact. Build. Bridg. – Nord, 3 (2008)Google Scholar
  7. 7.
    Amalfitano, D., Fasolino, A.R., Tramontana, P., Amatucci, N.: Considering Context Events in Event-Based Testing of Mobile Applications. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops, pp. 126–133 (2013)Google Scholar
  8. 8.
    Jiang, B., Long, X., Gao, X.: MobileTest: A tool supporting automatic black box test for software on smart mobile devices. In: Proceedings of the International Conference on Software Engineering (2007)Google Scholar
  9. 9.
    Canfora, G., Mercaldo, F., Visaggio, C.A., D’Angelo, M., Furno, A., Manganelli, C.: A case study of automating user experience-oriented performance testing on smartphones. In: Proceedings of the IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013. pp. 66–69 (2013)Google Scholar
  10. 10.
    Lu, H., Chan, W.K., Tse, T.H.: Testing context-aware middleware-centric programs. In: Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering, SIGSOFT 2006/FSE-14. p. 242. ACM Press, New York (2006)Google Scholar
  11. 11.
    Merdes, M., Malaka, R., Suliman, D., Paech, B., Brenner, D., Atkinson, C.: Ubiquitous RATs: How Resource-Aware Run-Time Tests Can Improve Ubiquitous Software System. In: 6th International Workshop on Software Engineering and Middleware, SEM 2006, pp. 55–62 (2006)Google Scholar
  12. 12.
    Ryan, C., Gonsalves, A.: The effect of context and application type on mobile usability: An empirical study. In: Conferences in Research and Practice in Information Technology Series, pp. 115–124 (2005)Google Scholar
  13. 13.
    Satoh, I.: Software testing for mobile and ubiquitous computing. In: The Sixth International Symposium on Autonomous Decentralized Systems, ISADS 2003 (2003)Google Scholar
  14. 14.
    She, S., Sivapalan, S., Warren, I.: Hermes: A tool for testing mobile device applications. In: Proceedings of the Australian Software Engineering Conference, ASWEC, pp. 121–130 (2009)Google Scholar
  15. 15.
    Tse, T.H., Yau, S.S.: Testing context-sensitive middleware-based software applications. In: Proceedings of the 28th Annual International Computer Software and Applications Conference, COMPSAC 2004, pp. 458–466. IEEE (2004)Google Scholar
  16. 16.
    Wang, H., Chan, W.K.: Weaving Context Sensitivity into Test Suite Construction. In: 2009 IEEE/ACM International Conference on Automated Software Engineering, pp. 610–614. IEEE, Auckland (2009)Google Scholar
  17. 17.
    Software and systems engineering Software testing Part 2:Test processes. ISO/IEC/IEEE 29119-3:2013(E). 1–138 (2013)Google Scholar
  18. 18.
    IEEE Draft International Standard for Software and Systems Engineering–Software Testing–Part 4: Test Techniques. ISO/IEC/IEEE P29119-4-DISMay2013. 1–132 (2014)Google Scholar
  19. 19.
    Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. ISO/IEC 25010:2011. 1–34 (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Santiago Matalonga
    • 1
    Email author
  • Felyppe Rodrigues
    • 2
  • Guilherme H. Travassos
    • 2
  1. 1.Universidad ORT UruguayMontevideoUruguay
  2. 2.Programa de Engenharia de Sistemas e ComputaçãoUniversidade Federal do Rio de JaneiroRio de JaneiroBrazil

Personalised recommendations