Testing of Smart TV Applications: Key Ingredients, Challenges and Proposed Solutions

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 880)


Smart TV applications are software applications that have been designed to run on smart TVs which are televisions with integrated Internet features. Nowadays, the smart TVs are going to dominate the television market, and the number of connected TVs is growing exponentially. This growth is accompanied by the increase of consumers and the use of smart TV applications that drive these devices. Due to the increasing demand for smart TV applications especially with the rise of the Internet of Things (IoT) services, it is essential to building an application with a certain level of quality. Despite the analogy between the smart TV and mobile apps, testing smart TV applications is different in many aspects due to the different nature of user interaction and development environment. To develop the field and formulate the concepts of smart TV application testing, this paper aims to provide the essential ingredients, solutions, answers to the most critical questions, and open problems. In addition, we offer initial results and proof of concepts for a creeper algorithm to detect essential views of the applications. This paper serves as an effort to report the key ingredients and challenges of the smart TV application testing systematically to the research community.


Smart tv application testing Software testing Model-based testing Internet of Things (IoT) 



This research is conducted as a part of the project TACR TH02010296 Quality Assurance System for Internet of Things Technology.


  1. 1.
    Jung, K.S.: The prospect of Smart TV service. Inf. Commun. Mag. 28(3), 3–7 (2011)Google Scholar
  2. 2.
    Zein, S., Salleh, N., Grundy, J.: A systematic mapping study of mobile application testing techniques. J. Syst. Softw. 117(C), 334–356 (2016)CrossRefGoogle Scholar
  3. 3.
    Sahinoglu, M., Incki, K., Aktas, M.S.: Mobile application verification: a systematic mapping study, pp. 147–163. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  4. 4.
    Amalfitano, D., Fasolino, A.R., Tramontana, P., Robbins, B.: Chapter 1 - testing android mobile applications: challenges, strategies, and approaches. In: Advances in Computers, vol. 89, pp. 1–52. Elsevier (2013)Google Scholar
  5. 5.
    Banerjee, I., Nguyen, B., Garousi, V., Memon, A.: Graphical user interface (GUI) testing: systematic mapping and repository. Inf. Softw. Technol. 55(10), 1679–1694 (2013)CrossRefGoogle Scholar
  6. 6.
    Li, Y.-F., Das, P.K., Dowe, D.L.: Two decades of web application testing-a survey of recent advances. Infor. Syst. 43(C), 20–54 (2014)CrossRefGoogle Scholar
  7. 7.
    Amalfitano, D., Fasolino, A.R., Tramontana, P., Ta, B.D., Memon, A.M.: Mobiguitar: automated model-based testing of mobile apps. IEEE Softw. 32(5), 53–59 (2015)CrossRefGoogle Scholar
  8. 8.
    Nguyen, B.N., Robbins, B., Banerjee, I., Memon, A.: Guitar: an innovative tool for automated testing of GUI-driven software. Autom. Softw. Eng. 21(1), 65–105 (2014)CrossRefGoogle Scholar
  9. 9.
    Cui, K., Zhou, K., Song, H., Li, M.: Automated software testing based on hierarchical state transition matrix for Smart TV. IEEE Access 5, 6492–6501 (2017)CrossRefGoogle Scholar
  10. 10.
    Ingrosso, A., Volpi, V., Opromolla, A., Sciarretta, E., Medaglia, C.M.: UX and usability on Smart TV: a case study on a T-commerce application, pp. 312–323. Springer, Cham (2015)Google Scholar
  11. 11.
    Sabina, K.C.: Defining a testing platform for Smart TV applications. Bachelor thesis, Helsinki Metropolia University of Applied Sciences, January 2016Google Scholar
  12. 12.
    Bluttman, K., Cottrell, L.M.: UX and usability on Smart TV: a case study on a T-commerce application. McGraw Hill Professional, Cham (2012)Google Scholar
  13. 13.
    Murgrabia, M.: Design considerations for Vewd app store applications (2017). Accessed 5 Dec 2017Google Scholar
  14. 14.
    Deng, L., Offutt, J., Ammann, P., Mirzaei, N.: Mutation operators for testing android apps. Inf. Softw. Technol. 81(C), 154–168 (2017)CrossRefGoogle Scholar
  15. 15.
    Moran, K., Tufano, M., Bernal-Cardenas, C., Linares-Vasquez, M., Bavota, G., Vendome, C., Di Penta, M., Poshyvanyk, D.: Mdroid+: a mutation testing framework for android. In: 40th International Conference on Software Engineering (ICSE) (2018)Google Scholar
  16. 16.
    Ma, Y.-S., Offutt, J., Kwon, Y.R.: MuJava: an automated class mutation system: research articles. Softw. Test. Verif. Reliab. 15(2), 97–133 (2005)CrossRefGoogle Scholar
  17. 17.
    Barr, E.T., Harman, M., McMinn, P., Shahbaz, M., Yoo, S.: The oracle problem in software testing: a survey. IEEE Trans. Softw. Eng. 41(5), 507–525 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Computer Science, Faculty of Electrical EngineeringCzech Technical UniversityPraha 2Czech Republic

Personalised recommendations