Abstract
Applications for task definition and automation are valuable tools to automated software engineering area. This paper describes a solution to support a parameterized task definition using screen capture images. The approach allows the capture of a sequence of actions defined by the user. Through the captured sequence of actions, the approach assists in the implementation of task automation processes.
Based on picture-driven computing the proposed tool aims to reduce the challenges that users face while trying to define tasks. This approach provides also a foundation for the creation of picture-driven based tests for interactive systems, enabling to test any interactive system but also allowing for the definition, parameterization and execution of tests that might involve the use of several independent interactive systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
https://msdn.microsoft.com/en-us/library/system.drawing.graphics(v=vs.110).aspx (last accessed: 5 December 2016).
References
Ammann, P., Offutt, J.: Introduction to Software Testing, 1st edn. Cambridge University Press, New York (2008)
Automa tool, automate repetitive tasks in the graphical user interface. http://www.getautoma.com/. Accessed 12 Apr 2016
Barbosa, A., Paiva, A.C., Campos, J.C.: Test case generation from mutated task models. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2011, pp. 175–184. ACM, New York (2011)
Bolton, M.L., Bass, E.J., Siminiceanu, R.I.: Generating phenotypical erroneous human behavior to evaluate human-automation interaction using model checking. Int. J. Hum. Comput. Stud. 70(11), 888–906 (2012)
Chang, T.-H., Yeh, T., Miller, R.C.: GUI testing using computer vision. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2010, pp. 1535–1544. ACM, New York (2010)
David, B.: Selenium 2 Testing Tools: Beginner’s Guide. Packt Publishing, Birmingham (2012)
de Kleijn, R., Selenium, L.: Hands-on tutorials to create a robust and maintainable test automation framework. Leanpub (2014)
Eggplant tool, functional tests automation. http://www.testplant.com/eggplant/. Accessed 12 Apr 2016
Li, Y.F., Das, P.K., Dowe, D.L.: Two decades of web application testing a survey of recent advances. Inf. Syst. 43, 20–54 (2014)
Giannakopoulou, D., Rungta, N., Feary, M.: Automated test case generation for an autopilot requirement prototype. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC) (2011)
Godefroid, P., Klarlund, N., Sen, K.: DART: directed automated random testing. ACM SIGPLAN Not. 40(6), 213–223 (2005)
Martinie, C., Palanque, P.A., Barboni, E., Ragosta, M.: Task-model based assessment of automation levels: application to space ground segments. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Anchorage, Alaska, USA, pp. 3267–3273, 9–12 October 2011
Pangoli, S., Paternó, F.: Automatic generation of task-oriented help. In: Proceedings of the 8th Annual ACM Symposium on User Interface and Software Technology, UIST 1995, pp. 181–187. ACM, New York (1995)
Parasuraman, R., Sheridan, T.B., Wickens, C.D.: A model for types and levels of human interaction with automation. Trans. Sys. Man Cybern. Part A 30(3), 286–297 (2000)
RiaTest tool, automate testing of web applications. http://www.cogitek.com/riatest.html. Accessed 12 Apr 2016
Silva, J.C., Saraiva, J., Campos, J.: A generic library for GUI reasoning and testing. In: Proceedings of the ACM Symposium on Applied Computing, SAC 2009, pp. 121–128. ACM (2009)
Silva, J.C., Silva, J.L.: A methodology for GUI layer redefinition through virtualization and computer vision. In: 2014 14th International Conference on Computational Science and Its Applications (ICCSA), pp. 58–63. IEEE (2014)
Silva, J.L., Campos, J.C., Paiva, A.C.R.: Model-based user interface testing with Spec Explorer and ConcurTaskTrees. Electron. Notes Theor. Comput. Sci. 208, 77–93 (2008). Elsevier, Amsterdam
Silva, J.L., Ornelas, J.D., Silva, J.C.: Make it ISI: interactive systems integration tool. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 245–250. ACM (2016)
Silva, J.L., Ornelas, J.D., Silva, J.C.: Supporting GUI exploration through USS tool. J. Inf. Syst. Eng. Manage. 1, 1–15 (2016). doi:10.20897/lectito.201651. ISSN 2468-4376
Yeh, T., Chang, T.-H., Miller, R.C.: Sikuli: using GUI screenshots for search and automation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, UIST 2009, pp. 183–192. ACM, New York (2009)
Acknowledgments
José Luís Silva acknowledges support from Fundação para a Ciência e a Tecnologia (FCT, Portugal), through project UID/EEA/50009/2013.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Machado, V., Lopes, N., Silva, J.C., Luís Silva, J. (2017). Picture-Based Task Definition and Parameterization Support System. In: Rocha, Á., Correia, A., Adeli, H., Reis, L., Costanzo, S. (eds) Recent Advances in Information Systems and Technologies. WorldCIST 2017. Advances in Intelligent Systems and Computing, vol 570. Springer, Cham. https://doi.org/10.1007/978-3-319-56538-5_60
Download citation
DOI: https://doi.org/10.1007/978-3-319-56538-5_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-56537-8
Online ISBN: 978-3-319-56538-5
eBook Packages: EngineeringEngineering (R0)