Abstract
Defining cost-effective verification and validation tools is one of the biggest research challenges of the area. Such tools speedup and reduce the cost of the assessment of Off-The-Shelf (OTS) software components that must undergo proper certification or approval processes to be used in critical scenarios. Previously we introduced the design of framework for testing of critical OTS applications and services, to improve reusability, thus aiming to reduce testing time and costs. In this paper we present an implementation of the framework that allows applying, in a cost-effective fashion, functional testing, robustness testing and penetration testing to web services. We present details on the implementation and we describe the procedure to use the framework to conduct testing campaigns in web services. Finally, the framework usability and utility is demonstrated based on a case study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Antunes, N., et al.: A monitoring and testing framework for critical off-the-shelf applications and services. In: 2013 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), pp. 371–374 (2013)
Antunes, N., Vieira, M.: Detecting SQL Injection Vulnerabilities in Web Services. In: Fourth Latin-American Symposium on Dependable Computing 2009 (LADC 2009), pp. 17–24. IEEE Computer Society, Joao Pessoa (2009)
Ceccarelli, A., et al.: A Testbed for Evaluating Anomaly Detection Monitors Through Fault Injection. In: 5th IEEE Workshop on Self-Organizing Real-Time Systems (SORT 2014), Reno, Nevada, USA (2014)
IEC 61508 TC: IEC 61508, Functional Safety of Electrical/Electronic/Programmable Elec-tronic (E/E/PE) Safety Related Systems, Part 3: Software Requirements. IEC, Geneva, Swiss (1998)
IEEE Computer Society. Software & Systems Engineering Standards Committee: 1012-2012 - IEEE Standard for System and Software Verification and Validation. IEEE Computer Society (2012)
ISO 26262: Road vehicles - Functional safety - Part 6: Product development at the software level (2011)
Koopman, P., DeVale, J.: Comparing the robustness of POSIX operating systems. In: Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing. Digest of Papers, pp. 30–37 (1999)
Laranjeiro, N., et al.: Improving Web Services Robustness. In: IEEE 7th International Conference on Web Services (ICWS 2009), Los Angeles, CA, USA, pp. 397–404 (2009)
Laranjeiro, N., et al.: Wsrbench: An On-Line Tool for Robustness Benchmarking. In: IEEE International Conference on Services Computing, SCC 2008, pp. 187–194 (2008)
Liferay, Inc.: Liferay Portal, http://www.liferay.com/
Prasad, V., et al.: Locating system problems using dynamic instrumentation. In: 2005 Ottawa Linux Symposium, pp. 49–64 (2005)
Tran, E.: Verification/Validation/Certification. In: Koopman, P. (ed.) Topics in Dependable Embedded Systems. Carnegie Mellon University (1999)
Vieira, M., et al.: Benchmarking the Robustness of Web Services. In: 13th Pacific Rim International Symposium on Dependable Computing, PRDC 2007, pp. 322–329 (2007)
RTCA DO-178C/EUROCAE ED-12C - Software Considerations in Airborne Systems and Equipment Certification (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Duchi, F., Antunes, N., Ceccarelli, A., Vella, G., Rossi, F., Bondavalli, A. (2014). Cost-Effective Testing for Critical Off-the-Shelf Services. In: Bondavalli, A., Ceccarelli, A., Ortmeier, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2014. Lecture Notes in Computer Science, vol 8696. Springer, Cham. https://doi.org/10.1007/978-3-319-10557-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-10557-4_26
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10556-7
Online ISBN: 978-3-319-10557-4
eBook Packages: Computer ScienceComputer Science (R0)