Abstract
We introduce a multi-objective formulation of service-oriented testing, focusing on the balance between service price and reliability. We experimented with NSGA-II for this problem, investigating the effect on performance and quality of composition size, topology and the number of services discovered. For topologies small enough for exhaustive search we found that NSGA-II finds a pareto front very near (the fronts are a Euclidean distance of ~0.00024 price-reliability points apart) the true pareto front. Regarding performance, we find that composition size has the strongest effect, with smaller topologies consuming more machine time; a curious effect we believe is due to the influence of crowding distance. Regarding result quality, our results reveal that size and topology have more effect on the front found than the number of service choices discovered. As expected the price-reliability relationship (logarithmic, linear, exponential) is replicated in the front discovered when correlation is high, but as the price-reliability correlation decreases, we find fewer solutions on the front and the front becomes less smooth.
Keywords
- Execution Time
- Pareto Front
- Service Composition
- Composition Size
- Service Group
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Alshahwan, N., Harman, M.: Automated session data repair for web application regression testing. In: ICST 2008, pp. 298–307. IEEE, Lillehammer (2008)
Blanco, R., García-Fanjul, J., Tuya, J.: A first approach to test case generation for BPEL compositions of web services using scatter search. In: ICSTW 2009, pp. 131–140. IEEE, Denver (2009)
Bozkurt, M., Harman, M.: Automatically generating realistic test input from web services. In: SOSE 2011, pp. 13–24. IEEE, Irvine (2011)
Bozkurt, M., Harman, M.: Optimised realistic test input generation. Presented at the SSBSE 2011 (September 2011), http://www.ssbse.org/2011/fastabstracts/bozkurt.pdf
Bozkurt, M., Harman, M., Hassoun, Y.: Testing & verification in service-oriented architecture: A survey. STVR (to appear)
CBDI Forum, http://everware-cbdi.com/cbdi-forum
Conroy, K., Grechanik, M., Hellige, M., Liongosari, E., Xie, Q.: Automatic test generation from GUI applications for testing web services. In: ICSM 2007, pp. 345–354. IEEE, Paris (2007)
Di Penta, M., Canfora, G., Esposito, G., Mazza, V., Bruno, M.: Search-based testing of service level agreements. In: GECCO 2007, pp. 1090–1097. ACM, London (2007)
Elbaum, S., Rothermel, G., Karre, S., Fisher II, M.: Leveraging user-session data to support web application testing. IEEE Transactions on Software Engineering 31(3), 187–202 (2005)
Harman, M.: The current state and future of search based software engineering. In: Briand, L., Wolf, A. (eds.) FOSE 2007, Los Alamitos, CA, USA, pp. 342–357 (2007)
Lakhotia, K., Harman, M., McMinn, P.: A multi-objective approach to search-based test data generation. In: GECCO 2007, pp. 1098–1105. ACM, London (2007)
Luo, X., Ping, F., Chen, M.H.: Clustering and tailoring user session data for testing web applications. In: ICST 2009, pp. 336–345. IEEE, Denver (2009)
McMinn, P., Shahbaz, M., Stevenson, M.: Search-based test input generation for string data types using the results of web queries. In: ICST 2012, pp. 141–150. IEEE, Montreal (2012)
McMinn, P., Stevenson, M., Harman, M.: Reducing qualitative human oracle costs associated with automatically generated test data. In: STOV 2010, pp. 1–4. ACM, Trento (2010)
OASIS: SOA-EERP business quality of service (bQoS) (September 2009), http://docs.oasis-open.org/ns/soa-eerp/bqos/200903
Oster, N., Saglietti, F.: Automatic Test Data Generation by Multi-objective Optimisation. In: Górski, J. (ed.) SAFECOMP 2006. LNCS, vol. 4166, pp. 426–438. Springer, Heidelberg (2006)
Pinto, G.H.L., Vergilio, S.R.: A multi-objective genetic algorithm to test data generation. In: ICTAI 2010, vol. 1, pp. 129–134. IEEE, Arras (2010)
Remote Methods, http://www.remotemethods.com/
Sagarna, R., Yao, X.: Handling constraints for search based software test data generation. In: ICST 2008, pp. 232–240. IEEE, Lillehammer (2008)
Wan Ab. Rahman, W., Meziane, F.: Challenges to describe QoS requirements for web services quality prediction to support web services interoperability in electronic commerce. In: IBIMA 2008, vol. 4, pp. 50–58. International Business Information Management Association (IBIMA), Kuala Lumpur (2008)
Yoo, S., Harman, M.: Pareto efficient multi-objective test case selection. In: ISSTA 2007, pp. 140–150. ACM, London (2007)
Zhang, Y., Harman, M., Mansouri, S.A.: The multi-objective next release problem. In: GECCO 2007, London, UK, pp. 1129–1137 (July 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bozkurt, M., Harman, M. (2012). Optimised Realistic Test Input Generation Using Web Services. In: Fraser, G., Teixeira de Souza, J. (eds) Search Based Software Engineering. SSBSE 2012. Lecture Notes in Computer Science, vol 7515. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33119-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-33119-0_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33118-3
Online ISBN: 978-3-642-33119-0
eBook Packages: Computer ScienceComputer Science (R0)
