Skip to main content

Optimised Realistic Test Input Generation Using Web Services

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNPSE,volume 7515)

Abstract

We introduce a multi-objective formulation of service-oriented testing, focusing on the balance between service price and reliability. We experimented with NSGA-II for this problem, investigating the effect on performance and quality of composition size, topology and the number of services discovered. For topologies small enough for exhaustive search we found that NSGA-II finds a pareto front very near (the fronts are a Euclidean distance of ~0.00024 price-reliability points apart) the true pareto front. Regarding performance, we find that composition size has the strongest effect, with smaller topologies consuming more machine time; a curious effect we believe is due to the influence of crowding distance. Regarding result quality, our results reveal that size and topology have more effect on the front found than the number of service choices discovered. As expected the price-reliability relationship (logarithmic, linear, exponential) is replicated in the front discovered when correlation is high, but as the price-reliability correlation decreases, we find fewer solutions on the front and the front becomes less smooth.

Keywords

  • Execution Time
  • Pareto Front
  • Service Composition
  • Composition Size
  • Service Group

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alshahwan, N., Harman, M.: Automated session data repair for web application regression testing. In: ICST 2008, pp. 298–307. IEEE, Lillehammer (2008)

    Google Scholar 

  2. Blanco, R., García-Fanjul, J., Tuya, J.: A first approach to test case generation for BPEL compositions of web services using scatter search. In: ICSTW 2009, pp. 131–140. IEEE, Denver (2009)

    Google Scholar 

  3. Bozkurt, M., Harman, M.: Automatically generating realistic test input from web services. In: SOSE 2011, pp. 13–24. IEEE, Irvine (2011)

    Google Scholar 

  4. Bozkurt, M., Harman, M.: Optimised realistic test input generation. Presented at the SSBSE 2011 (September 2011), http://www.ssbse.org/2011/fastabstracts/bozkurt.pdf

  5. Bozkurt, M., Harman, M., Hassoun, Y.: Testing & verification in service-oriented architecture: A survey. STVR (to appear)

    Google Scholar 

  6. CBDI Forum, http://everware-cbdi.com/cbdi-forum

  7. Conroy, K., Grechanik, M., Hellige, M., Liongosari, E., Xie, Q.: Automatic test generation from GUI applications for testing web services. In: ICSM 2007, pp. 345–354. IEEE, Paris (2007)

    Google Scholar 

  8. Di Penta, M., Canfora, G., Esposito, G., Mazza, V., Bruno, M.: Search-based testing of service level agreements. In: GECCO 2007, pp. 1090–1097. ACM, London (2007)

    CrossRef  Google Scholar 

  9. ECJ 20, http://cs.gmu.edu/~eclab/projects/ecj/

  10. Elbaum, S., Rothermel, G., Karre, S., Fisher II, M.: Leveraging user-session data to support web application testing. IEEE Transactions on Software Engineering 31(3), 187–202 (2005)

    CrossRef  Google Scholar 

  11. Harman, M.: The current state and future of search based software engineering. In: Briand, L., Wolf, A. (eds.) FOSE 2007, Los Alamitos, CA, USA, pp. 342–357 (2007)

    Google Scholar 

  12. Lakhotia, K., Harman, M., McMinn, P.: A multi-objective approach to search-based test data generation. In: GECCO 2007, pp. 1098–1105. ACM, London (2007)

    CrossRef  Google Scholar 

  13. Luo, X., Ping, F., Chen, M.H.: Clustering and tailoring user session data for testing web applications. In: ICST 2009, pp. 336–345. IEEE, Denver (2009)

    Google Scholar 

  14. McMinn, P., Shahbaz, M., Stevenson, M.: Search-based test input generation for string data types using the results of web queries. In: ICST 2012, pp. 141–150. IEEE, Montreal (2012)

    Google Scholar 

  15. McMinn, P., Stevenson, M., Harman, M.: Reducing qualitative human oracle costs associated with automatically generated test data. In: STOV 2010, pp. 1–4. ACM, Trento (2010)

    Google Scholar 

  16. OASIS: SOA-EERP business quality of service (bQoS) (September 2009), http://docs.oasis-open.org/ns/soa-eerp/bqos/200903

  17. Oster, N., Saglietti, F.: Automatic Test Data Generation by Multi-objective Optimisation. In: Górski, J. (ed.) SAFECOMP 2006. LNCS, vol. 4166, pp. 426–438. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  18. Pinto, G.H.L., Vergilio, S.R.: A multi-objective genetic algorithm to test data generation. In: ICTAI 2010, vol. 1, pp. 129–134. IEEE, Arras (2010)

    Google Scholar 

  19. Remote Methods, http://www.remotemethods.com/

  20. Sagarna, R., Yao, X.: Handling constraints for search based software test data generation. In: ICST 2008, pp. 232–240. IEEE, Lillehammer (2008)

    Google Scholar 

  21. Wan Ab. Rahman, W., Meziane, F.: Challenges to describe QoS requirements for web services quality prediction to support web services interoperability in electronic commerce. In: IBIMA 2008, vol. 4, pp. 50–58. International Business Information Management Association (IBIMA), Kuala Lumpur (2008)

    Google Scholar 

  22. Yoo, S., Harman, M.: Pareto efficient multi-objective test case selection. In: ISSTA 2007, pp. 140–150. ACM, London (2007)

    CrossRef  Google Scholar 

  23. Zhang, Y., Harman, M., Mansouri, S.A.: The multi-objective next release problem. In: GECCO 2007, London, UK, pp. 1129–1137 (July 2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bozkurt, M., Harman, M. (2012). Optimised Realistic Test Input Generation Using Web Services. In: Fraser, G., Teixeira de Souza, J. (eds) Search Based Software Engineering. SSBSE 2012. Lecture Notes in Computer Science, vol 7515. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33119-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33119-0_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33118-3

  • Online ISBN: 978-3-642-33119-0

  • eBook Packages: Computer ScienceComputer Science (R0)