World Wide Web

, Volume 17, Issue 5, pp 921–947 | Cite as

Efficient execution of web navigation sequences

  • José LosadaEmail author
  • Juan Raposo
  • Alberto Pan
  • Paula Montoto


Web automation applications are widely used for different purposes such as B2B integration and automated testing of web applications. Most current systems build the automatic web navigation component by using the APIs of conventional browsers. While this approach has its advantages, it suffers performance problems for intensive web automation tasks which require real time responses and/or a high degree of parallelism. In this paper, we outline a set of techniques to build a web navigation component able to efficiently execute web navigation sequences. These techniques detect what elements and scripts of the pages accessed during the navigation sequence are needed for the correct execution of the sequence (and, therefore, must be loaded and executed), and what parts of the pages can be discarded. The tests executed with real web sources show that the optimized navigation sequences run significantly faster and consume significantly less resources.


Web automation Navigation sequence Optimization Efficient execution 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alexa: The Web Information Company
  2. 2.
    Anupam, V., Freire, J., Kumar, B., Lieuwen, D.: Automating web navigation with the WebVCR. Comput. Netw. 33(1–6), 503–517 (2000)CrossRefGoogle Scholar
  3. 3.
    Davulcu H., Yang G., Kifer M., Ramakrishnan I.V.: Computational Aspects of Resilient Data Extraction from Semistructured Sources, ACM Symposium on Principles of Database Systems (PODS), pp. 136–144 (2000)Google Scholar
  4. 4.
    Document Object Model (DOM):
  5. 5.
  6. 6.
    Hupp D., Miller R.C.: Smart Bookmarks: automatic retroactive macro recording on the web. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, pp. 81–90. ACM New York, Newport (2007)Google Scholar
  7. 7.
  8. 8.
  9. 9.
    Lingam S., Elbaum S.: Supporting End-Users in the Creation of Dependable Web Clips. WWW 2007, 953–962Google Scholar
  10. 10.
    Losada J., Raposo J., Pan A., Montoto P.: Efficient execution of web navigation sequences. In: The 14th International Conference on Web Information System Engineering (WISE), pp. 340–353 (2012)Google Scholar
  11. 11.
    Montoto, P., Pan, A., Raposo, J., Bellas, F., López, J.: Automated browsing in AJAX websites. Data Knowl. Eng. 70(3), 269–283 (2011)CrossRefGoogle Scholar
  12. 12.
    Pan A., Raposo J., Álvarez M., Hidalgo J., Viña A.: Semi automatic wrapper-generation for commercial web sources. In: IFIP WG8.1 Working Conference on Engineering Information Systems in the Internet Context, pp. 265–283. Kluwer, B.V. Deventer, Japan (2002)Google Scholar
  13. 13.
  14. 14.
    Safonov A., Konstan J., Carlis J.: Beyond hard-to-reach pages: interactive, parametric web macros. In: 7th Conference on Human Factors & the Web. Madison 2001Google Scholar
  15. 15.
  16. 16.
  17. 17.
    XML Path Language (XPath):

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • José Losada
    • 1
    Email author
  • Juan Raposo
    • 1
  • Alberto Pan
    • 1
  • Paula Montoto
    • 1
  1. 1.Information and Communications Technology Department, Facultad de InformáticaUniversity of A CoruñaA CoruñaSpain

Personalised recommendations