AWAIT: Efficient Overload Management for Busy Multi-tier Web Services under Bursty Workloads

  • Lei Lu
  • Ludmila Cherkasova
  • Vittoria de Nitto Personè
  • Ningfang Mi
  • Evgenia Smirni
Conference paper

DOI: 10.1007/978-3-642-13911-6_6

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6189)
Cite this paper as:
Lu L., Cherkasova L., de Nitto Personè V., Mi N., Smirni E. (2010) AWAIT: Efficient Overload Management for Busy Multi-tier Web Services under Bursty Workloads. In: Benatallah B., Casati F., Kappel G., Rossi G. (eds) Web Engineering. ICWE 2010. Lecture Notes in Computer Science, vol 6189. Springer, Berlin, Heidelberg

Abstract

The problem of service differentiation and admission control in web services that utilize a multi-tier architecture is more challenging than in a single-tiered one, especially in the presence of bursty conditions, i.e., when arrivals of user web sessions to the system are characterized by temporal surges in their arrival intensities and demands. We demonstrate that classic techniques for a session based admission control that are triggered by threshold violations are ineffective under bursty workload conditions, as user-perceived performance metrics rapidly and dramatically deteriorate, inadvertently leading the system to reject requests from already accepted user sessions, resulting in business loss. Here, as a solution for service differentiation of accepted user sessions we promote a methodology that is based on blocking, i.e., when the system operates in overload, requests from accepted sessions are not rejected but are instead stored in a blocking queue that effectively acts as a waiting room. The requests in the blocking queue implicitly become of higher priority and are served immediately after load subsides. Residence in the blocking queue comes with a performance cost as blocking time adds to the perceived end-to-end user response time. We present a novel autonomic session based admission control policy, called AWAIT, that adaptively adjusts the capacity of the blocking queue as a function of workload burstiness in order to meet predefined user service level objectives while keeping the portion of aborted accepted sessions to a minimum. Detailed simulations illustrate the effectiveness of AWAIT under different workload burstiness profiles and therefore strongly argue for its effectiveness.

Download to read the full conference paper text

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Lei Lu
    • 1
  • Ludmila Cherkasova
    • 2
  • Vittoria de Nitto Personè
    • 3
  • Ningfang Mi
    • 4
  • Evgenia Smirni
    • 1
  1. 1.College of William and MaryWilliamsburgUSA
  2. 2.Hewlett-Packard LaboratoriesPalo AltoUSA
  3. 3.Universitá degli Studi di Roma “Tor Vergata”RomeItaly
  4. 4.Electrical and Computer EngineeringNortheastern UniversityBoston

Personalised recommendations