Skip to main content

An Application of Markov Decision Processes to the Seat Inventory Control Problem

  • Chapter
Perspectives on Operations Research

Abstract

Airlines typically divide a pool of identical seats into several booking classes that represent e.g. different discount levels with differentiated sale conditions and restrictions. Assuming perfect market segmentation, mixing discount and higher-fare passengers in the same aircraft compartment offers the airline the potential of gaining revenue from seats that would otherwise fly empty. If too many seats are sold at a discount price, however, the airline company would loose full-fare passengers. If too many seats are protected for higher-fare demand, the flight would depart with vacant seats. Seat inventory control deals with the optimal allocation of capacity to these different classes of demand, forming a substantial part of a revenue management system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Aviv Y, Pazgal A (2005) A partially observed Markov decision process for dynamic pricing. Management Science 49(9):1400–1416

    Article  Google Scholar 

  2. Belobaba PP (1987) Airline yield management. Transportation Science 21(2):63–73

    Google Scholar 

  3. Belobaba PP (1989) Application of a probabilistic decision model to airline seat inventory control. Operations Research 37(2):183–197

    Google Scholar 

  4. Brumelle SL, McGill JI (1993) Airline seat allocation with multiple nested fare classes. Operations Research 41(1):127–137

    Google Scholar 

  5. Brumelle SL, McGill JI, Oum TH, Sawaki K, Thretheway MW (1990) Allocation of airline seat between stochastically dependent demands. Transportation Science 24(3):183–192

    Google Scholar 

  6. Brumelle SL, Walczak D (2003) Dynamic airline revenue management with multiple semi-Markov demand. Operations Research 51(1):137–148

    Article  Google Scholar 

  7. Curry RE (1990) Optimal airline seat allocation with fare classes nested by origins and destinations. Transportation Science 24(3):193–204

    Google Scholar 

  8. Helm WE, Waldmann KH (1984) Optimal control of arrivals to multi-server queues in a random environment. Journal of Applied Probability 21(3):602–615

    Article  Google Scholar 

  9. Hinderer K, Waldmann KH (2005) Algorithms for countable state Markov decision models with an absorbing set. SIAM J. Control and Optimization 43(6):2109–2131

    Article  Google Scholar 

  10. Kleywegt AJ, Papastavrou JD (1998) The dynamic and stochastic Knapsack problem. Operations Research 46(1):17–35

    Google Scholar 

  11. Lautenbacher CJ, Stidham S Jr (1999) The underlying Markov decision process in the single-leg airline yield management problem. Transportation Science 33(2):136–146

    Google Scholar 

  12. Lee TC, Hersh M (1993) A model for dynamic airline seat inventory control with multiple seat bookings. Transportation Science 27(3):252–265

    Google Scholar 

  13. Liang Y (1999) Solution to the continuous time dynamic yield management model. Transportation Science 33(1):117–123

    Google Scholar 

  14. Littlewood K (1972) Forecasting and control of passengers. 12th AG-IFORS Symposium Proceedings, pp. 95–117

    Google Scholar 

  15. Robinson LW (1995) Optimal and approximate control policies for airline booking with sequential nonmonotonic fare classes. Operations Research 43(2):252–263

    Google Scholar 

  16. Schäl M (1975) Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal. Z. Wahrscheinlichkeitstheorie verw. Gebiete 32:179–196

    Article  Google Scholar 

  17. Shaked M, Shanthikumar JG (1988) Stochastic convexity and its applications. Advances in applied probabilities 20(2):427–446

    Article  Google Scholar 

  18. van Slyke R, Young Y (2000) Finite horizon stochastic Knapsacks with applications to yield management. Operations Research 48(1):155–172

    Article  Google Scholar 

  19. Stidham S Jr (1978) Socially and individually optimal control of arrivals to a GI/GI/1 queue. Management Science 24(15):1598–1610

    Google Scholar 

  20. Subramanian J, Stidham S Jr, Lautenbacher CJ (1999) Airline yield management with overbooking, cancellations, and no-shows. Transportation Science 33(2):147–167

    Article  Google Scholar 

  21. Talluri KT, van Ryzin GJ (2004) The Theory and Practice of Revenue Management. Kluwer Academic Publishers, Dordrecht

    Google Scholar 

  22. Walczak D (2001) Dynamic modelling approaches to airline revenue management. Ph.D. thesis at the Centre for Transportation Studies, University of British Columbia

    Google Scholar 

  23. Wollmer RD (1992) An airline management model for a single leg route when lower fare classes book first. Operations Research 40(1):26–37

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Martin Morlock Christoph Schwindt Norbert Trautmann Jürgen Zimmermann

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Deutscher Universitäts-Verlag/GWV Fachverlage GmbH, Wiesbaden

About this chapter

Cite this chapter

Barz, C., Waldmann, KH. (2006). An Application of Markov Decision Processes to the Seat Inventory Control Problem. In: Morlock, M., Schwindt, C., Trautmann, N., Zimmermann, J. (eds) Perspectives on Operations Research. DUV. https://doi.org/10.1007/978-3-8350-9064-4_7

Download citation

Publish with us

Policies and ethics