Abstract
Personalization has become a focal point of modern revenue management. However, it is often the case that minimal data are available to appropriately make suggestions tailored to each customer. This has led to many products making use of reinforcement learning-based algorithms to explore sets of offerings to find the best suggestions to improve conversion and revenue. Arguably the most popular of these algorithms are built on the foundation of the multi-arm bandit framework, which has shown great success across a variety of use cases. A general multi-arm bandit algorithm aims to trade-off adaptively exploring available, but under observed, recommendations, with the current known best offering. While much success has been achieved with these relatively understandable procedures, much of the airline industry is losing out on better personalized offers by ignoring the context of the transaction, as is the case in the traditional multi-arm bandit setup. Here, we explore a popular exploration heuristic, Thompson sampling, and note implementation details for multi-arm and contextual bandit variants. While the contextual bandit requires greater computational and technical complexity to include contextual features in the decision process, we illustrate the value it brings by the improvement in overall expected
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Byrd, M., Darrow, R. (2023). A note on the advantage of context in Thompson sampling. In: Vinod, B. (eds) Artificial Intelligence and Machine Learning in the Travel Industry. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-25456-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-25456-7_8
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-031-25455-0
Online ISBN: 978-3-031-25456-7
eBook Packages: Business and ManagementBusiness and Management (R0)