Skip to main content

Mix and Match: Markov Chains and Mixing Times for Matching in Rideshare

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11920))

Abstract

Rideshare platforms such as Uber and Lyft dynamically dispatch drivers to match riders’ requests. We model the dispatching process in rideshare as a Markov chain that takes into account the geographic mobility of both drivers and riders over time. Prior work explores dispatch policies in the limit of such Markov chains; we characterize when this limit assumption is valid, under a variety of natural dispatch policies. We give explicit bounds on convergence in general, and exact (including constants) convergence rates for special cases. Then, on simulated and real transit data, we show that our bounds characterize convergence rates—even when the necessary theoretical assumptions are relaxed. Additionally these policies compare well against a standard reinforcement learning algorithm which optimizes for profit without any convergence properties.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    We have \(\sum _{r \in \mathcal {R}} p_r \le 1\). Thus, with probability \(1-\sum _{r \in \mathcal {R}} p_r\), there is no request in any given time.

  2. 2.

    The choice of \(u_\sigma \) can be random since \(\sigma \) can be a randomized policy.

  3. 3.

    It is not critical for our purposes, but the experiments use New York city and road-distance is measured in Manhattan distance.

References

  1. Alonso-Mora, J., Samaranayake, S., Wallar, A., Frazzoli, E., Rus, D.: On-demand high-capacity ride-sharing via dynamic trip-vehicle assignment. Proc. Nat. Acad. Sci. 114(3), 462–467 (2017)

    Article  Google Scholar 

  2. Andrieu, C., De Freitas, N., Doucet, A., Jordan, M.I.: An introduction to MCMC for machine learning. Mach. Learn. 50(1–2), 5–43 (2003)

    Article  Google Scholar 

  3. Banerjee, S., Freund, D., Lykouris, T.: Pricing and optimization in shared vehicle systems: an approximation framework. In: Proceedings of the 2017 ACM Conference on Economics and Computation, EC 2017, pp. 517–517. ACM, New York (2017). https://doi.org/10.1145/3033274.3085099. http://doi.acm.org/10.1145/3033274.3085099. ISBN 978-1-4503-4527-9

  4. Banerjee, S., Johari, R., Riquelme, C.: Dynamic pricing in ridesharing platforms. SIGecom Exch. 15(1), 65–70 (2016). https://doi.org/10.1145/2994501.2994505. http://doi.acm.org/10.1145/2994501.2994505. ISSN 1551–9031

    Article  Google Scholar 

  5. Banerjee, S., Kanoria, Y., Qian, P.: State dependent control of closed queueing networks with application to ride-hailing. In: Proceedings of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS 2018 (2018). Complete working paper available at arXiv:1803.04959

  6. Braverman, A., Dai, J.G., Liu, X., Ying, L.: Empty-car routing in ridesharing systems. arXiv preprint arXiv:1609.07219 (2016)

  7. Cachon, G.P., Daniels, K.M., Lobel, R.: The role of surge pricing on a service platform with self-scheduling capacity. Manufact. Serv. Oper. Manage. 19(3), 368–384 (2017)

    Article  Google Scholar 

  8. Das, A., Gollapudi, S., Kim, A., Panigrahi, D., Swamy, C.: Minimizing latency in online ride and delivery services. In: Proceedings of the 2018 World Wide Web Conference, pp. 379–388. International World Wide Web Conferences Steering Committee (2018)

    Google Scholar 

  9. Dickerson, J.P., Sandholm, T.: Futurematch: combining human value judgments and machine learning to match in dynamic environments. In: Twenty-Ninth AAAI Conference on Artificial Intelligence (2015)

    Google Scholar 

  10. Dickerson, J.P., Sankararaman, K.A., Srinivasan, A., Xu, P.: Allocation problems in ride-sharing platforms: online matching with offline reusable resources. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence AAAI 2018, pp. 1007–1014 (2018)

    Google Scholar 

  11. Ghosh, S., Varakantham, P., Adulyasak, Y., Jaillet, P.: Dynamic repositioning to reduce lost demand in bike sharing systems. J. Artif. Intell. Res. 58, 387–430 (2017)

    Article  Google Scholar 

  12. Hahn, R., Metcalfe, R.: The ridesharing revolution: Economic survey and synthesis. Technical report (2017)

    Google Scholar 

  13. Hastings, W.K.: Monte carlo sampling methods using markov chains and their applications. Biometrika 57, 97–109 (1970)

    Article  MathSciNet  Google Scholar 

  14. Jia, Y., Xu, W., Liu, X.: An optimization framework for online ride-sharing markets. In: 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), pp. 826–835. IEEE (2017)

    Google Scholar 

  15. Laptev, N., Yosinski, J., Li, L.E., Smyl, S.: Time-series extreme event fore-casting with neural networks at uber. In: International Conference on Machine Learning, vol. 34, pp. 1–5 (2017)

    Google Scholar 

  16. Levin, D.A., Peres, Y.: Markov Chains and Mixing Times. American Mathematical Society (2017)

    Google Scholar 

  17. Li, Y.: Deep reinforcement learning: An overview. arXiv preprint arXiv:1701.07274 (2017)

  18. Lin, K., Zhao, R., Xu, Z., Zhou, J.: Efficient large-scale fleet management via multi-agent deep reinforcement learning. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1774–1783. ACM (2018)

    Google Scholar 

  19. Lowalekar, M., Varakantham, P., Jaillet, P.: Online spatio-temporal matching in stochastic and dynamic domains. Artif. Intell. 261, 71–112 (2018). https://doi.org/10.1016/j.artint.2018.04.005. http://www.sciencedirect.com/science/article/pii/S0004370218302030. ISSN 0004–3702

    Article  MathSciNet  Google Scholar 

  20. Ma, H., Fang, F., Parkes, D.C.: Spatio-temporal pricing for ridesharing platforms. In: Proceedings of the 2019 ACM Conference on Economics and Computation, EC 2019 (2019)

    Google Scholar 

  21. Mehta, A., et al.: Online matching and ad allocation. Found. Trends® Theoret. Comput. Sci. 8(4), 265–368 (2013)

    Google Scholar 

  22. Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21(6), 1087–1092 (1953)

    Article  Google Scholar 

  23. Metropolis, N., Ulam, S.: The monte carlo method. J. Am. Stat. Assoc. 44(247), 335–341 (1949)

    Article  Google Scholar 

  24. O’Mahony, E., Shmoys, D.B.: Data analysis and optimization for (citi) bike sharing. In: Twenty-ninth AAAI Conference on Artificial Intelligence (2015)

    Google Scholar 

  25. Ozkan, E., Ward, A.: Dynamic matching for real-time ridesharing. SSRN 2844451 (2017)

    Google Scholar 

  26. Qu, M., Zhu, H., Liu, J., Liu, G., Xiong, H.: A cost-effective recommender system for taxi drivers. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 45–54. ACM (2014)

    Google Scholar 

  27. Rong, J., Qin, T., An, B.: Dynamic pricing for reusable resources in competitive market with stochastic demand. In: Thirty-Second AAAI Conference on Artificial Intelligence (2018)

    Google Scholar 

  28. Sun, Y., Wang, J., Tan, W.: Online algorithms of task allocation in spatial crowdsourcing. In: Proceedings of the 12th Chinese Conference on Computer Supported Cooperative Work and Social Computing, pp. 205–208. ACM (2017)

    Google Scholar 

  29. Tong, Y., She, J., Ding, B., Chen, L., Wo, T., Xu, K.: Online minimum matching in real-time spatial data: experiments and analysis. Proc. VLDB Endowment 9(12), 1053–1064 (2016)

    Article  Google Scholar 

  30. Verma, T., Varakantham, P., Kraus, S., Lau, H.C.: Augmenting decisions of taxi drivers through reinforcement learning for improving revenues. In: Twenty-Seventh International Conference on Automated Planning and Scheduling (2017)

    Google Scholar 

  31. Wen, J., Zhao, J., Jaillet, P.: Rebalancing shared mobility-on-demand systems: a reinforcement learning approach. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 220–225. IEEE (2017)

    Google Scholar 

  32. Yao, H., et al.: Deep multi-view spatial-temporal network for taxi demand prediction. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, AAAI 2018, pp. 2588–2595 (2018)

    Google Scholar 

Download references

Acknowledgements

John Dickerson and Michael Curry were supported in part by NSF CAREER Award IIS-1846237 and DARPA SI3-CMD Award S4761. Aravind Srinivasan, Karthik Abinav Sankararaman and Pan Xu were supported in part by NSF CNS-1010789, CCF-1422569 and CCF-1749864, and by research awards from Adobe, Amazon and Google. Yuhao Wan was supported via an REU grant, NSF CCF-1852352, and was advised by John Dickerson. John Dickerson and Aravind Srinivasan were both supported by a gift from Google and a seed grant from the Maryland Transportation Institute (MTI). Work done when Karthik was at the University of Maryland, College Park.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pan Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Curry, M., Dickerson, J.P., Sankararaman, K.A., Srinivasan, A., Wan, Y., Xu, P. (2019). Mix and Match: Markov Chains and Mixing Times for Matching in Rideshare. In: Caragiannis, I., Mirrokni, V., Nikolova, E. (eds) Web and Internet Economics. WINE 2019. Lecture Notes in Computer Science(), vol 11920. Springer, Cham. https://doi.org/10.1007/978-3-030-35389-6_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-35389-6_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-35388-9

  • Online ISBN: 978-3-030-35389-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics