Skip to main content
Book cover

International Conference on Service-Oriented Computing

ICSOC 2022: Service-Oriented Computing pp 285–299Cite as

Balancing Supply and Demand for Mobile Crowdsourcing Services

  • 643 Accesses

Part of the Lecture Notes in Computer Science book series (LNCS,volume 13740)

Abstract

Mobile crowdsourcing (MC) which has been developed rapidly in recent years is playing an increasingly indispensable role in people’s daily lives such as taxi-hailing, food delivery and other services. The geographic equilibrium of service supply and demand is crucial so that the MC system could guarantee more promising matches in a more regionally balanced way. However, due to the spatial dynamic of MC environments, the emergence of supply and demand is unpredictable, asymmetric, and constantly changing among different regions and throughout the day, presenting considerable challenges to the MC platform. In this paper, we propose a hybrid reinforcement learning and transformer-based balancing framework (HRB) to achieve geographically balanced coverage of MC services, considering both the imbalanced state of service supply-demand geographical distribution and the moving willingness of MC participants. The HRB framework is developed based on the Deep Deterministic Policy Gradient strategy, which includes an actor-critic network for generating migration strategies and a Willingness Transformer (WiT) model for predicting the migration willingness of both mobile service providers and demanders among different regions. Experimental results have validated the effectiveness by comparing the proposed approach with other algorithms under multiple indicators.

Keywords

  • Mobile crowdsourcing service
  • Supply and demand balance
  • Reinforcement learning
  • Transformer
  • Migration willingness

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-031-20984-0_20
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-031-20984-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.

Notes

  1. 1.

    https://tianchi.aliyun.com/dataset/dataDetail?dataId=94519.

  2. 2.

    https://www.kaggle.com/datasets/ongks1986/new-york-city-bike-sharing-2019.

  3. 3.

    https://www.kaggle.com/chetanism/foursquare-nyc-and-tokyo-checkin-dataset/version/2.

References

  1. Chen, L., et al.: Dynamic cluster-based over-demand prediction in bike sharing systems. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016, Heidelberg, Germany, 12–16 September2016. pp. 841–852. ACM (2016)

    Google Scholar 

  2. Covington, P., Adams, J., Sargin, E.: Deep neural networks for YouTube recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA, 15–19 September 2016. pp. 191–198. ACM (2016)

    Google Scholar 

  3. Dietterich, T.G.: Hierarchical reinforcement learning with the MAXQ value function decomposition. J. Artif. Intell. Res. 13, 227–303 (2000)

    CrossRef  MathSciNet  MATH  Google Scholar 

  4. Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. In: 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, 3–2 May 2021. OpenReview.net (2021)

    Google Scholar 

  5. Duan, Y., Wu, J.: Optimizing rebalance scheme for dock-less bike sharing systems with adaptive user incentive. In: 20th IEEE International Conference on Mobile Data Management, MDM 2019, Hong Kong, SAR, China, 10–13 June 2019. pp. 176–181. IEEE (2019)

    Google Scholar 

  6. Duan, Y., Wu, J.: Optimizing the crowdsourcing-based bike station rebalancing scheme. In: 39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019, Dallas, TX, USA, 7–10 July 2019, pp. 1559–1568. IEEE (2019)

    Google Scholar 

  7. Hamrouni, A., Alelyani, T., Ghazzai, H., Massoud, Y.: Toward collaborative mobile crowdsourcing. IEEE Internet Things Mag. 4(2), 88–94 (2021)

    CrossRef  Google Scholar 

  8. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, 27–30 June 2016. pp. 770–778. IEEE Computer Society (2016)

    Google Scholar 

  9. Holler, J., et al.: Deep reinforcement learning for multi-driver vehicle dispatching and repositioning problem. In: 2019 IEEE International Conference on Data Mining, ICDM 2019, Beijing, China, 8–11 November 2019. pp. 1090–1095. IEEE (2019)

    Google Scholar 

  10. Jiao, Y., et al.: Real-world ride-hailing vehicle repositioning using deep reinforcement learning. CoRR abs/2103.04555 (2021)

    Google Scholar 

  11. Li, M., et al.: Efficient ridesharing order dispatching with mean field multi-agent reinforcement learning. In: The World Wide Web Conference, WWW 2019, San Francisco, CA, USA, 13–17 May 2019. pp. 983–994. ACM (2019)

    Google Scholar 

  12. Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. In: Bengio, Y., LeCun, Y. (eds.) 4th International Conference Track Proceedings on Learning Representations, ICLR 2016, San Juan, Puerto Rico, 2–4 May 2016 (2016)

    Google Scholar 

  13. Mnih, M., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)

    CrossRef  Google Scholar 

  14. Neiat, A.G., Bouguettaya, A., Mistry, S.: Incentive-based crowdsourcing of hotspot services. ACM Trans. Internet Techn. 19(1), 5:1–5:24 (2019)

    Google Scholar 

  15. Pan, L., Cai, Q., Fang, Z., Tang, P., Huang, L.: A deep reinforcement learning framework for rebalancing dockless bike sharing systems. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, pp. 1393–1400. AAAI Press (2019)

    Google Scholar 

  16. Qin, Z.T., et al.: Ride-hailing order dispatching at DIDI via reinforcement learning. INFORMS J. Appl. Anal. 50(5), 272–286 (2020)

    CrossRef  Google Scholar 

  17. Said, A.B., Erradi, A.: Deep-gap: a deep learning framework for forecasting crowdsourcing supply-demand gap based on imaging time series and residual learning. In: 2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), Sydney, Australia, 11–13 December 2019. pp. 279–286. IEEE (2019)

    Google Scholar 

  18. Said, A.B., Erradi, A.: Multiview topological data analysis for crowdsourced service supply-demand gap prediction. In: 16th International Wireless Communications and Mobile Computing Conference, IWCMC 2020, Limassol, Cyprus, 15–19 June 2020. pp. 1818–1823. IEEE (2020)

    Google Scholar 

  19. Singla, A., Santoni, M., Bartók, G., Mukerji, P., Meenen, M., Krause, A.: Incentivizing users for balancing bike sharing systems. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 25–30 January 2015, Austin, Texas, USA, pp. 723–729. AAAI Press (2015)

    Google Scholar 

  20. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4–9 December 2017, Long Beach, CA, USA, pp. 5998–6008 (2017)

    Google Scholar 

  21. Wang, S., Chen, H., Cao, J., Zhang, J., Yu, P.S.: Locally balanced inductive matrix completion for demand-supply inference in stationless bike-sharing systems. IEEE Trans. Knowl. Data Eng. 32(12), 2374–2388 (2020)

    CrossRef  Google Scholar 

  22. Wang, Z., Qin, Z.T., Tang, X., Ye, J., Zhu, H.: Deep reinforcement learning with knowledge transfer for online rides order dispatching. In: IEEE International Conference on Data Mining, ICDM 2018, Singapore, 17–20 November 2018. pp. 617–626. IEEE Computer Society (2018)

    Google Scholar 

Download references

Acknowledgements

This work was supported by National Key R &D Program of China (No.2021YFF0900802), Natural Science Foundation of China (No. 91846205) and Natural Science Foundation of Shandong Province (No. ZR2019LZH008).

Author information

Authors and Affiliations

  1. School of Software, Shandong University, Jinan, China

    Zhaoming Li, Wei He, Ning Liu, Yonghui Xu & Lizhen Cui

  2. Jonit SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Jinan, China

    Wei He, Ning Liu, Yonghui Xu & Lizhen Cui

  3. State Key Laboratory of High-end Server & Storage Technology, Beijing, China

    Kaiyuan Qi

Authors
  1. Zhaoming Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ning Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yonghui Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lizhen Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kaiyuan Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Wei He or Lizhen Cui .

Editor information

Editors and Affiliations

  1. University of Malaga, Málaga, Spain

    Javier Troya

  2. University of Michigan-Dearborn, Dearborn, MI, USA

    Brahim Medjahed

  3. University of Castilla-La Mancha, Ciudad Real, Spain

    Mario Piattini

  4. The University of New South Wales, Sydney, NSW, Australia

    Lina Yao

  5. University of Seville, Seville, Spain

    Pablo Fernández

  6. University of Seville, Seville, Spain

    Antonio Ruiz-Cortés

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Li, Z., He, W., Liu, N., Xu, Y., Cui, L., Qi, K. (2022). Balancing Supply and Demand for Mobile Crowdsourcing Services. In: Troya, J., Medjahed, B., Piattini, M., Yao, L., Fernández, P., Ruiz-Cortés, A. (eds) Service-Oriented Computing. ICSOC 2022. Lecture Notes in Computer Science, vol 13740. Springer, Cham. https://doi.org/10.1007/978-3-031-20984-0_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-20984-0_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-20983-3

  • Online ISBN: 978-3-031-20984-0

  • eBook Packages: Computer ScienceComputer Science (R0)