Skip to main content

Research on Intelligent Cloud Manufacturing Resource Adaptation Methodology Based on Reinforcement Learning

  • Conference paper
  • First Online:
Artificial Intelligence and Security (ICAIS 2021)

Abstract

In cloud manufacturing, an allocation platform integrates resources and assign tasks manufacturers. Improper allocation algorithm causes wasting of resources and budget. In this paper, a new bilateral adaptation algorithm based on Q-learning and improved Gale-Shapley algorithm is proposed for the manufacturer-dealer bilateral adaptation problem in the intelligent cloud manufacturing environment. The main idea of the algorithm is to first construct a manufacturer-to-dealer distance-based ordering model as well as a dealer-to-manufacturer Quality of Service based (QoS-based) ordering model, and then, a basic bilateral allocation result is obtained by the improved Gale-Shapley algorithm, which will allocate dealers and manufacturers into pairs depend on the overall cost and degree of satisfaction. At last, with the obtained pairing scheme, a more rational pairing approach can be obtained through the self-learning process in the Q-learning algorithm. Numerical experiment has been done and the proposed algorithm are compared with some traditional approaches. The experimental results show that the improved Gale-Shapley algorithm proposed in this paper obtains better results than other ways.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, B., et al.: Cloud manufacturing - a new model of service-oriented networked Manufacturing. Comput. Integrated Manuf. Syst. 16(01), 1–7+16 (2010)

    Google Scholar 

  2. Di, Z., Tao, S., Ye, C., Liangqi, W.: A stable bilateral matching decision method based on language preference information. Oper. Manage. 28(02), 60–66 (2019)

    Google Scholar 

  3. Shan, X., Wang, F., He, X., Jiang, G.: A study of supply chain production and marketing cooperation based on stable bilateral matching. Comput. Eng. Appl. 52(23), 260–265+270 (2016)

    Google Scholar 

  4. Wang, J., et al.: Multi-task allocation in mobile crowd sensing with individual task quality assurance. IEEE Trans. Mob. Comput. 17(9), 2101–2113 (2018)

    Google Scholar 

  5. Pu, L., Chen, X., Xu, J., Fu, X.: Crowd foraging: a qos-oriented self-organized mobile crowdsourcing framework over opportunistic networks. IEEE J. Sel. Areas Commun. 35(4), 848–862 (2017)

    Google Scholar 

  6. Liu, Y., Guo, B., Wang, Y., et al.: TaskMe: Multi-task allocation in mobile crowd sensing. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 403–414 (2016)

    Google Scholar 

  7. Wang, J., Huang, Q., Hu, W., et al.: Shapley value based customers voluntary demand response program: a stackelberg game approach. In: 2019 IEEE Innovative Smart Grid Technologies-Asia (ISGT Asia), pp. 3051–3056. IEEE (2019)

    Google Scholar 

  8. Waschneck, B., Reichstaller, A., Belzner, L., et al.: Optimization of global production scheduling with deep reinforcement learning. Proc. CIRP 72(1), 1264–1269 (2018)

    Article  Google Scholar 

  9. Chen, S., Fang, S., Tang, R.: A reinforcement learning based approach for multi-projects scheduling in cloud manufacturing. Int. J. Prod. Res. 57(10), 3080–3098 (2019)

    Article  Google Scholar 

  10. Zheng, Z., Zhang, Y., Lyu, M.R.: Investigating QoS of real-world web services. IEEE Trans. Serv. Comput. 7(1), 32–39 (2014)

    Article  Google Scholar 

  11. Zheng, Z., Zhang, Y., Lyu, M.R.: Distributed qos evaluation for real-world web services. In: 2010 IEEE International Conference on Web Services, pp. 83–90. IEEE (2010)

    Google Scholar 

Download references

Acknowledgement

This paper was supported by the National Natural Science Foundation of China (61802208 and 61772286), Project funded by China Postdoctoral Science Foundation (2019M651923 and 2020M671552), Natural Science Foundation of Jiangsu Province of China (BK20191381), Primary Research & Development Plan of Jiangsu Province Grant (BE2019742), the Opening Project of Jiangsu Key Laboratory of Data Science and Smart Software (No. 2020DS301).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jin Qi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fang, Z., Hu, Q., Sun, H., Chen, G., Qi, J. (2021). Research on Intelligent Cloud Manufacturing Resource Adaptation Methodology Based on Reinforcement Learning. In: Sun, X., Zhang, X., Xia, Z., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2021. Lecture Notes in Computer Science(), vol 12736. Springer, Cham. https://doi.org/10.1007/978-3-030-78609-0_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78609-0_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78608-3

  • Online ISBN: 978-3-030-78609-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics