Abstract
In cloud manufacturing, an allocation platform integrates resources and assign tasks manufacturers. Improper allocation algorithm causes wasting of resources and budget. In this paper, a new bilateral adaptation algorithm based on Q-learning and improved Gale-Shapley algorithm is proposed for the manufacturer-dealer bilateral adaptation problem in the intelligent cloud manufacturing environment. The main idea of the algorithm is to first construct a manufacturer-to-dealer distance-based ordering model as well as a dealer-to-manufacturer Quality of Service based (QoS-based) ordering model, and then, a basic bilateral allocation result is obtained by the improved Gale-Shapley algorithm, which will allocate dealers and manufacturers into pairs depend on the overall cost and degree of satisfaction. At last, with the obtained pairing scheme, a more rational pairing approach can be obtained through the self-learning process in the Q-learning algorithm. Numerical experiment has been done and the proposed algorithm are compared with some traditional approaches. The experimental results show that the improved Gale-Shapley algorithm proposed in this paper obtains better results than other ways.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Li, B., et al.: Cloud manufacturing - a new model of service-oriented networked Manufacturing. Comput. Integrated Manuf. Syst. 16(01), 1–7+16 (2010)
Di, Z., Tao, S., Ye, C., Liangqi, W.: A stable bilateral matching decision method based on language preference information. Oper. Manage. 28(02), 60–66 (2019)
Shan, X., Wang, F., He, X., Jiang, G.: A study of supply chain production and marketing cooperation based on stable bilateral matching. Comput. Eng. Appl. 52(23), 260–265+270 (2016)
Wang, J., et al.: Multi-task allocation in mobile crowd sensing with individual task quality assurance. IEEE Trans. Mob. Comput. 17(9), 2101–2113 (2018)
Pu, L., Chen, X., Xu, J., Fu, X.: Crowd foraging: a qos-oriented self-organized mobile crowdsourcing framework over opportunistic networks. IEEE J. Sel. Areas Commun. 35(4), 848–862 (2017)
Liu, Y., Guo, B., Wang, Y., et al.: TaskMe: Multi-task allocation in mobile crowd sensing. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 403–414 (2016)
Wang, J., Huang, Q., Hu, W., et al.: Shapley value based customers voluntary demand response program: a stackelberg game approach. In: 2019 IEEE Innovative Smart Grid Technologies-Asia (ISGT Asia), pp. 3051–3056. IEEE (2019)
Waschneck, B., Reichstaller, A., Belzner, L., et al.: Optimization of global production scheduling with deep reinforcement learning. Proc. CIRP 72(1), 1264–1269 (2018)
Chen, S., Fang, S., Tang, R.: A reinforcement learning based approach for multi-projects scheduling in cloud manufacturing. Int. J. Prod. Res. 57(10), 3080–3098 (2019)
Zheng, Z., Zhang, Y., Lyu, M.R.: Investigating QoS of real-world web services. IEEE Trans. Serv. Comput. 7(1), 32–39 (2014)
Zheng, Z., Zhang, Y., Lyu, M.R.: Distributed qos evaluation for real-world web services. In: 2010 IEEE International Conference on Web Services, pp. 83–90. IEEE (2010)
Acknowledgement
This paper was supported by the National Natural Science Foundation of China (61802208 and 61772286), Project funded by China Postdoctoral Science Foundation (2019M651923 and 2020M671552), Natural Science Foundation of Jiangsu Province of China (BK20191381), Primary Research & Development Plan of Jiangsu Province Grant (BE2019742), the Opening Project of Jiangsu Key Laboratory of Data Science and Smart Software (No. 2020DS301).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Fang, Z., Hu, Q., Sun, H., Chen, G., Qi, J. (2021). Research on Intelligent Cloud Manufacturing Resource Adaptation Methodology Based on Reinforcement Learning. In: Sun, X., Zhang, X., Xia, Z., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2021. Lecture Notes in Computer Science(), vol 12736. Springer, Cham. https://doi.org/10.1007/978-3-030-78609-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-78609-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78608-3
Online ISBN: 978-3-030-78609-0
eBook Packages: Computer ScienceComputer Science (R0)