Skip to main content
SpringerLink
Log in

The pickup and delivery hybrid-operations of AGV conflict-free scheduling problem with time constraint among multi-FMCs

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Since much emphasis has been put on the eco-friendly manufacturing process in industries, and the complex changes in market demands, this paper focuses on a green scheduling problem of automated guided vehicles (AGVs) in a flexible manufacturing system (FMS). The studied FMS consists of multi-FMCs (flexible manufacturing cells) which have many material handling needs with time constraints. Distinguished from other AGV scheduling problems in FMS, this paper concentrates on the pickup and delivery operations or even bi-handling requirements of AGVs for FMCs, ignoring the inner production process within them. To solve this problem, a bi-objective mathematical model is built trying to minimize the total tardiness and energy consumption of AGVs simultaneously. Some properties of the problem and a no-collision algorithm are developed for the potential conflicts among AGVs. Due to the NP-hard nature of the proposed problem, a hyper-heuristic (HH) algorithm based on a double deep Q network (DDQN) is introduced, which benefits from the structures of double decision networks and multi-operator. To improve the performance of the proposed algorithm, the experience pool is used to increase the convergence speed and the crowding distance, and the non-dominated sorting strategies are presented to decide the acceptance of the new generation. Besides, in the DDQN, the states and rewards of agents are designed based on the characteristics of the scheduling problem. Finally, many experiments have been conducted and the computational results reveal that the proposed DDQN-HH algorithm outperforms the other two compared algorithms in both the convergence speed and quality of solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability statement

The authors declare that all data supporting the findings of this study are available within the article and its supplementary information files.

References

  1. Ivanov D, Tang CS, Dolgui A, Battini D, Das A (2020) Researchers’ perspectives on Industry 40: multi-disciplinary analysis and opportunities for operations management. Int J Prod Res. https://doi.org/10.1080/00207543.2020.1798035

    Article  Google Scholar 

  2. Thoben KD, Wiesner S, Wuest T (2017) “Industrie 4.0” and smart manufacturing-a review of research issues and application examples. Int J Autom Technol 11(1):4–16. https://doi.org/10.20965/ijat.2017.p0004

    Article  Google Scholar 

  3. Lu Y (2017) Industry 4.0: a survey on technologies, applications and open research issues. J Ind Inf Integr 6:1–10. https://doi.org/10.1016/j.jii.2017.04.005

    Article  Google Scholar 

  4. Kang HS, Lee JY, Choi S, Kim H, Park JH, Son JY, Do Noh S (2016) Smart manufacturing: Past research, present findings, and future directions. Int J Precis Eng Manuf Green Technol 3(1):111–128

    Article  Google Scholar 

  5. Huang S, Guo Y, Zha S, Wang F, Fang W (2017) A real-time location system based on RFID and UWB for digital manufacturing workshop. Procedia Cirp 63:132–137. https://doi.org/10.1016/j.procir.2017.03.085

    Article  Google Scholar 

  6. Barak S, Moghdani R, Maghsoudlou H (2021) Energy-efficient multi-objective flexible manufacturing scheduling. J Clean Prod 283:124610. https://doi.org/10.1016/j.jclepro.2020.124610

    Article  Google Scholar 

  7. Blazewicz J, Eiselt HA, Finke G, Laporte G, Weglarz J (1991) Scheduling tasks and vehicles in a flexible manufacturing system. Int J Flex Manuf Syst 4(1):5–16

    Article  Google Scholar 

  8. Singh N, Sarngadharan PV, Pal PK (2011) AGV scheduling for automated material distribution: a case study. J Intell Manuf 22(2):219–228. https://doi.org/10.1007/s10845-009-02

    Article  Google Scholar 

  9. Huang B, Sun Y, Sun Y (2008) Scheduling of flexible manufacturing systems based on Petri nets and hybrid heuristic search. Int J Prod Res 46(16):4553–4565. https://doi.org/10.1080/00207540600698878

    Article  MATH  Google Scholar 

  10. Fontes DBM, Homayouni SM (2019) Joint production and transportation scheduling in flexible manufacturing systems. J Glob Optim 74(4):879–908. https://doi.org/10.1007/s10898-018-0681-7

    Article  MathSciNet  MATH  Google Scholar 

  11. Novas JM, Henning GP (2014) Integrated scheduling of resource-constrained flexible manufacturing systems using constraint programming. Expert Syst Appl 41(5):2286–2299. https://doi.org/10.1016/j.eswa.2013.09.026

    Article  Google Scholar 

  12. De Guzman MC, Prabhu N, Tanchoco JMA (1997) Complexity of the AGV shortest path and single-loop guide path layout problems. Int J Prod Res 35(8):2083–2092. https://doi.org/10.1080/002075497194741

    Article  MATH  Google Scholar 

  13. Miyamoto T, Inoue K (2016) Local and random searches for dispatch and conflict-free routing problem of capacitated AGV systems. Comput Ind Eng 91:1–9. https://doi.org/10.1016/j.cie.2015.10.017

    Article  Google Scholar 

  14. Chawla VK, Chanda AK, Angra S (2019) A clonal selection algorithm for minimizing distance travel and back tracking of automatic guided vehicles in flexible manufacturing system. J Eng (India) Ser C 100(3):401–410. https://doi.org/10.1007/s40032-018-0447-5

    Article  Google Scholar 

  15. Singh A, Philip D, Ramkumar J, Das M (2018) A simulation based approach to realize green factory from unit green manufacturing processes. J Clean Prod 182:67–81. https://doi.org/10.1016/j.jclepro.2018.02.025

    Article  Google Scholar 

  16. Govindan K, Diabat A, Shankar KM (2015) Analyzing the drivers of green manufacturing with fuzzy approach. J Clean Prod 96:182–193. https://doi.org/10.1016/j.jclepro.2014.02.054

    Article  Google Scholar 

  17. Zou WQ, Pan QK, Meng T, Gao L, Wang YL (2020) An effective discrete artificial bee colony algorithm for multi-AGVs dispatching problem in a matrix manufacturing workshop. Expert Syst Appl 161:113675. https://doi.org/10.1016/j.eswa.2020.113675

    Article  Google Scholar 

  18. Chang HC, Liu TK (2017) Optimisation of distributed manufacturing flexible job shop scheduling by using hybrid genetic algorithms. J Intell Manuf 28(8):1973–1986. https://doi.org/10.1007/s10845-015-1084

    Article  Google Scholar 

  19. Rifai AP, Nguyen HT, Aoyama H, Dawal SZM, Masruroh NA (2018) Non-dominated sorting biogeography-based optimization for bi-objective reentrant flexible manufacturing system scheduling. Appl Soft Comput 62:187–202. https://doi.org/10.1016/j.asoc.2017.10.045

    Article  Google Scholar 

  20. Lissovoi A, Oliveto PS, Warwicker JA (2020) Simple hyper-heuristics control the neighbourhood size of randomised local search optimally for LeadingOnes. Evol Comput 28(3):437–461. https://doi.org/10.1162/evco_a_00258

    Article  Google Scholar 

  21. Choong SS, Wong LP, Lim CP (2018) Automatic design of hyper-heuristic based on reinforcement learning. Inf Sci 436:89–107. https://doi.org/10.1016/j.ins.2018.01.005

    Article  MathSciNet  Google Scholar 

  22. Pandey SP (2021) Simultaneous scheduling of machines and tools in a multi machine FMS with alternative routing using symbiotic organisms search algorithm. J Eng Res. https://doi.org/10.36909/jer.10653

    Article  Google Scholar 

  23. Lv Y, Li C, Tang Y, Kou Y (2021) Toward energy-efficient rescheduling decision mechanisms for flexible job shop with dynamic events and alternative process plans. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2021.3115821

    Article  Google Scholar 

  24. Lacomme P, Larabi M, Tchernev N (2013) Job-shop based framework for simultaneous scheduling of machines and automated guided vehicles. Int J Prod Econ 143:24–34. https://doi.org/10.1016/j.ijpe.2010.07.012

    Article  Google Scholar 

  25. Baruwa OT, Piera MA (2016) A coloured Petri net-based hybrid heuristic search approach to simultaneous scheduling of machines and automated guided vehicles. Int J Prod Res. https://doi.org/10.1080/00207543.2015.1087656

    Article  Google Scholar 

  26. Mousavi M, Yap HJ, Musa SN, Tahriri F, Dawal SZM (2017) Multi-objective AGV scheduling in an FMS using a hybrid of genetic algorithm and particle swarm optimization. PLoS One 12(3):e0169817. https://doi.org/10.1371/journal.pone.0169817

    Article  Google Scholar 

  27. Heger J, Voss T (2018) Dynamic priority based dispatching of AGVs in flexible job shops. Procedia CIRP 79:445–449. https://doi.org/10.1016/j.procir.2019.02.119

    Article  Google Scholar 

  28. Jahed A, Tavakkoli Moghaddam R (2021) Mathematical modeling for a flexible manufacturing scheduling problem in an intelligent transportation system. Iran J Manag Stud 14(1):189–208. https://doi.org/10.22059/IJMS.2020.261618.673203

    Article  Google Scholar 

  29. Chawla V, Chanda A, Angra S (2018) Sustainable multi-objective scheduling for automatic guided vehicle and flexible manufacturing system by a grey wolf optimization algorithm. Int J Data Netw Sci 2(1):27–40. https://doi.org/10.5267/j.ijdns.2018.6.001

    Article  Google Scholar 

  30. An Y, Chen X, Zhang J, Li Y (2020) A hybrid multi-objective evolutionary algorithm to integrate optimization of the production scheduling and imperfect cutting tool maintenance considering total energy consumption. J Clean Prod 268:121540. https://doi.org/10.1016/j.jclepro.2020.121540

    Article  Google Scholar 

  31. Hemmati Far M, Haleh H, Saghaei A (2018) A flexible cell scheduling problem with automated guided vehicles and robots under energy-conscious policy. Sci Iran 25(1):339–358. https://doi.org/10.24200/SCI.2017.4399

    Article  Google Scholar 

  32. Xu W, Guo S (2019) A multi-objective and multi-dimensional optimization scheduling method using a hybrid evolutionary algorithms with a sectional encoding mode. Sustainability 11(5):1329. https://doi.org/10.3390/su11051329

    Article  Google Scholar 

  33. Ren T, Ren Y (2021) Multi-task scheduling of Agvs system based on improved NSGA-II algorithm. J Phys Conf Ser 1924(1):012007. https://doi.org/10.1088/1742-6596/1924/1/012007

    Article  Google Scholar 

  34. Fazlollahtabar H (2018) Lagrangian relaxation method for optimizing delay of multiple autonomous guided vehicles. Transp Lett 10(6):354–360. https://doi.org/10.1080/19427867.2017.1386871

    Article  Google Scholar 

  35. Nishi T, Hiranaka Y, Grossmann IE (2011) A bilevel decomposition algorithm for simultaneous production scheduling and conflict-free routing for automated guided vehicles. Comput Oper Res 38(5):876–888. https://doi.org/10.1016/j.cor.2010.08.012

    Article  MathSciNet  MATH  Google Scholar 

  36. Riazi S, Bengtsson K, Lennartson B (2020) Energy optimization of large-scale AGV systems. IEEE Trans Sci Eng. https://doi.org/10.1109/tase.2019.2963285

    Article  Google Scholar 

  37. Chen RM, Shen YM (2016) Dynamic search control-based particle swarm optimization for project scheduling problems. Adv Mech Eng 8(4):1687814016641837. https://doi.org/10.1177/1687814016641837

    Article  Google Scholar 

  38. Umar UA, Ariffin MKA, Ismail N, Tang SH (2015) Hybrid multiobjective genetic algorithms for integrated dynamic scheduling and routing of jobs and automated-guided vehicle (AGV) in flexible manufacturing systems (FMS) environment. Int J Adv Manuf Technol 81(9):2123–2141. https://doi.org/10.1007/s00170-015-732

    Article  Google Scholar 

  39. Pillay N, Qu R (2018) Hyper-heuristics: theory and applications. Springer International Publishing, Cham

    Book  Google Scholar 

  40. Olgun B, Koç Ç, Altıparmak F (2021) A hyper heuristic for the green vehicle routing problem with simultaneous pickup and delivery. Comput Ind Eng 153:107010. https://doi.org/10.1016/j.cie.2020.107010

    Article  Google Scholar 

  41. Bouazza W, Sallez Y, Trentesaux D (2021) Dynamic scheduling of manufacturing systems: a product-driven approach using hyper-heuristics. Int J Comput Integr Manuf 34(6):641–665. https://doi.org/10.1080/0951192X.2021.1925969

    Article  Google Scholar 

  42. Zhang F, Mei Y, Nguyen S, Zhang M (2021) Correlation coefficient-based recombinative guidance for genetic programming hyperheuristics in dynamic flexible job shop scheduling. IEEE Trans Evol Comput 25(3):552–566. https://doi.org/10.1109/TEVC.2021.3056143

    Article  Google Scholar 

  43. Sutton RS, Barto AG (2018) Reinforcement learning: an introduction. MIT Press, Cambridge

    MATH  Google Scholar 

  44. Mosadegh H, Ghomi SF, Süer GA (2020) Stochastic mixed-model assembly line sequencing problem: mathematical modeling and Q-learning based simulated annealing hyper-heuristics. Eur J Oper Res 282(2):530–544. https://doi.org/10.1016/j.ejor.2019.09.021

    Article  MathSciNet  MATH  Google Scholar 

  45. Zhang Y, Bai R, Qu R, Tu C, Jin J (2021) A deep reinforcement learning based hyper-heuristic for combinatorial optimisation with uncertainties. Eur J Oper Res. https://doi.org/10.1016/j.ejor.2021.10.032

    Article  MATH  Google Scholar 

  46. Matsui Y (2007) An empirical analysis of just-in-time production in Japanese manufacturing companies. Int J Prod Econ 108(1–2):153–164

    Article  Google Scholar 

  47. Burke EK, Hyde MR, Kendall G, Ochoa G, Özcan E, Woodward JR (2019) A classification of hyper-heuristic approaches: revisited. In: Handbook of metaheuristics. Springer, Cham, pp 453–477. https://doi.org/10.1007/978-3-319-91086-4_14

  48. Ghorashi SB, Hamedi M, Sadeghian R (2019) Modeling and optimization of a reliable blood supply chain network in crisis considering blood compatibility using MOGWO. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04343-1

    Article  Google Scholar 

  49. Shirvani MH (2020) A hybrid meta-heuristic algorithm for scientific workflow scheduling in heterogeneous distributed computing systems. Eng Appl Artif Intell. https://doi.org/10.1016/j.engappai.2020.103501

    Article  Google Scholar 

  50. Burnwal S, Deb S (2013) Scheduling optimization of flexible manufacturing system using cuckoo search-based approach. Int J Adv Manuf Technol 64(5–8):951–959. https://doi.org/10.1007/s00170-012-4061-z

    Article  Google Scholar 

  51. Yang X-S, Deb S (2009) Cuckoo search via Lévy flights. In: 2009 World congress on nature and biologically inspired computing (NaBIC). IEEE, pp 210–214. https://doi.org/10.1109/NABIC.2009.5393690

Download references

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Tongji University, Cao’an Road 4800, Mechanical Building A444, Shanghai, 201804, People’s Republic of China

    Binghai Zhou & Yuanrui Lei

Authors
  1. Binghai Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuanrui Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

BZ: proposed the research goals and aims. Verified the overall results, experiments, and other outputs. Provided the computing resources and analysis tools. Reviewed the initial draft and revised the manuscript. In charge of acquisition of the financial support for the project leading to this publication. YL: developed and designed the mathematical model and methodology. Performed software development and experiments. Conducted the statistical analysis. Wrote the initial draft and revised the manuscript.

Corresponding author

Correspondence to Binghai Zhou.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Abbreviation

Definition

AGV

Automated guided vehicle

FMS

Flexible manufacturing system

FMC

Flexible manufacturing cell

DDQN

Double deep Q network

DDQN-HH

Double deep Q network-hyper heuristic

HH

Hyper heuristic

CNC

Computer numerical control

NP

Non-deterministic polynomial

ML

Machine learning

RL

Reinforcement learning

LLH

Low-level heuristic

I/O

Input and output

FILO

First in last out

JIT

Just in time

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, B., Lei, Y. The pickup and delivery hybrid-operations of AGV conflict-free scheduling problem with time constraint among multi-FMCs. Neural Comput & Applic 35, 23125–23151 (2023). https://doi.org/10.1007/s00521-023-08897-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08897-z

Keywords

Search

Navigation