Skip to main content

Boosting Local Search Using Machine Learning: A Study on Improving Local Search by Graph Classification in Determining Capacity of Shunting Yards

  • Conference paper
  • First Online:
Agents and Artificial Intelligence (ICAART 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11978))

Included in the following conference series:

  • 628 Accesses

Abstract

Determining the maximum capacities of shunting yards is an important problem at Dutch Railways (NS). Solving this capacity determination problem is computational expensive as it requires to solve an NP-hard shunting planning problem. Currently, NS uses a shunt plan simulator where a local search heuristic is implemented to determine such capacities.

In this paper, we study how to combine machine learning with local search in order to speed up finding shunting plans in the capacity determination problem. We investigate this in the following two ways. In the first approach, we propose to use the Deep Graph Convolutional Neural Network (DGCNN) to predict whether local search will find a feasible shunt plan given an initial solution. Using instances generated from the simulator, we build a classification model and show our approach can significantly reduce the simulation time in determining the capacity of a given shunting yard.

In the second approach, we investigate whether we can use machine learning to help local search decide which promising areas to explore during search. Therefore, DGCNN is applied to predict the order of search operators in which the local search heuristic should evaluate. We show that accurately predicting the evaluation order could find improved solutions faster, and may lead to more consistent plans.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Boysen, N., Fliedner, M., Jaehn, F., Pesch, E.: Shunting yard operations: theoretical aspects and applications. Eur. J. Oper. Res. 220(1), 1–14 (2012)

    Article  Google Scholar 

  2. van den Broek, R., Hoogeveen, H., van den Akker, M., Huisman, B.: A local search algorithm for train unit shunting with service scheduling. Transportation Science (2018, submitted)

    Google Scholar 

  3. van den Broek, R.: Train Shunting and Service Scheduling: an integrated local search approach. Master’s thesis, Utrecht University (2016)

    Google Scholar 

  4. de Oliveira da Costa, P.R., Rhuggenaath, J., Zhang, Y., Akcay, A., Lee, W.J., Kaymak, U.: Data driven policy on feasibility determination for train shunting problem. In: ECML PKDD 2019 (2019)

    Google Scholar 

  5. Dai, L.: A machine learning approach for optimization in railway planning. Master’s thesis, Delft University of Technology, March 2018

    Google Scholar 

  6. Defourny, B., Ernst, D., Wehenkel, L.: Scenario trees and policy selection for multistage stochastic programming using machine learning. J. Comput. (2012)

    Google Scholar 

  7. Hopcroft, J., Karp, R.: An algorithm for maximum matchings in bipartite graphs. Ann. Symp. Switching and Automata Theory 2(4), 225–231 (1973)

    MathSciNet  MATH  Google Scholar 

  8. Kipf, T., Welling, M.: Semi-supervised classification with graph convolutional networks. CoRR abs/1609.02907 (2016)

    Google Scholar 

  9. Kroon, L.G., Lentink, R.M., Schrijver, A.: Shunting of passenger train units: an integrated approach. Transp. Sci. 42(4), 436–449 (2008)

    Article  Google Scholar 

  10. Lombardi, M., Milano, M.: Boosting combinatorial problem modeling with machine learning. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI-18), pp. 5472–5478 (2018)

    Google Scholar 

  11. Meisel, S., Mattfeld, D.: Synergies of operations research and data mining. Eur. J. Oper. Res. 206(1), 1–10 (2010)

    Article  Google Scholar 

  12. Neumann, M., Garnett, R., Bauckhage, C., Kersting, K.: Propagation kernels: efficient graph kernels from propagated information. Mach. Learn. 102(2), 209–245 (2016)

    Article  MathSciNet  Google Scholar 

  13. Niepert, M., Ahmed, M., Kutzkov, K.: Learning convolutional neural networks for graphs. CoRR abs/1605.05273 (2016)

    Google Scholar 

  14. Peer, E., Menkovski, V., Zhang, Y., Lee, W.J.: Shunting trains with deep reinforcement learning. In: Proceeding of 2018 IEEE International Conference on Systems, Man, and Cybernetics. IEEE (2018)

    Google Scholar 

  15. Shervashidze, N., Schweitzer, P., van Leeuwen, E., Mehlhorn, K., Borgwardt, K.: Weisfeiler-lehman graph kernels. J. Mach. Learn. Res. 12, 2539–2561 (2011)

    MathSciNet  MATH  Google Scholar 

  16. van de Ven, A., Zhang, Y., Lee, W.J., Eshuis, H., Wilbik, A.: Determining capacity of shunting yards by combining graph classification with local search. In: Steels, L., Rocha, A., van den Herik, J. (eds.) 11th International Conference on Agents and Artificial Intelligence (ICAART 2019), vol. 2, pp. 285–293. SCITEPRESS-Science and Technology Publications, Lda. (2019)

    Google Scholar 

  17. Verwer, S., Zhang, Y., Ye, Q.C.: Auction optimization using regression trees and linear models as integer programs. Artif. Intell. 244, 368–395 (2017). https://doi.org/10.1016/j.artint.2015.05.004

    Article  MathSciNet  MATH  Google Scholar 

  18. Zhang, M., Cui, Z., Neumann, M., Chen, Y.: An end-to-end deep learning architecture for graph classification. In: AAAI, pp. 4438–4445 (2018)

    Google Scholar 

Download references

Acknowledgements

The work is partially supported by the NWO funded project Real-time data-driven maintenance logistics (project number: 628.009.012).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yingqian Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

van de Ven, A., Zhang, Y., Lee, WJ. (2019). Boosting Local Search Using Machine Learning: A Study on Improving Local Search by Graph Classification in Determining Capacity of Shunting Yards. In: van den Herik, J., Rocha, A., Steels, L. (eds) Agents and Artificial Intelligence. ICAART 2019. Lecture Notes in Computer Science(), vol 11978. Springer, Cham. https://doi.org/10.1007/978-3-030-37494-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-37494-5_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-37493-8

  • Online ISBN: 978-3-030-37494-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics