Skip to main content

A New Rearrangement Plan for Freight Cars in a Train

Q-Learning for Minimizing the Movement Counts of Freight Cars

  • Chapter
Intelligent Control and Computer Engineering

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 70))

Abstract

In this paper, a new Q-Learning method for transfer scheduling of freight cars in a train is proposed. In the proposed method, the number of freight-movements in order to line freights in the desired order is reflected by corresponding evaluation value for each pair of freight-layout and removal-destination at a freight yard. Evaluation values are obtained by the Q-Learning method. The best transfer scheduling can be derived by selecting the removal-action of freight that has the best evaluation value at each freight-layout.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Blasum, U., Bussieck, M.R., Hochstättler, W., Moll, C., Scheel, H.-H., Winter, T.: Scheduling trams in the morning. Math. Methods Oper. Res. 49(1), 137–148 (2000)

    Google Scholar 

  2. Dahlhaus, E., Manne, F., Miller, M., Ryan, J.: Algorithms for combinatorial problems related to train marshalling. In: Proceedings of Australasian Workshop on Combinatorial Algorithms 2000, pp. 7–16 (2000)

    Google Scholar 

  3. He, S., Song, R., Chaudhry, S.S.: Fuzzy dispatching model and genetic algorithms for railyards operations. Eur. J. Oper. Res. 124(2), 307–331 (2000)

    Article  MATH  Google Scholar 

  4. Hirashima, Y.: A reinforcement learning system for transfer scheduling of freight cars in a train. In: Lecture Notes in Engineering and Computer Science: Proceedings of the International MultiConference of Engineers and Computer Scientists 2010, IMECS 2010, Hong Kong, 17–19, March 2010, pp. 112–117 (2010)

    Google Scholar 

  5. Jacob, R., Marton, P., Maue, J., Nunkesser, M.: Multistage methods for freight train classification. In: 7th Workshop on Algorithmic Methods and Models for Optimization of Railways, pp. 158–174 (2007)

    Google Scholar 

  6. Kroon, L.G., Lentink, R.M., Schrijver, A.: Shunting of passenger train units: an integrated approach. Transp. Sci. 42, 436–449 (2008)

    Article  Google Scholar 

  7. Li, G., Muto, M., Aihara, N., Tsujimura, T.: Environmental load reduction due to modal shift resulting from improvements to railway freight stations. Q. Rep. RTRI 48(4), 207–214 (2007)

    Article  Google Scholar 

  8. Tomii, N., Jian, Z.L.: Depot shunting scheduling with combining genetic algorithm and pert. In: Proceedings of 7th International Conference on Computer Aided Design, Manufacture and Operation in the Railway and Other Advanced Mass Transit Systems, pp. 437–446 (2000)

    Google Scholar 

  9. Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yoichi Hirashima .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media B.V.

About this chapter

Cite this chapter

Hirashima, Y. (2011). A New Rearrangement Plan for Freight Cars in a Train. In: Ao, SI., Castillo, O., Huang, X. (eds) Intelligent Control and Computer Engineering. Lecture Notes in Electrical Engineering, vol 70. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0286-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-94-007-0286-8_10

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-007-0285-1

  • Online ISBN: 978-94-007-0286-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics