Skip to main content
SpringerLink
Log in

A classification model of railway fasteners based on computer vision

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Fasteners are critical railway components that maintain the rails in a fixed position. The state of fasteners needs to be periodically checked in order to ensure safe transportation. Several computer vision methods have been proposed in the literature for fastener classification. However, these methods do not take into consideration the fasteners covered by stone. This paper proposes a new fastener classification model, which can divide fasteners into four types, including normal, partially worn, missing, and covered. First, the traditional latent Dirichlet allocation is introduced for fastener classification and its shortcomings are analyzed. Second, conditional random fields are used to segment the fastener structure. Third, the Bayesian hierarchical model of fastener feature words and structure labels is established. Then, the topics hidden behind the fastener feature words are derived, and the fastener image is ultimately represented by a topic distribution. Finally, the fasteners are classified using the support vector machine. The experimental results demonstrate the effectiveness of this method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Abbreviations

LDA:

Latent Dirichlet allocation

CRF:

Conditional random fields

S_LDA:

Spatial pyramid LDA

BoF:

Bag-of-features

GLM:

Generalized linear model

MAP:

Maximum a posteriori

MPM:

Maximum posterior marginal

TRW:

Tree-reweighted belief propagation

sLDA:

Supervised LDA

References

  1. Wei JH, Liu C, Ren TQ, Liu HX, Zhou WJ (2017) Online condition monitoring of a rail fastening system on high-speed railways based on wavelet packet analysis. Sensors 17(2):318

    Article  Google Scholar 

  2. Mao QZ, Cui H, Hu QW, Ren XC (2018) A rigorous fastener inspection approach for high-speed railway from structure light sensors. ISPRS J Photogramm Remote Sens 143:249–267

    Article  Google Scholar 

  3. Wang L, Zhang B, Chen XA (2011) Inspection system for loss of rail fastening nut based on computer vision. Comput Eng Des 32(12):4147–4150

    Google Scholar 

  4. Yang JF, Tao W, Liu MH, Zhang YJ, Zhang HB, Zhao H (2011) An efficient direction field-based method for the detection of fasteners on high-speed railways. Sensors 11(8):7364–7381

    Article  Google Scholar 

  5. Dou YG, Huang YP, Li QY, Luo SW (2014) A fast template matching-based algorithm for railway bolts detection. Int J Mach Learn Cybernet 5(6):835–844

    Article  Google Scholar 

  6. Feng H, Jiang ZG, Xie FY, Yang P, Shi J, Chen L (2014) Automatic fastener classification and defect detection in vision-based railway inspection systems. IEEE Trans Instrum Meas 63(4):877–888

    Article  Google Scholar 

  7. Aytekin C, Rezaeitabar Y, Dogru S, Ulusoy I (2015) Railway fastener inspection by real-time machine vision. IEEE Trans Syst Man Cybern Syst 45(7):1101–1107

    Article  Google Scholar 

  8. Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J Mach Learn Res 3:993–1022

    MATH  Google Scholar 

  9. Wang Y, Li J, Gao XB (2014) Latent feature mining of spatial and marginal characteristics for mammographic mass classification. Neurocomputing 144:107–118

    Article  Google Scholar 

  10. Hou SJ, Chen L, Tao DC, Zhou SB, Liu WJ, Zheng YJ (2017) Multi-layer multi-view topic model for classifying advertising video. Pattern Recogn 68:66–81

    Article  Google Scholar 

  11. Xia X, Lo D, Ding Y, Al-Kofahi JM, Nguyen TN, Wang XY (2017) Improving automated bug triaging with specialized topic model. IEEE Trans Softw Eng 43(3):272–297

    Article  Google Scholar 

  12. Lafferty J, Mccallum A, Pereira F (2001) Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: ICML, pp 282–289

  13. Kumar S, Hebert M (2006) Discriminative random fields. Int J Comput Vision 68(2):179–201

    Article  Google Scholar 

  14. Vishwanathan SVN, Schraudolph NN, Schmidt MW, Murphy KP (2006) Accelerated training of conditional random fields with stochastic gradient methods. In: ICML, pp 969–976

  15. Mai L, Niu YX, Liu F (2013) Saliency aggregation: a data-driven approach. In: Proceedings of IEEE conference computer vision and pattern recognition, pp 1131–1138

  16. Domke J (2013) Learning graphical model parameters with approximate marginal inference. IEEE Trans Pattern Anal Mach Intell 35(10):2454–2467

    Article  Google Scholar 

  17. Qiu WL, Gao XB, Han B (2017) A Superpixel-based CRF saliency detection approach. Neurocomputing 244:19–32

    Article  Google Scholar 

  18. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  19. Kadir T, Brady M (2001) Saliency, scale and image description. Int J Comput Vision 45(2):83–105

    Article  Google Scholar 

  20. Hammersley JM, Clifford P (1971) Markov fields on finite graphs and lattices

  21. Konidaris G, Osentoski S, Thomas P (2011) Value function approximation in reinforcement learning using the Fourier basis. In: Proceedings of AAAI conference artificial intelligence, San Francisco, California, USA

  22. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of IEEE conference computer vision and pattern recognition, pp 886–893

  23. Kumar S, August J, Hebert M (2005) Exploiting inference for approximate parameter learning in discriminative fields: an empirical study. In: Proceedings of international conference on energy minimization methods in computer vision and pattern recognition, vol 3757, pp 153–168

    Google Scholar 

  24. Kohli P, Torr PHS (2008) Measuring uncertainty in graph cut solutions. Comput Vis Image Underst 112(1):30–38

    Article  Google Scholar 

  25. Heinrich G (2008) Parameter estimation for text analysis. Leipzig University, Leipzig

    Google Scholar 

  26. Blei DM, Jordan MI (2003) Modeling annotated data. In: Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval (SIGIR'03). ACM, New York, pp 127–134, 28 July–1 August 2003

  27. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Suesstrunk S (2012) Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2281

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by Sichuan Province Science and Technology Support Program under grant 2018GZ0361.

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, China

    Yang Ou, Jianqiao Luo, Bailin Li & Biao He

Authors
  1. Yang Ou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianqiao Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bailin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Biao He
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

We propose a new fastener classification model, which can divide fasteners into four types, including normal, partially worn, missing, and covered. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Bailin Li.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ou, Y., Luo, J., Li, B. et al. A classification model of railway fasteners based on computer vision. Neural Comput & Applic 31, 9307–9319 (2019). https://doi.org/10.1007/s00521-019-04337-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-019-04337-z

Keywords

Search

Navigation