Skip to main content
SpringerLink
Log in

Recognition results classification and post-processing methods for painted characters on billet surface

  • Published:
Advances in Manufacturing Aims and scope Submit manuscript

Abstract

Automatic identification of characters marked on billets is very important for steelworks to achieve manufacturing and logistics informatization management. Due to the presence of adhesions, fractures, blurs, and other problems in characters painted on billets, character recognition accuracy with machine vision is relatively low, and hardly meets practical application requirements. To make the character recognition results more reliable and accurate, an identification results classification and post-processing method has been proposed in this paper. By analyzing issues in the image segmentation and recognition stage, the recognition result classification model, based on character encoding rules and recognition confidence, is built, and the character recognition results can be classified as correct, suspect, or wrong. In the post-processing stage, a human-machine-cooperation mechanism with a post-processing interface is designed to eliminate error information in suspect and wrong types. The system was developed and experiments conducted with images acquired in an iron and steel factory. The results show the character recognition accuracy to be approximately 89% using the character recognizer. However, this result cannot be directly applied in information management systems. With the proposed post-processing method, a human worker will query the suspect and wrong results classified by the system, determine whether the result is correct or wrong, and then, correct the wrong result through the post-processing interface. Using this method, the character recognition accuracy ultimately improves to 99.4%. Thus, the results will be more reliable applied in a practical system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Alexandria AR, Cortez PC, Felix JHS et al (2014) An OCR system for numerals applied to energy meters. IEEE Latin Am Trans 12(6):957–964

    Article  Google Scholar 

  2. Deng CG, Xiang ZQ, Xie JC et al (2010) Design and study on marking system online for steel products. Comput Integr Manuf Syst 16(9):1859–1865

    Google Scholar 

  3. Agarwal K, Shivpuri R (2014) Knowledge discovery in steel bar rolling mills using scheduling data and automated inspection. J Intell Manuf 25(6):1289–1299

    Article  Google Scholar 

  4. Jia HB, Murphey YL, Shi JJ (2004) An intelligent real-time vision system for surface defect detection. In: Proceedings of the 17th international conference on pattern recognition, Cambridge, UK, pp 239–242

  5. Zhu JN, Mae Y, Minami M (2007) Finding and quantitative evaluation of minute flaws on metal surface using hairline. IEEE Trans Ind Electron 54(3):1420–1429

    Article  Google Scholar 

  6. Bulnes FG, Usamentiaga R, Garcia DF (2011) Vision-based technique for periodical defect detection in hot steel strips. In: Proceedings of IEEE international conference on industry applications society annual meeting, Orlando, FL, pp 1–8

  7. Choi SH, Yun JP, Sim SB (2010) Edge-based text localization and character segmentation algorithms for automatic slab information recognition. In: Proceedings of IEEE international conference on image analysis and signal processing, Zhejiang, China, pp 387–392

  8. Bulnes FG, Usamentiaga R, Garcia DF (2011) Detection of periodical patterns in the defects identified by computer vision systems. In: Proceedings of IEEE international conference on intelligent systems design and applications, Cordoba, Spain, pp 301–306

  9. Li P, Wu SB, Wang LN et al (2013) Automatic recognition system of plate character based on machine vision. Metall Ind Autom 37(4):12–15

    Google Scholar 

  10. Novak V, Hurtik P, Habiballa H et al (2014) Recognition of damaged letters based on mathematical fuzzy logic analysis. J Appl Logic 189(2):497–506

    MathSciNet  MATH  Google Scholar 

  11. Mi ZZ, Xie ZJ, Liu Q (2016) Study of heavy rail mark recognition method based on PSO-SVM. Mod Sci Instrum 6:87–90

    Google Scholar 

  12. Zhao QJ, Cao P, Tu DW (2014) Toward intelligent manufacturing: label characters marking and recognition method for steel products with machine vision. Adv Manuf 2(1):3–12

    Article  Google Scholar 

  13. Huang GB, Kae A, Doersch C et al (2012) Bounding the probability of error for high precision optical character recognition. J Mach Learn Res 13(1):363–387

    MathSciNet  MATH  Google Scholar 

  14. Rico-Juan JR, Calvo-Zaragoza J (2014) Improving classification using a confidence matrix based on weak classifiers applied to OCR. Neurocomputing 151:1354–1361

    Article  Google Scholar 

  15. Navarro-Cerdan JR, Arlandis J, Llobret R et al (2015) Batch-adaptive rejection threshold estimation with application to OCR post-processing. Expert Syst Appl 42(21):8111–8122

    Article  Google Scholar 

  16. Qiu Q, Li Z, Ahmed K et al (2016) A neuromorphic architecture for context aware text image recognition. J Signal Process Syst 84(3):1–15

    Google Scholar 

  17. Zhu A, Gao R, Uchida S (2016) Could scene context be beneficial for scene text detection? Pattern Recognit 58:204–215

    Article  Google Scholar 

  18. Quehl B, Yang H, Sack H (2015) Improving text recognition by distinguishing scene and overlay text. In: Proceedings of SPIE the 7th international conference on machine vision. doi:10.1117/12.2181370

  19. Serrano N, Civera J, Sanchis A et al (2013) Effective balancing error and user effort in interactive handwriting recognition. Pattern Recognit Lett 37(1):135–142

    Google Scholar 

  20. Betta G, Capriglione D, Corvino M et al (2015) A proposal for the management of the measurement uncertainty in classification and recognition problems. IEEE Trans Instrum Meas 64(2):392–402

    Article  Google Scholar 

  21. Kim S, Yu Z, Kil RM et al (2015) Deep learning of support vector machines with class probability output networks. Neural Netw 64:19–28

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mechatronics Engineering and Automation, Shanghai Key Laboratory of Intelligent Manufacturing and Robotics, Shanghai University, Shanghai, 200072, People’s Republic of China

    Qi-Jie Zhao, Chun-Hui Huang, Zhen-Nan Ke & Jin-Gang Yi

Authors
  1. Qi-Jie Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun-Hui Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhen-Nan Ke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin-Gang Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qi-Jie Zhao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, QJ., Huang, CH., Ke, ZN. et al. Recognition results classification and post-processing methods for painted characters on billet surface. Adv. Manuf. 5, 261–270 (2017). https://doi.org/10.1007/s40436-017-0190-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40436-017-0190-9

Keywords

Search

Navigation