Nuclear Power Plant Accident Diagnosis Algorithm Including Novelty Detection Function Using LSTM

  • Jaemin Yang
  • Subong Lee
  • Jonghyun KimEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 965)


Diagnosis of the accident or transient at the nuclear power plants is performed under the judgment of operators based on the procedures. Although procedures given to operators, numerous and rapidly changing parameters are generated by measurements from a variety of indicators and alarms, thus, there can be difficulties or delays to interpret a situation. In order to deal with this problem, many approaches have suggested based on computerized algorithms or networks. Although those studies suggested methods to diagnose accidents, if an unknown (or untrained) accident is given, they cannot respond as they do not know about it. In this light, this study aims at developing an algorithm to diagnose the accidents including “don’t know” response. Long short term memory recurrent neural network and the auto encoder are applied for implementing the algorithm including novelty detection function. The algorithm is validated with various examples regarding untrained cases to demonstrate its feasibility.


LSTM Auto encoder Accident diagnosis Novelty detection 



This research was supported by Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Science, ICT & Future Planning (N01190021-06). Also, it was supported by the NRF grant funded by the Korean government (Ministry of Science and ICT) (2018M2B2B1065651).


  1. 1.
    O’Hara, J., et al.: Human Factors Engineering Program Review Model. United States Nuclear Regulatory Commission, Office of Nuclear Regulatory, Wasington, DC (2012)Google Scholar
  2. 2.
    Loganovsky, K.N., Zdanevich, N.A.: Cerebral basis of posttraumatic stress disorder following the Chernobyl disaster. CNS Spectr. 18(2), 95–102 (2013)CrossRefGoogle Scholar
  3. 3.
    Ohtsuru, A., et al.: Nuclear disasters and health: lessons learned, challenges, and proposals. The Lancet 386(9992), 489–497 (2015)CrossRefGoogle Scholar
  4. 4.
    Woods, D.D.: Coping with complexity: the psychology of human behaviour in complex systems. In: Tasks, Errors, and Mental Models. Taylor & Francis, London (1988)Google Scholar
  5. 5.
    Meister, D.: Cognitive behavior of nuclear reactor operators. Int. J. Ind. Ergon. 16(2), 109–122 (1995)CrossRefGoogle Scholar
  6. 6.
    Vaurio, J.K.: Safety-related decision making at a nuclear power plant. Nucl. Eng. Des. 185(2–3), 335–345 (1998)CrossRefGoogle Scholar
  7. 7.
    de Oliveira, M.V., et al.: HSI for monitoring the critical safety functions status tree of a NPP. (2013)Google Scholar
  8. 8.
    Lee, M.r.: Expert system for nuclear power plant accident diagnosis using a fuzzy inference method. Expert Systems 19(4), 201–207 (2002)CrossRefGoogle Scholar
  9. 9.
    Santosh, T., et al.: Application of artificial neural networks to nuclear power plant transient diagnosis. Reliab. Eng. Syst. Saf. 92(10), 1468–1472 (2007)CrossRefGoogle Scholar
  10. 10.
    Kwon, K.-C., Kim, J.-H.: Accident identification in nuclear power plants using hidden Markov models. Eng. Appl. Artif. Intell. 12(4), 491–501 (1999)CrossRefGoogle Scholar
  11. 11.
    Zio, E.: A support vector machine integrated system for the classification of operation anomalies in nuclear components and systems. Reliab. Eng. Syst. Saf. 92(5), 593–600 (2007)CrossRefGoogle Scholar
  12. 12.
    Fantoni, P., Mazzola, A.: A pattern recognition-artificial neural networks based model for signal validation in nuclear power plants. Ann. Nucl. Energy 23(13), 1069–1076 (1996)CrossRefGoogle Scholar
  13. 13.
    Embrechts, M.J., Benedek, S.: Hybrid identification of nuclear power plant transients with artificial neural networks. IEEE Trans. Industr. Electron. 51(3), 686–693 (2004)CrossRefGoogle Scholar
  14. 14.
    Uhrig, R.E., Hines, J.: Computational intelligence in nuclear engineering. Nucl. Eng. Technol. 37(2), 127–138 (2005)Google Scholar
  15. 15.
    Moshkbar-Bakhshayesh, K., Ghofrani, M.B.: Transient identification in nuclear power plants: A review. Prog. Nucl. Energy 67, 23–32 (2013)CrossRefGoogle Scholar
  16. 16.
    Nabeshima, K., et al.: On-line neuro-expert monitoring system for borssele nuclear power plant. Prog. Nucl. Energy 43(1–4), 397–404 (2003)CrossRefGoogle Scholar
  17. 17.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  18. 18.
    Vinyals, O., et al.: Show and tell: A neural image caption generator. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015)Google Scholar
  19. 19.
    Karpathy, A., L. Fei-Fei.: Deep visual-semantic alignments for generating image descriptions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015)Google Scholar
  20. 20.
    Auli, M., et al.: Joint language and translation modeling with recurrent neural networks (2013)Google Scholar
  21. 21.
    Liwicki, M., et al.: A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. In: Proceedings of the 9th International Conference on Document Analysis and Recognition, ICDAR 2007 (2007)Google Scholar
  22. 22.
    Ma, J., Perkins, S.: Online novelty detection on temporal sequences. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2003)Google Scholar
  23. 23.
    Bartal, Y., Lin, J., Uhrig, R.E.: Nuclear power plant transient diagnostics using artificial neural networks that allow “don’t-know” classifications. Nucl. Technol. 110(3), 436–449 (1995)CrossRefGoogle Scholar
  24. 24.
    Antoˆnio, C.d.A., Martinez, A.S., Schirru, R.: A neural model for transient identification in dynamic processes with “don’t know” response. Ann. Nucl. Energy, 30(13), 1365–1381. (2003)Google Scholar
  25. 25.
    Marchi, E., et al.: A novel approach for automatic acoustic novelty detection using a denoising autoencoder with bidirectional LSTM neural networks. In: Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on (2015)Google Scholar
  26. 26.
    Srivastava, N., Mansimov, E., Salakhudinov, R.: Unsupervised learning of video representations using lstms. In: International Conference on Machine Learning (2015)Google Scholar
  27. 27.
    Gensler, A., et al.: Deep Learning for solar power forecasting—An approach using autoencoder and LSTM neural networks. In: Systems, Man, and Cybernetics (SMC), 2016 IEEE International Conference on (2016)Google Scholar
  28. 28.
    Hochreiter, S., Schmidhuber, J.: Bridging long time lags by weight guessing and “Long Short-Term Memory”. Spatiotemporal Models in Biol. Artif. Syst. 37, 65–72 (1996)Google Scholar
  29. 29.
    Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)
  30. 30.
    Chung, J., et al.: Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555, (2014)
  31. 31.
    Yang, J., Kim, J.: An accident diagnosis algorithm using long short-term memory. Nucl. Eng. Technol. 50(4), 582–588 (2018)CrossRefGoogle Scholar
  32. 32.
    Jain, Y.K., Bhandare, S.K.: Min max normalization based data perturbation method for privacy protection. Int. J. Comput. Commun. Technol. 2(8), 45–50 (2011)Google Scholar
  33. 33.
    Duan, K., et al.: Multi-category classification by soft-max combination of binary classifiers. In: International Workshop on Multiple Classifier Systems. Springer. (2003)Google Scholar
  34. 34.
    Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13(Feb), 281–305 (2012)Google Scholar
  35. 35.
    Snoek, J., Larochelle, H., Adams, R.P. Practical bayesian optimization of machine learning algorithms. In: Advances in Neural Information Processing Systems. (2012)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Nuclear EngineeringChosun UniversityGwangjuRepublic of Korea

Personalised recommendations