Accented Visualization in Digital Industry Applications

  • Anton IvaschenkoEmail author
  • Pavel Sitnikov
  • Georgiy Katirkin
Conference paper
Part of the Studies in Systems, Decision and Control book series (SSDC, volume 199)


The paper proposes a new approach of accented visualization useful to develop system architectures implementing interactive user interfaces in digital industry applications. The proposed solution is suitable for image data processing, analysis, virtualization and presentation based on Augmented Reality and the Internet of Things. Accentuated visualization is based on adaptive construction and virtual consideration of the content of the current real scene in the field of view of a person, as well as the viewer’s experience that contains perceptions, points of view and expected behavior. The proposed approach was implemented in a specialized intelligent system for manual operation control. Such a system implements the ideas of Industry 4.0 for smart manufacturing by introduction of cyber-physical decision-making support. The overall solution is used to identify gaps and failures of operator in real time, predict possible operating mistakes and suggest better procedures based on comparing the sequence of actions to an experience of highly qualified operators captured in knowledge base. There are presented the results of solution industrial implementation using neural networks and AR accented visualization in practice.


Augmented reality Smart manufacturing Industry 4.0 Ontology Decision-making support 


  1. 1.
    Digital Russia. New Reality. Digital McKinsey, 133 p. (2017).
  2. 2.
    Lasi, H., Kemper, H.-G., Fettke, P., Feld, T., Hoffmann, M.: Industry 4.0. Bus. Inf. Syst. Eng. 4(6), 239–242 (2014)CrossRefGoogle Scholar
  3. 3.
    Kagermann, H., Wahlster, W., Helbig, J. (eds.): Recommendations for implementing the strategic initiative Industrie 4.0: Final report of the Industrie 4.0 Working Group, 82 p. (2013)Google Scholar
  4. 4.
    Hersent, O., Boswarthick, D., Elloumi, O.: The Internet of Things: Key Applications and Protocols, 370 p. Wiley, Chichester (2012)Google Scholar
  5. 5.
    Ivaschenko, A., Novikov, A., Kosov, D., Kuzmin, V.: Moving sensors concept for distributed diagnostics. In: IEEE SAI Intelligent Systems Conference 2015, London, UK, pp. 1051–1053 (2015)Google Scholar
  6. 6.
    Bessis, N., Dobre, C.: Big Data and Internet of Things: A Roadmap for Smart Environments, 450 p. Springer (2014)Google Scholar
  7. 7.
    Baesens, B.: Analytics in a Big Data World: The Essential Guide to Data Science and Its Applications, 232 p. Wiley (2014)Google Scholar
  8. 8.
    Surnin, O.L., Sitnikov, P.V., Ivaschenko, A.V., Ilyasova, N.Yu., Popov, S.B.: Big data incorporation based on open services provider for distributed enterprises. In: CEUR Workshop Proceedings, Proceedings of the International Conference Information Technology and Nanotechnology, Session Data Science (DS-ITNT 2017), vol. 190, pp. 42–47 (2017)Google Scholar
  9. 9.
    Holzinger, A.: Extravaganza tutorial on hot ideas for interactive knowledge discovery and data mining in biomedical informatics. Lecture Notes in Computer Science, vol. 8609, pp. 502–515 (2014)Google Scholar
  10. 10.
    Sturm, W., Schreck, T., Holzinger, A., Ullrich, T.: Discovering medical knowledge using visual analytics–a survey on methods for systems biology and *omics data. In: Eurographics Workshop on VCBM, Eurographics (EG), pp. 71–81 (2015)Google Scholar
  11. 11.
    Holzinger, A.: Interactive machine learning for health informatics: when do we need the human-in-the-loop? Brain Inform. 3(2), 119–131 (2016)CrossRefGoogle Scholar
  12. 12.
    Van Krevelen, R.: Augmented reality: technologies, applications, and limitations (2007).
  13. 13.
    Navab, N.: Developing killer apps for industrial augmented reality. IEEE Comput. Graph. Appl. 24(3), 16–20 (2004)CrossRefGoogle Scholar
  14. 14.
    Singh, M., Singh, M.P.: Augmented reality interfaces. IEEE Internet Comput. 17(6), 66–70 (2013)CrossRefGoogle Scholar
  15. 15.
    Ke, C., Kang, B., Chen, D., Li, X.: An augmented reality based application for equipment maintenance. In: Tao, J., Tan, T., Picard, R.W. (eds.) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol. 3784, pp. 836–841. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  16. 16.
    Lee, K.: Augmented reality in education and training. TechTrends 56, 13–21 (2012)CrossRefGoogle Scholar
  17. 17.
    Friedrich, W.: ARVIKA: augmented reality for development, production and service. Siemens AG, Automation and Drives Advanced Technologies and Standards (2003)Google Scholar
  18. 18.
    Ivaschenko, A., Milutkin, M., Sitnikov, P.: Accented visualization in maintenance AR guides. In: Proceedings of SCIFI-IT 2017, Belgium, EUROSIS-ETI, pp. 42–45 (2017)Google Scholar
  19. 19.
    Ivaschenko, A., Khorina, A., Sitnikov, P.: Accented visualization by augmented reality for smart manufacturing applications. In: 2018 IEEE Industrial Cyber-Physical Systems (ICPS), pp. 519–522. ITMO University, Saint Petersburg (2018)Google Scholar
  20. 20.
    Ivaschenko, A., Sitnikov, P., Milutkin, M., Khasanov, D., Krivosheev, A.: AR optimization for interactive user guides. In: Proceedings of Intelligent Systems Conference (IntelliSys) 2018, 6–7 September 2018, London, UK, pp. 1183–1186 (2018)Google Scholar
  21. 21.
    ImageNet. Accessed 30 Nov 2018

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Samara State Technical UniversitySamaraRussia
  2. 2.ITMO UniversitySaint-PetersburgRussia
  3. 3.SEC “Open Code”SamaraRussia

Personalised recommendations