Accented Visualization in Digital Industry Applications
Abstract
The paper proposes a new approach of accented visualization useful to develop system architectures implementing interactive user interfaces in digital industry applications. The proposed solution is suitable for image data processing, analysis, virtualization and presentation based on Augmented Reality and the Internet of Things. Accentuated visualization is based on adaptive construction and virtual consideration of the content of the current real scene in the field of view of a person, as well as the viewer’s experience that contains perceptions, points of view and expected behavior. The proposed approach was implemented in a specialized intelligent system for manual operation control. Such a system implements the ideas of Industry 4.0 for smart manufacturing by introduction of cyber-physical decision-making support. The overall solution is used to identify gaps and failures of operator in real time, predict possible operating mistakes and suggest better procedures based on comparing the sequence of actions to an experience of highly qualified operators captured in knowledge base. There are presented the results of solution industrial implementation using neural networks and AR accented visualization in practice.
Keywords
Augmented reality Smart manufacturing Industry 4.0 Ontology Decision-making supportReferences
- 1.Digital Russia. New Reality. Digital McKinsey, 133 p. (2017). https://www.mckinsey.com/ru/our-work/mckinsey-digital
- 2.Lasi, H., Kemper, H.-G., Fettke, P., Feld, T., Hoffmann, M.: Industry 4.0. Bus. Inf. Syst. Eng. 4(6), 239–242 (2014)CrossRefGoogle Scholar
- 3.Kagermann, H., Wahlster, W., Helbig, J. (eds.): Recommendations for implementing the strategic initiative Industrie 4.0: Final report of the Industrie 4.0 Working Group, 82 p. (2013)Google Scholar
- 4.Hersent, O., Boswarthick, D., Elloumi, O.: The Internet of Things: Key Applications and Protocols, 370 p. Wiley, Chichester (2012)Google Scholar
- 5.Ivaschenko, A., Novikov, A., Kosov, D., Kuzmin, V.: Moving sensors concept for distributed diagnostics. In: IEEE SAI Intelligent Systems Conference 2015, London, UK, pp. 1051–1053 (2015)Google Scholar
- 6.Bessis, N., Dobre, C.: Big Data and Internet of Things: A Roadmap for Smart Environments, 450 p. Springer (2014)Google Scholar
- 7.Baesens, B.: Analytics in a Big Data World: The Essential Guide to Data Science and Its Applications, 232 p. Wiley (2014)Google Scholar
- 8.Surnin, O.L., Sitnikov, P.V., Ivaschenko, A.V., Ilyasova, N.Yu., Popov, S.B.: Big data incorporation based on open services provider for distributed enterprises. In: CEUR Workshop Proceedings, Proceedings of the International Conference Information Technology and Nanotechnology, Session Data Science (DS-ITNT 2017), vol. 190, pp. 42–47 (2017)Google Scholar
- 9.Holzinger, A.: Extravaganza tutorial on hot ideas for interactive knowledge discovery and data mining in biomedical informatics. Lecture Notes in Computer Science, vol. 8609, pp. 502–515 (2014)Google Scholar
- 10.Sturm, W., Schreck, T., Holzinger, A., Ullrich, T.: Discovering medical knowledge using visual analytics–a survey on methods for systems biology and *omics data. In: Eurographics Workshop on VCBM, Eurographics (EG), pp. 71–81 (2015)Google Scholar
- 11.Holzinger, A.: Interactive machine learning for health informatics: when do we need the human-in-the-loop? Brain Inform. 3(2), 119–131 (2016)CrossRefGoogle Scholar
- 12.Van Krevelen, R.: Augmented reality: technologies, applications, and limitations (2007). https://doi.org/10.13140/rg.2.1.1874.7929
- 13.Navab, N.: Developing killer apps for industrial augmented reality. IEEE Comput. Graph. Appl. 24(3), 16–20 (2004)CrossRefGoogle Scholar
- 14.Singh, M., Singh, M.P.: Augmented reality interfaces. IEEE Internet Comput. 17(6), 66–70 (2013)CrossRefGoogle Scholar
- 15.Ke, C., Kang, B., Chen, D., Li, X.: An augmented reality based application for equipment maintenance. In: Tao, J., Tan, T., Picard, R.W. (eds.) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol. 3784, pp. 836–841. Springer, Heidelberg (2005)CrossRefGoogle Scholar
- 16.Lee, K.: Augmented reality in education and training. TechTrends 56, 13–21 (2012)CrossRefGoogle Scholar
- 17.Friedrich, W.: ARVIKA: augmented reality for development, production and service. Siemens AG, Automation and Drives Advanced Technologies and Standards (2003)Google Scholar
- 18.Ivaschenko, A., Milutkin, M., Sitnikov, P.: Accented visualization in maintenance AR guides. In: Proceedings of SCIFI-IT 2017, Belgium, EUROSIS-ETI, pp. 42–45 (2017)Google Scholar
- 19.Ivaschenko, A., Khorina, A., Sitnikov, P.: Accented visualization by augmented reality for smart manufacturing applications. In: 2018 IEEE Industrial Cyber-Physical Systems (ICPS), pp. 519–522. ITMO University, Saint Petersburg (2018)Google Scholar
- 20.Ivaschenko, A., Sitnikov, P., Milutkin, M., Khasanov, D., Krivosheev, A.: AR optimization for interactive user guides. In: Proceedings of Intelligent Systems Conference (IntelliSys) 2018, 6–7 September 2018, London, UK, pp. 1183–1186 (2018)Google Scholar
- 21.ImageNet. http://www.image-net.org. Accessed 30 Nov 2018