Abstract
The capability to efficiently handling and analysing data streams in industrial processes and industrial cyber-physical systems (ICPS) is critical for digitalisation and renewal of current manufacturing industry. A key problem within this context is to provide scalable capability to collect, process, analyse, and visualise data streams to support these ICPSs. The status of these systems continuously changes, and analysts must understand and act upon such changes often in real time. Visualisation tools are increasingly used by analysts to get insights from these changes, but inconveniently nowadays, analysts have to store the data from the Industrial Data Stream to a data storage system and then use some visualisation tools to be able to visualise the data to help them understand and act promptly. In this paper, we propose to integrate visualisation and analysis primitives transparently into the query language of the Data Stream Management System (DSMS) and we show a proof of concept by a successful integration of an operator that can execute query-based visualisation methods that support processing of continuous numerical queries over streaming data in industrial analytics applications. We will also show how we are benefiting from the meta data in DSMSs to perform dimensionality reduction in real time to identify a two, three, four, or five-dimensional representation of the numerical query results on the data stream which preserve the salient relationships in the results and how the operator can suggest the most appropriate visualisation of the data to the analyst.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Evans, P.C., Annunziata, M.: Industrial internet: pushing the boundaries of minds and machines. In: General Electric (2012)
Lee, J., Bagheri, B., Kao, H.-A.: A cyber-physical systems architecture for Industry 4.0-based manufacturing systems. Manuf. Lett. 3, 18–23 (2015)
Brettel, M., Friederichsen, N., Keller, M., Rosenberg, M.: How virtualization, decentralization and network building change the manufacturing landscape: an Industry 4.0 perspective. Int. J. Mech. Aerosp. Indust. Mechatron. Manuf. Eng. 8(1), 37–44 (2014)
Kennedy, S.: Made in China 2025, Center for Strategic & International Studies, 1 June 2015. [Online]. http://csis.org/publication/made-china-2025. Accessed 21 Oct 2015
Abadi, D., et al.: The Beckman report on database research. ACM SIGMOD Record 43(3), 61–70 (2014). Also in CACM 59(2) (2016)
Markl, V.: Breaking the chains: on declarative data analysis and data independence in the Big Data era. In: Proceedings of the VLDB Endowment from the 40th International Conference on Very Large Data Bases, Hangzhou, China, vol. 7, no. 13 (2014)
Keim, D.A., Mansmann, F., Schneidewind, J., Thomas, J., Ziegler, H.: Visual analytics: scope and challenges. In: Simoff, S.J., Böhlen, M.H., Mazeika, A. (eds.) Visual Data Mining. LNCS, vol. 4404, pp. 76–90. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-71080-6_6
Wu, E., Battle, L., Madden, S.R.: The case for data visualization management systems: vision paper. Proc. VLDB Endowm. 7(10), 903–906 (2014)
Melander, L., Orsborn, K., Risch, T.: Visualization of Continuous Queries Using a Visual Data Flow Programming Language. (submitted to DASFAA 2017)
Melander, L.: Integrating visual data flow programming with data stream management, PhD thesis, Department of Information Technology, Uppsala University, Uppsala, Sweden (2016). ISBN:978-91-506-2583-7
Egenhofer, M.J.: Spatial SQL: a query and presentation language. IEEE Trans. Knowl. Data Eng. 6(1) (1994)
Chan, E.P.F., Wong, J.M.T.: Querying and visualization of geometric data. In: Proceedings of the Fourth ACM Workshop on Advances in Geographic Information Systems, Rockville, pp. 129–138 (1996)
Kurc, T., Chang, C., Ferreira, R., Sussman, A., Saltz, J.: Querying very large multi-dimensional datasets in ADR, conference on high performance networking and computing. In: Proceedings of the 1999 ACM/IEEE conference on Supercomputing, Portland, 13–19 November 1999
Pourabbas, E., Rafanelli M.: PQL: an extended pictorial query language for querying geographical databases using positional and OLAP operators. In: Proceedings of the 7th International Symposium on Advances in Geographic Information Systems (ACM-GIS 1999), Kansas City, 2–6 November 1999
Keahey, T.A., McCormick, P.S., Ahrens, J.P., Keahey, K.: Qviz: a framework for querying and visualizing data. In: Erbacher, R.F., Chen, P.C., Roberts, J.C., Wittenbrink, C.M., Groehn, M. (eds.) Proceedings of SPIE: Visual Data Exploration and Analysis VIII, vol. 4302, pp. 259–267 (2001)
Battle, L., Stonebraker, M., Chang, R.: Dynamic reduction of query result sets for interactive visualization. IEEE BigData (2013)
Liu, Z., Jiang, B., Heer, J.: imMens: real-time visual querying of Big Data. In: Eurographics Conference on Visualization (EuroVis) 2013, vol. 32(203), no. 3 (2013)
Vartak, M., Madden, S., Parameswaran, A., Polyzotis, N.: SEEDB: automatically generating query visualizations. In: Proceedings of the VLDB Endowment from the 40th International Conference on Very Large Data Bases, Hangzhou, vol. 7, no. 13 (2014)
Traub, J., Steenbergen, N., Drulich, P.M., Rabl, T., Markl, V.: I\(^{2}\): interactive real-time visualization for streaming data. In: Proceedings of 20th International Conference on Extending Database Technology, Venice (2017)
Industrial Digitalization in China. http://www.gcis.com.cn/china-insights-en/industry-articles-en/238-industrial-digitalization-in-china. Accessed Mar 2022
Thunman, M.: How edge analytics can help manufacturers overcome obstacles associated with more equipment data (2021). https://www.automation.com/en-us/articles/may-2021/how-edge-analytics-help-manufacturers-data
Dasgupta, A., Arendt, D.L., Franklin, L.R., Wong, P.C., Cook, K.A.: Human factors in streaming data analysis: challenges and opportunities for information visualization. Comput. Graph. Forum 37, 254–272 (2018). https://doi.org/10.1111/cgf.13264
Kaur, J.: Real-time streaming data visualizations (2021). https://www.xenonstack.com/blog/streaming-data-visualizations
What is Streaming Analytics: Stream Processing, Data Streaming, and Real-time Analytics (2020). https://www.altexsoft.com/blog/real-time-analytics/
Baker, P.: The best data visualization tools for 2020 (2019). https://uk.pcmag.com/cloud-services/83744/the-best-data-visualization-tools-for-2020
Lutu, P.E.N.: The use of histogram analysis to support fast selection of predictive features for data stream mining. In: 2018 International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD), pp. 1–6 (2018). https://doi.org/10.1109/ICABCD.2018.8465411
Casillas, J., Wang, S., Yao, X.: Concept drift detection in histogram-based straightforward data stream prediction. In: 2018 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 878–885 (2018). https://doi.org/10.1109/ICDMW.2018.00129
Acknowledgements
This project is supported by eSSENCE through the Swedish Foundation for Strategic Research, grant RIT08-0041.
Thanks and appreciation to Matteo Magnani who reviewed this paper and provided valuable feedback and insights.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Nadir, M.I., Orsborn, K. (2022). Visualisation of Numerical Query Results on Industrial Data Streams. In: Chiusano, S., et al. New Trends in Database and Information Systems. ADBIS 2022. Communications in Computer and Information Science, vol 1652. Springer, Cham. https://doi.org/10.1007/978-3-031-15743-1_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-15743-1_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15742-4
Online ISBN: 978-3-031-15743-1
eBook Packages: Computer ScienceComputer Science (R0)