Skip to main content
SpringerLink
Log in

PEVis: visual analytics of potential anomaly pattern evolution for temporal multivariate data

  • Regular Paper
  • Published:
Journal of Visualization Aims and scope Submit manuscript

Abstract

The availability of massive temporal multivariate data provides unprecedented opportunities to analyze anomaly pattern evolution. However, due to the complicated relationships and dynamic temporality, it is a challenging problem to efficiently reveal and perceive the evolution of abnormal patterns. Existing methods mostly focus on the use of automated algorithms to capture anomalies, which limits the understanding of the evolutionary law. In this paper, we propose a novel visual analytics system, PEVis, to help domain experts extract four types of abnormal evolution patterns and quantitatively analyze the contribution of different features to its occurrence. By aggregating different anomaly detection algorithms, the anomalous data that deviate seriously from other densely distributed points or with small isolated clusters can be identified. A strategy for perceiving temporal multivariate data is proposed to solve the conflict between exploring the global time-varying law and local data distribution in visualization, through aligning dimension reduction space of adjacent timestamp and designing a doughnut glyph to visually display data distribution and feature contributions. Experiments on two real-world datasets, namely air quality index data and consumer price index data, demonstrate that the proposed methods can effectively reveal the seasonal variation of abnormal phenomena.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Bach B, Dragicevic P, Archambault D, Hurter C, Carpendale S (2014) A review of temporal data visualizations based on space-time cube operations. In: 16th Eurographics conference on visualization, EuroVis 2014-state of the art reports, Swansea, UK, June 9–13, pp 1–19

  • Bach B, Shi C, Heulot N, Madhyastha TM, Grabowski TJ, Dragicevic P (2016) Time curves: folding time to visualize patterns of temporal evolution in data. IEEE Trans Vis Comput Graph 22(1):559–568

    Article  Google Scholar 

  • Bach B, Dragicevic P, Archambault D, Hurter C, Carpendale S (2017) A descriptive framework for temporal data visualizations based on generalized space-time cubes. Comput Graph Forum 36(6):36–61

    Article  Google Scholar 

  • Breunig MM, Kriegel H, Ng RT, Sander J (2000) LOF: identifying density-based local outliers. In: Chen W, Naughton JF, Bernstein PA (eds) Proceedings of the 2000 ACM SIGMOD international conference on management of data, May 16–18, ACM, Dallas, TX, USA, pp 93–104

  • Cao N, Shi C, Lin WS, Lu J, Lin Y, Lin C (2016) Targetvue: visual analysis of anomalous user behaviors in online communication systems. IEEE Trans Vis Comput Graph 22(1):280–289

    Article  Google Scholar 

  • Cao N, Lin Y, Gotz D, Du F (2018) Z-glyph: visualizing outliers in multivariate data. Inf Vis 17(1):22–40

    Article  Google Scholar 

  • Chandola V, Banerjee A, Kumar V (2009) Anomaly detection: a survey. ACM Comput Surv 41(3):15:1-15:58

    Article  Google Scholar 

  • Chen Y, Lv C, Li Y, Chen W, Ma K (2020) Ordered matrix representation supporting the visual analysis of associated data. Sci China Inf Sci 63(8):1–3

    Article  Google Scholar 

  • Cui W, Wang X, Liu S, Riche NH, Madhyastha TM, Ma K, Guo B (2014) Let it flow: a static method for exploring dynamic graphs. In: IEEE Pacific visualization symposium, PacificVis 2014, Yokohama, Japan, March 4–7, 2014. IEEE Computer Society, pp 121–128

  • Deng Z, Weng D, Chen J, Liu R, Wang Z, Bao J, Zheng Y, Wu Y (2020) Airvis: visual analytics of air pollution propagation. IEEE Trans Vis Comput Graph 26(1):800–810

    Google Scholar 

  • Fan X, Li C, Yuan X, Dong X, Liang J (2019) An interactive visual analytics approach for network anomaly detection through smart labeling. J Vis 22(5):9715–99

    Article  Google Scholar 

  • Fujiwara T, Chou J, McCullough AM, Ranganath C, Ma K (2017) A visual analytics system for brain functional connectivity comparison across individuals, groups, and time points. In: 2017 IEEE Pacific visualization symposium, PacificVis 2017, Seoul, South Korea, April 18–21, 2017. IEEE Computer Society, pp 250–259

  • Fujiwara T, Chou J, Shilpika XuP, Ren L, Ma K (2020) An incremental dimensionality reduction method for visualizing streaming multidimensional data. IEEE Trans Vis Comput Graph 26(1):418–428

    Article  Google Scholar 

  • Guo S, Xu K, Zhao R, Gotz D, Zha H, Cao N (2018) Eventthread: visual summarization and stage analysis of event sequence data. IEEE Trans Vis Comput Graph 24(1):56–65

    Article  Google Scholar 

  • Han J, Kamber M, Pei J (2011) Data mining: concepts and techniques, 3rd edn. Morgan Kaufmann

  • Jäckle D, Fischer F, Schreck T, Keim DA (2016) Temporal MDS plots for analysis of multivariate data. IEEE Trans Vis Comput Graph 22(1):141–150

    Article  Google Scholar 

  • Kaijuan Y, Siwei F, Yingcai GXW (2020) Understanding evolution patterns in multiple sequences of dynamic graphs. J Comput Aided Des Comput Graph 32(10):1655–1662

    Google Scholar 

  • Knorr EM, Ng RT (1999) Finding intensional knowledge of distance-based outliers. In: VLDB’99, Proceedings of 25th international conference on very large data bases, September 7–10, 1999, Edinburgh, Scotland, UK. Morgan Kaufmann, pp 211–222

  • Kriegel H, Kröger P, Schubert E, Zimek A (2011) Interpreting and unifying outlier scores. In: Proceedings of the eleventh SIAM international conference on data mining, SDM 2011, April 28–30, 2011, Mesa, Arizona, USA. SIAM/Omnipress, pp 13–24

  • Liu FT, Ting KM, Zhou Z (2012) Isolation-based anomaly detection. ACM Trans Knowl Discov Data 6(1):3:1–3:39:66

    Google Scholar 

  • Liu N, Shin D, Hu X (2018) Contextual outlier interpretation. In: Lang J (ed) Proceedings of the twenty-seventh international joint conference on artificial intelligence (IJCAI 2018), July 13–19, 2018, Stockholm, Sweden, pp 2461–2467. ijcai.org

  • Liu D, Veeramachaneni K, Geiger A, Li VOK, Qu H (2021) Aqeyes: visual analytics for anomaly detection and examination of air quality data. CoRR, arxiv:abs/2103.12910

  • Loorak MH, Perin C, Kamal N, Hill MD, Carpendale S (2016) Timespan: using visualization to explore temporal multi-dimensional data of stroke patients. IEEE Trans Vis Comput Graph 22(1):409–418

    Article  Google Scholar 

  • Muelder C, Zhu B, Chen W, Zhang H, Ma K (2016) Visual analysis of cloud computing performance using behavioral lines. IEEE Trans Vis Comput Graph 22(6):1694–1704

    Article  Google Scholar 

  • Ramaswamy S, Rastogi R, Shim K (2000) Efficient algorithms for mining outliers from large data sets. In: Chen W, Naughton JF, Bernstein PA (eds) Proceedings of the 2000 ACM SIGMOD international conference on management of data, May 16–18, 2000, ACM, Dallas, TX, USA, pp 427–438

  • Stitz H, Gratzl S, Aigner W, Streit M (2016) Thermalplot: visualizing multi-attribute time-series data using a thermal metaphor. IEEE Trans Vis Comput Graph 22(16):2594–2607

    Article  Google Scholar 

  • Stopar L, Skraba P, Grobelnik M, Mladenic D (2019) Streamstory: exploring multivariate time series on multiple scales. IEEE Trans Vis Comput Graph 25(4):1788–1802

    Article  Google Scholar 

  • Tang H, Wei S, Zhou Z, Qian ZC, Chen YV (2019) Treeroses: outlier-centric monitoring and analysis of periodic time series data. J Vis 22(5):1005–1019

    Article  Google Scholar 

  • Wu Y, Xie X, Wang J, Deng D, Liang H, Zhang H, Cheng S, Chen W (2019) Forvizor: visualizing spatio-temporal team formations in soccer. IEEE Trans Vis Comput Graph 25(1):65–75

    Article  Google Scholar 

  • Wu Y, Weng D, Deng Z, Bao J, Xu M et al (2021) Towards better detection and analysis of massive spatiotemporal co-occurrence patterns. IEEE Trans Intell Transp Syst 22(6):3387–3402

    Article  Google Scholar 

  • Xu K, Xia M, Mu X, Wang Y, Cao N (2019) Ensemblelens: ensemble-based visual exploration of anomaly detection algorithms with multidimensional data. IEEE Trans Vis Comput Graph 25(1):109–119

    Article  Google Scholar 

  • Xu J, Tao Y, Yan Y, Lin H (2020a) Exploring evolution of dynamic networks via diachronic node embeddings. IEEE Trans Vis Comput Graph 26(7):2387–2402

  • Xu K, Wang Y, Yang L, Wang Y, Qiao B, Qin S, Xu Y, Zhang H, Qu H (2020b) Clouddet: interactive visual analysis of anomalous performances in cloud computing systems. IEEE Trans Vis Comput Graph 26(1):1107–1117

  • Yue X, Shu X, Zhu X, Du X, Yu Z, Papadopoulos D, Liu S (2019) Bitextract: interactive visualization for extracting bitcoin exchange intelligence. IEEE Trans Vis Comput Graph 25(1):162–171

    Article  Google Scholar 

  • Zhao J, Cao N, Wen Z, Song Y, Lin Y, Collins C (2014) #fluxflow: visual analysis of anomalous information spreading on social media. IEEE Trans Vis Comput Graph 20(12):1773–1782

    Article  Google Scholar 

  • Zhao Y, Luo X, Lin X, Wang H, Kui X, Zhou F, Wang J, Chen Y, Chen W (2020) Visual analytics for electromagnetic situation awareness in radio monitoring and management. IEEE Trans Vis Comput Graph 26(1):590–600

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China under Grant 42171450, the Key Research and Development Project of Science and Technology Development Plan of Science and Technology Department of Jilin Province No. 20210201074GX, National Natural Science Foundation of China under Grant 41671379 and National Key R&D Program of China No. 2020YFA0714102.

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Information Processing of Jilin Universities, School of Information Science and Technology, Northeast Normal University, Changchun, 130024, China

    Cheng Lv, Ke Ren, Huijie Zhang, Jia Fu & Yiming Lin

Authors
  1. Cheng Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ke Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huijie Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jia Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yiming Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huijie Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lv, C., Ren, K., Zhang, H. et al. PEVis: visual analytics of potential anomaly pattern evolution for temporal multivariate data. J Vis 25, 575–591 (2022). https://doi.org/10.1007/s12650-021-00807-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12650-021-00807-6

Keywords

Search

Navigation