Skip to main content

Integrated Analysis and Hypothesis Testing for Complex Spatio-Temporal Data

  • Chapter
  • First Online:
Transactions on Computational Science XXXVII


Analysis of unstructured, complex data is a challenging task that requires a combination of various data analysis techniques, including, among others, deep learning, statistical analysis, and interactive methods. A simple use of individual data analysis techniques addresses only a part of the overall data exploration and analysis challenge. The visual exploration process also requires exploration of what-if scenarios, a continuous and iterative process of generating and testing hypotheses. We describe a comprehensive approach to exploration of complex data that combines automatic and interactive data analysis and hypotheses testing techniques. The proposed approach is illustrated on a publicly available spatio-temporal data set, a collection of bird songs recorded over an extended period of time. Convolutional Neural Network is used to identify and classify bird species from the bird songs data. In addition, two new interactive views, integrated within a coordinated multiple views setup, are introduced: the what-if view and the spectrogram view. The proposed approach is used to develop a unified tool for exploration of bird songs data, called Bird Song Explorer.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others


  1. Abdel-Hamid, O., Mohamed, A.R., Jiang, H., Deng, L., Penn, G., Yu, D.: Convolutional neural networks for speech recognition. IEEE/ACM Trans. Audio Speech Lang. Process. 22(10), 1533–1545 (2014)

    Article  Google Scholar 

  2. Andrienko, G., Andrienko, N., Bak, P., Keim, D., Wrobel, S.: Visual Analytics of Movement. Springer, Berlin (2013).

    Book  Google Scholar 

  3. Chen, W., Guo, F., Wang, F.Y.: A survey of traffic data visualization. IEEE Trans. Intell. Transp. Syst. 16(6), 2970–2984 (2015)

    Article  Google Scholar 

  4. Chollet, F., et al.: Keras (2015).

  5. Choo, J., Liu, S.: Visual analytics for explainable deep learning. IEEE Comput. Graphics Appl. 38(4), 84–92 (2018)

    Article  Google Scholar 

  6. Cibulski, L., Gračanin, D., Diehl, A., Splechtna, R., Elshehaly, M., Delrieux, C., Matković, K.: ITEA–interactive trajectories and events analysis: exploring sequences of spatio-temporal events in movement data. Vis. Comput. 32(6), 847–857 (2016)

    Article  Google Scholar 

  7. Endert, A., et al.: The state of the art in integrating machine learning into visual analytics. Comput. Graph. Forum 36(8), 458–486 (2017)

    Article  Google Scholar 

  8. Ferreira, N., et al.: Birdvis: visualizing and understanding bird populations. IEEE Trans. Visual Comput. Graphics 17(12), 2374–2383 (2011)

    Article  Google Scholar 

  9. Ferreira, N., Poco, J., Vo, H.T., Freire, J., Silva, C.T.: Visual exploration of big spatio-temporal urban data: a study of New York city taxi trips. IEEE Trans. Visual Comput. Graphics 19(12), 2149–2158 (2013)

    Article  Google Scholar 

  10. Giannotti, F., et al.: Unveiling the complexity of human mobility by querying and mining massive trajectory data. VLDB J. 20(5), 695 (2011)

    Article  MathSciNet  Google Scholar 

  11. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)

    MATH  Google Scholar 

  12. Hatcher, W.G., Yu, W.: A survey of deep learning: platforms, applications and emerging research trends. IEEE Access 6, 24411–24432 (2018)

    Article  Google Scholar 

  13. IEEE VIS 2018 Conference: VAST challenge 2018: Mini-challenge 1 (2018), note.

  14. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arxiv:1412.6980v9 [cs.LG],, 30 January 2017

  15. Liu, S., Cui, W., Wu, Y., Liu, M.: A survey on information visualization: recent advances and challenges. Vis. Comput. 30(12), 1373–1393 (2014).

    Article  Google Scholar 

  16. Martinsson, J.: Bird species identification using convolutional neural networks. Master’s thesis in computer science – algorithms, languages and logic, Department of Computer Science and Engineering, Chalmers University of Technology and University of Gothenburg, Gothenburg, Sweden, April 2017

    Google Scholar 

  17. Matković, K., Freiler, W., Gračanin, D., Hauser, H.: ComVis: a coordinated multiple views system for prototyping new visualization technology. In: Proceedings of the 12th International Conference on Information Visualisation (IV 2008), pp. 215–220, 9–11 July 2008

    Google Scholar 

  18. Matković, K., Gračanin, D., Beham, M., Splechtna, R., Meyer, M., Ginina, E.: Visual analysis of bird moving patterns. In: Gavrilova, M., Chang, J., Thalmann, N.M., Hitzer, E., Ishikawa, H. (eds.) CGI 2019. LNCS, vol. 11542, pp. 388–394. Springer, Cham (2019).

    Chapter  Google Scholar 

  19. Matković, K., Gračanin, D., Splechtna, R., Diehl, A., Elshehaly, M., Delrieux, C.: Exploring trajectory data using ComVis CMV tool VAST 2015 mini-challenge 1. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST 2015), pp. 167–168, 25–30 October 2015

    Google Scholar 

  20. Orellana, D., Bregt, A.K., Ligtenberg, A., Wachowicz, M.: Exploring visitor movement patterns in natural recreational areas. Tour. Manag. 33(3), 672–682 (2012)

    Article  Google Scholar 

  21. Piringer, H., Pajer, S., Berger, W., Teichmann, H.: Comparative visual analysis of 2D function ensembles. Comput. Graph. Forum 31(3pt3), 1195–1204 (2012)

    Article  Google Scholar 

  22. Pouyanfar, S., et al.: A survey on deep learning: algorithms, techniques, and applications. ACM Comput. Surv. 51(5), 92:1–92:36 (2018)

    Google Scholar 

  23. Radoš, S., Splechtna, R., Matković, K., Đuras, M., Gröller, E., Hauser, H.: Towards quantitative visual analytics with structured brushing and linked statistics. Comput. Graph. Forum 35(3), 251–260 (2016)

    Article  Google Scholar 

  24. Schlüter, J., Grill, T.: Exploring data augmentation for improved singing voice detection with neural networks. In: Proceedings of the 16th International Society for Music Information Retrieval Conference (ISMIR 2015), pp. 121–126 (2015)

    Google Scholar 

  25. Shaffer, J.P.: Multile hypothesis testing. Annu. Rev. Psychol. 46, 561–584 (1995)

    Article  Google Scholar 

  26. Sprengel, E., Jaggi, M., Kilcher, Y., Hofmann, T.: Audio based bird species identification using deep learning techniques. In: Proceedings of the Conference and Labs of the Evaluation Forum (CLEF) 2016, pp. 547–559, 5–8 September 2016

    Google Scholar 

  27. Takahashi, N., Gygli, M., Pfister, B., Van Gool, L.: Deep convolutional neural networks and data augmentation for acoustic event detection. arxiv:1604.07160v2 [cs.SD],, 8 December 2016

  28. Tufte, E.R.: Envisioning Information. Graphics Press, Cheshire (1990)

    Google Scholar 

  29. Wongsuphasawat, K., et al.: Visualizing dataflow graphs of deep learning models in TensorFlow. IEEE Trans. Visual Comput. Graphics 24(1), 1–12 (2018)

    Article  Google Scholar 

Download references


VRVis is funded by BMK, BMDW, Styria, SFG and Vienna Business Agency in the scope of COMET - Competence Centers for Excellent Technologies (854174) which is managed by FFG. This work also was supported, in part, by a grant from the Virginia Tech Institute for Creativity, Arts, and Technology.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Krešimir Matković .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer-Verlag GmbH Germany, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Matković, K., Gračanin, D., Beham, M., Splechtna, R., Meyer, M., Ginina, E. (2020). Integrated Analysis and Hypothesis Testing for Complex Spatio-Temporal Data. In: Gavrilova, M., Tan, C., Chang, J., Thalmann, N. (eds) Transactions on Computational Science XXXVII. Lecture Notes in Computer Science(), vol 12230. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-61982-7

  • Online ISBN: 978-3-662-61983-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics