Inference statistical analysis of continuous data based on confidence bands—Traditional and new approaches

  • Michael JochEmail author
  • Falko Raoul Döhring
  • Lisa Katharina Maurer
  • Hermann Müller


In the analysis of continuous data, researchers are often faced with the problem that statistical methods developed for single-point data (e.g., t test, analysis of variance) are not always appropriate for their purposes. Either methodological adaptations of single-point methods will need to be made, or confidence bands are the method of choice. In this article, we compare three prominent techniques to analyze continuous data (single-point methods, Gaussian confidence bands, and function-based resampling methods to construct confidence bands) with regard to their testing principles, prerequisites, and outputs in the analysis of continuous data. In addition, we introduce a new technique that combines the advantages of the existing methods and can be applied to a wide range of data. Furthermore, we introduce a method enabling a priori and a posteriori power analyses for experiments with continuous data.


Bootstrap Hypothesis testing Power analysis Time series 


Author note

We thank Heiko Maurer for his methodological and mathematical advice. This research was funded by the Deutsche Forschungsgemeinschaft via the Collaborative Research Center on “Cardinal Mechanisms of Perception” (SFB-TRR 135) and the research projects MU 1374/3-1 and MU 1374 /5-1.

Supplementary material

13428_2018_1060_MOESM1_ESM.m (11 kb)
ESM 1 (M 11.2 kb)
13428_2018_1060_MOESM2_ESM.mat (376 kb)
ESM 2 (MAT 376 kb)


  1. Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7, 1–26.
  2. Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991). Effects of crossmodal divided attention on late ERP components: II. Error processing in choice reaction tasks. Electroencephalography and Clinical Neurophysiology, 78, 447–455. CrossRefPubMedGoogle Scholar
  3. Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993). A neural system for error detection and compensation. Psychological Science, 4, 385–390. CrossRefGoogle Scholar
  4. Joch, M., Hegele, M., Maurer, H., Müller, H., & Maurer, L. K. (2017). Brain negativity as an indicator of predictive error processing : The contribution of visual action effect monitoring. Journal of Neurophysiology, 18, 486–495. CrossRefGoogle Scholar
  5. Lenhoff, M. W., Santner, T. J., Otis, J. C., Peterson, M. G. E., Williams, B. J., & Backus, S. I. (1999). Bootstrap prediction and confidence bands: A superior statistical method for analysis of gait data. Gait and Posture, 9, 10–17. CrossRefPubMedGoogle Scholar
  6. Makeig, S. (1993). Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones. Electroencephalography and Clinical Neurophysiology, 86, 283–293. CrossRefPubMedGoogle Scholar
  7. Makeig, S., Bell, A. J., Jung, T.-P., & Sejnowski, T. J. (1996). Independent component analysis of electroencephalographic data. In D. Touretzky, M. Moser, & M. Hasselmo (Eds.), Advances in neural information processing systems (Vol. 8, pp. 145–151). Cambridge, MA: MIT Press. Google Scholar
  8. Makeig, S., Jung, T. P., Bell, A. J., Ghahremani, D., & Sejnowski, T. J. (1997). Blind separation of auditory event-related brain responses into independent components. Proceedings of the National Academy of Sciences, 94, 10979–10984.CrossRefGoogle Scholar
  9. Maurer, L. K., Maurer, H., & Müller, H. (2015). Neural correlates of error prediction in a complex motor task. Frontiers in Behavioral Neuroscience, 9, 209:1–8. Google Scholar
  10. Müller, H., & Sternad, D. (2004). Decomposition of variability in the execution of goal-oriented tasks: Three components of skill improvement. Journal of Experimental Psychology: Human Perception and Performance, 30, 212–233. PubMedGoogle Scholar
  11. Tukey, J. W. (1958). Bias and confidence in not-quite large samples. Annals of Mathematical Statistics, 29, 614. CrossRefGoogle Scholar
  12. Wilcox, R. R. (2012). Introduction to robust estimation and hypothesis testing (3rd ed.). Amsterdam, The Netherlands: Academic Press. Retrieved from Google Scholar

Copyright information

© Psychonomic Society, Inc. 2018

Authors and Affiliations

  • Michael Joch
    • 1
    Email author
  • Falko Raoul Döhring
    • 1
  • Lisa Katharina Maurer
    • 1
  • Hermann Müller
    • 1
  1. 1.Neuromotor Behavior Laboratory, Department of Psychology and Sport ScienceJustus-Liebig-University GiessenGiessenGermany

Personalised recommendations