Abstract
Emerging technologies for physiological signals and data collection enable the monitoring of patient health and well-being in real-life settings. This requires novel methods and tools to compare the validity of this kind of information with that acquired in controlled environments using more costly and sophisticated technologies. In this paper, we describe a method and a MATLAB tool that relies on a standard sequence of statistical tests to compare features obtained using novel techniques with those acquired by means of benchmark procedures. After introducing the key steps of the proposed statistical analysis method, this paper describes its implementation in a MATLAB app, developed to support researchers in testing the extent to which a set of features, captured with a new methodology, can be considered a valid surrogate of that acquired employing gold standard techniques. An example of the application of the tool is provided in order to validate the method and illustrate the graphical user interface (GUI). The app development in MATLAB aims to improve its accessibility, foster its rapid adoption among the scientific community and its scalability into wider MATLAB tools.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bland, J.M., Altman, D.G.: Measuring agreement in method comparison studies. Stat. Methods Med. Res. 8(2), 135–160 (1999)
Serrao, M., Chini, G., Bergantino, M., Sarnari, D., Casali, C., Conte, C., Ranavolo, A., Marcotulli, C., Rinaldi, M., Coppola, G., Bini, F., Pierelli, F., Marinozzi, F.: Identification of specific gait patterns in patients with Cerebellar Ataxia, spastic paraplegia and Parkinson’s disease: a non-hierarchical cluster analysis. Hum. Move. Sci. 57, 267–279 (2018)
Marinozzi, F., Bini, F., Marinozzi, A., Zuppante, F., De Paolis, A., Pecci, R., Bedini, R.: Technique for bone volume measurement from human femur head samples by classification of micro-CT image histograms. Ann. I. Super. Sanità 49(3), 300–305 (2013)
Pecchia, L., Castaldo, R., Montesinos, L., Melillo, P.: Are ultra-short heart rate variability features good surrogates of short-term ones? State-of-the-art review and recommendations. Healthc. Technol. Lett. 5(3), 94–100 (2018)
Brisinda, D., Venuti, A., Cataldi, C., Efremov, K., Intorno, E., Fenici, R.: Real-time imaging of stress-induced cardiac autonomic adaptation during realistic force-on-force police scenarios. J. Police Crim. Psychol. 30(2), 71–86 (2015)
Fleming, T.R., DeMets, D.L.: Surrogate end points in clinical trials: are we being misled? Ann. Intern. Med. 125(7), 605–613 (1996)
Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3–4), 591–611 (1965)
Shapiro, S.S., Francia, R.S.: An approximate analysis of variance test for normality. J. Am. Stat. Assoc. 67(337), 215–216 (1972)
Lilliefors, H.W.: On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J. Am. Stat. Assoc. 62(318), 399–402 (1967)
Anderson, T.W., Darling, D.A.: Asymptotic theory of certain “goodness of fit” criteria based on stochastic processes. Ann. Math. Stat. 23(2), 193–212 (1952)
Thode, H.C.: Testing for Normality. Marcel Dekker, New York (2002)
Razali, N.M., Yap, B.W.: Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests. J. Stat. Model. Anal. 2(1), 21–33 (2011)
Ahad, N.A., Yin, T.S., Othman, A.R., Yaacob, C.R.: Sensitivity of normality tests to non-normal data. Sains Malays. 40(6), 637–641 (2011)
Mukaka, M.M.: Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med. J. 24(3), 69–71 (2012)
Hinkle, D.E., Wiersma, W., Jurs, S.G.: Applied Statistics for the Behavioural Sciences. Houghton Mifflin, Boston (2003)
Bland, J.M., Altman, D.G.: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1(8476), 307–310 (1986)
Sedgwick, P.: Limits of agreement (Bland-Altman method). BMJ 346(1630) (2013)
Nahm, F.S.: Nonparametric statistical tests for the continuous data: the basic concept and the practical use. Korean J. Anesthesiol. 69(1), 8–14 (2016)
Castaldo, R., Melillo, P., Bracale, U., Caserta, M., Triassi, M., Pecchia, L.: Acute mental stress assessment via short term HRV analysis in healthy adults: a systematic review with meta-analysis. Biomed. Signal Process. Control 18, 370–377 (2015)
Pecchia, L., Melillo, P., Sansone, M., Bracale, M.: Discrimination power of short-term heart rate variability measures for CHF assessment. IEEE Trans. Inf. Technol. Biomed. 15(1), 46 (2011)
Athavale, Y., Krishnan, S.: Biosignal monitoring using wearables: observations and opportunities. Biomed. Signal Process. Control 38, 22–33 (2017)
Melillo, P., Bracale, M., Pecchia, L.: Nonlinear heart rate variability features for real-life stress detection. Case study: students under stress due to university examination. BioMed. Eng. OnLine 10, 96 (2011)
MathWorks. https://uk.mathworks.com/matlabcentral/fileexchange/13964-shapiro-wilk-and-shapiro-francia-normality-tests. Accessed 28 Dec 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors declare that they have no conflict of interest.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ajo’, S., Piaggio, D., Taher, M., Marinozzi, F., Bini, F., Pecchia, L. (2021). A MATLAB App to Assess, Compare and Validate New Methods Against Their Benchmarks. In: Jarm, T., Cvetkoska, A., Mahnič-Kalamiza, S., Miklavcic, D. (eds) 8th European Medical and Biological Engineering Conference. EMBEC 2020. IFMBE Proceedings, vol 80. Springer, Cham. https://doi.org/10.1007/978-3-030-64610-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-64610-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64609-7
Online ISBN: 978-3-030-64610-3
eBook Packages: EngineeringEngineering (R0)