The Appropriate Use of Approximate Entropy and Sample Entropy with Short Data Sets
Purchase on Springer.com
$39.95 / €34.95 / £29.95*
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.
Approximate entropy (ApEn) and sample entropy (SampEn) are mathematical algorithms created to measure the repeatability or predictability within a time series. Both algorithms are extremely sensitive to their input parameters: m (length of the data segment being compared), r (similarity criterion), and N (length of data). There is no established consensus on parameter selection in short data sets, especially for biological data. Therefore, the purpose of this research was to examine the robustness of these two entropy algorithms by exploring the effect of changing parameter values on short data sets. Data with known theoretical entropy qualities as well as experimental data from both healthy young and older adults was utilized. Our results demonstrate that both ApEn and SampEn are extremely sensitive to parameter choices, especially for very short data sets, N ≤ 200. We suggest using N larger than 200, an m of 2 and examine several r values before selecting your parameters. Extreme caution should be used when choosing parameters for experimental studies with both algorithms. Based on our current findings, it appears that SampEn is more reliable for short data sets. SampEn was less sensitive to changes in data length and demonstrated fewer problems with relative consistency.
- Aboy, M., D. Cuesta-Frau, D. Austin, and P. Mico-Tormos. Characterization of sample entropy in the context of biomedical signal analysis. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2007:5943–5946, 2007.
- Bar-Yam, Y. Dynamics of Complex Systems. Boulder, CO: Westview Press, 2003.
- Cavanaugh, J. T., N. Kochi, and N. Stergiou. Nonlinear analysis of ambulatory activity patterns in community-dwelling older adults. J. Gerontol. A Biol. Sci. Med. Sci. 65:197–203, 2010. CrossRef
- Chen, X., I. Solomon, and K. Chon. Comparison of the use of approximate entropy and sample entropy: applications to neural respiratory signal. Conf. Proc. IEEE Eng. Med. Biol. Soc. 4:4212–4215, 2005.
- Chon, K., C. G. Scully, and S. Lu. Approximate entropy for all signals. IEEE Eng. Med. Biol. Mag. 28:18–23, 2009. CrossRef
- Costa, M., A. L. Goldberger, and C. K. Peng. Multiscale entropy analysis of biological signals. Phys. Rev. E 71:021906, 2005. CrossRef
- Cuesta-Frau, D., P. Miro-Martinez, S. Oltra-Crespo, M. Varela-Entrecanales, M. Aboy, D. Novak, and D. Austin. Measuring body temperature time series regularity using approximate entropy and sample entropy. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2009:3461–3464, 2009.
- Deffeyes, J. E., R. T. Harbourne, W. A. Stuberg, and N. Stergiou. Approximate entropy used to assess sitting postural sway of infants with developmental delay. Infant Behav. Dev. 34:81–99, 2011. CrossRef
- Faure, P., and H. Korn. Is there chaos in the brain? I. Concepts of nonlinear dynamics and methods of investigation. C. R. Acad. Sci. III 324:773–793, 2011. CrossRef
- Gell-Mann, M. The Quark and the Jaguar: Adventures in the Simple and the Complex. New York: Owl Books, 1994.
- Georgoulis, A. D., C. Moraiti, S. Ristanis, and N. Stergiou. A novel approach to measure variability in the anterior cruciate ligament deficient knee during walking: the use of the approximate entropy in orthopaedics. J. Clin. Monit. Comput. 20:11–18, 2006. CrossRef
- Grabiner, M. D., and K. L. Troy. Attention demanding tasks during treadmill walking reduce step width variability in young adults. J. Neuroeng. Rehabil. 2:25, 2005. CrossRef
- Hong, S. L., and K. M. Newell. Motor entropy in response to task demands and environmental information. Chaos 18:033131, 2008. CrossRef
- Kaipust, J. P., J. M. Huisinga, M. Filipi, and N. Stergiou. Gait variability measures reveal differences between multiple sclerosis patients and healthy controls. Mot. Control 16:229–244, 2012.
- Karmakar, C. K., A. H. Khandoker, R. K. Begg, M. Palaniswami, and S. Taylor. Understanding ageing effects by approximate entropy analysis of gait variability. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2007:1965–1968, 2007.
- Khandoker, A. H., M. Palaniswami, and R. K. Begg. A comparative study on approximate entropy measure and poincaré plot indexes of minimum foot clearance variability in the elderly during walking. J. Neuroeng. Rehabil. 5:4, 2008. CrossRef
- Korn, H., and P. Faure. Is there chaos in the brain? II. Experimental evidence and related models. C. R. Biol. 326:787–840, 2003. CrossRef
- Kurz, M. J., and J. G. Hou. Levodopa influences the regularity of the ankle joint kinematics in individuals with Parkinson’s disease. J. Comput. Neurosci. 28:131–136, 2010. CrossRef
- Lake, D. E., J. S. Richman, M. P. Griffin, and J. R. Moorman. Sample entropy analysis of neonatal heart rate variability. Am. J. Physiol. Regul. Integr. Comp. Physiol. 283:R789–R797, 2002.
- Lamoth, C. J. C., E. Ainsworth, W. Polomski, and H. Houdijk. Variability and stability analysis of walking of transfemoral amputees. Med. Eng. Phys. 32:1009–1014, 2010. CrossRef
- Lamoth, C. J., F. J. van Deudekom, J. P. van Campen, B. A. Appels, O. J. de Vries, and M. Pijnappels. Gait stability and variability measures show effects of impaired cognition and dual tasking in frail people. J. Neuroeng. Rehabil. 8:2, 2011. CrossRef
- Lipsitz, L. A. Dynamics of stability: the physiologic basis of functional health and frailty. J. Gerontol. A Biol. Sci. Med. Sci. 57:115–125, 2002. CrossRef
- Lipsitz, L. A., and A. L. Goldberger. Loss of ‘complexity’ and aging. Potential applications of fractals and chaos theory to senescence. JAMA 267:1806–1809, 1992. CrossRef
- Liu, C., C. Liu, P. Shao, L. Li, X. Sun, X. Wang, and F. Liu. Comparison of different threshold values r for approximate entropy: application to investigate the heart rate variability between heart failure and healthy control groups. Physiol. Meas. 32:167–180, 2011. CrossRef
- Lu, S., X. Chen, J. Kanters, I. C. Solomon, and K. H. Chon. Automatic selection of the threshold value R for approximate entropy. IEEE Trans. Biomed. Eng. 55:1966–1972, 2008. CrossRef
- Mayer-Kress, G., Y. Liu, and K. M. Newell. Complex systems and human movement. Complexity 12:40–51, 2006. CrossRef
- Molina-Picó, A., D. Cuesta-Frau, M. Aboy, C. Crespo, P. Miró-Martínez, and S. Oltra-Crespo. Comparative study of approximate entropy and sample entropy robustness to spikes. Artif. Intell. Med. 53:97–106, 2011. CrossRef
- Myers, S. A., N. Stergiou, I. I. Pipinos, and J. M. Johanning. Gait variability patterns are altered in healthy young individuals during the acute reperfusion phase of ischemia-reperfusion. J. Surg. Res. 164:6–12, 2010. CrossRef
- Pincus, S. Approximate entropy as a measure of system-complexity. Proc. Natl Acad. Sci. U.S.A. 88:2297–2301, 1991. CrossRef
- Pincus, S. Approximate entropy (ApEn) as a complexity measure. Chaos 5:110–117, 1995. CrossRef
- Pincus, S., and W. Huang. Approximate entropy—statistical properties and applications. Commun. Stat. Theory Methods 21:3061–3077, 1992. CrossRef
- Rathleff, M. S., A. Samani, C. G. Olesen, U. G. Kersting, and P. Madeleine. Inverse relationship between the complexity of midfoot kinematics and muscle activation in patients with medial tibial stress syndrome. J. Electromyogr. Kinesiol. 21:638–644, 2011. CrossRef
- Rhea, C. K., T. A. Silver, S. L. Hong, J. H. Ryu, B. E. Studenka, C. M. L. Hughes, and J. M. Haddad. Noise and complexity in human postural control: interpreting the different estimations of entropy. PLoS ONE 6:e17696, 2011. CrossRef
- Richman, J. S., and J. R. Moorman. Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Heart Circ. Physiol. 278:H2039–H2049, 2000.
- Rose, M. H., T. Bandholm, and B. R. Jensen. Approximate entropy based on attempted steady isometric contractions with the ankle dorsal- and plantarflexors: reliability and optimal sampling frequency. J. Neurosci. Methods 177:212–216, 2009. CrossRef
- Sarlabous, L., A. Torres, J. A. Fiz, J. Gea, J. Martinez-Llorens, J. Morera, and R. Jane. Interpretation of the approximate entropy using fixed tolerance values as a measure of amplitude variations in biomedical signals. Conf. Proc. IEEE Eng. Med. Biol. Soc. 5967–5970:2010, 2010.
- Smith, B. A., C. Teulier, J. Sansom, N. Stergiou, and B. D. Ulrich. Approximate entropy values demonstrate impaired neuromotor control of spontaneous leg activity in infants with myelomeningocele. Pediatr. Phys. Ther. 23:241–247, 2011. CrossRef
- Sosnoff, J. J., M. D. Goldman, and R. W. Motl. Real-life walking impairment in multiple sclerosis: preliminary comparison of four methods for processing accelerometry data. Mult. Scler. 16:868–877, 2010. CrossRef
- Stergiou, N., R. Harbourne, and J. Cavanaugh. Optimal movement variability: a new theoretical perspective for neurologic physical therapy. J. Neurol. Phys. Ther. 30:120–129, 2006.
- Turnock, M. J. E., and C. S. Layne. Variations in linear and nonlinear postural measurements under achilles tendon vibration and unstable support-surface conditions. J. Mot. Behav. 42:61–69, 2010. CrossRef
- Wolf, A., J. B. Swift, H. L. Swinney, and J. A. Vastano. Determining Lyapunov exponents from a time-series. Physica D 16:285–317, 1985. CrossRef
- The Appropriate Use of Approximate Entropy and Sample Entropy with Short Data Sets
Annals of Biomedical Engineering
Volume 41, Issue 2 , pp 349-365
- Cover Date
- Print ISSN
- Online ISSN
- Springer US
- Additional Links
- Step length
- Step width
- Step time
- Nonlinear analysis
- Industry Sectors
- Author Affiliations
- 1. Nebraska Biomechanics Core Facility, Department of Health, Physical Education, and Recreation, University of Nebraska at Omaha, 6001 Dodge Street, HPER 207, Omaha, NE, 68182, USA
- 2. Department of Biostatistics, College of Public Health, University of Nebraska Medical Center, 984355 Nebraska Medical Center, Omaha, NE, 68198, USA
- 3. Department of Environmental, Agricultural & Occupational Health, College of Public Health, University of Nebraska Medical Center, 984355 Nebraska Medical Center, Omaha, NE, 68198, USA