Advertisement

Sports Medicine

, Volume 38, Issue 4, pp 297–316 | Cite as

Validity, Reliability and Sensitivity of Measures of Sporting Performance

  • Kevin Currell
  • Asker E. JeukendrupEmail author
Review Article

Abstract

Performance testing is one of the most common and important measures used in sports science and physiology. Performance tests allow for a controlled simulation of sports and exercise performance for research or applied science purposes. There are three factors that contribute to a good performance test: (i) validity; (ii) reliability; and (iii) sensitivity. A valid protocol is one that resembles the performance that is being simulated as closely as possible. When investigating race-type events, the two most common protocols are time to exhaustion and time trials. Time trials have greater validity than time to exhaustion because they provide a good physiological simulation of actual performance and correlate with actual performance. Sports such as soccer are more difficult to simulate. While shuttle-running protocols such as the Loughborough Intermittent Shuttle Test may simulate physiology of soccer using time to exhaustion or distance covered, it is not a valid measure of soccer performance. There is a need to include measures of skill in such protocols. Reliability is the variation of a protocol. Research has shown that time-to-exhaustion protocols have a coefficient of variation (CV) of >10%, whereas time trials are more reliable as they have been shown to have a CV of <5%. A sensitive protocol is one that is able to detect small, but important, changes in performance. The difference between finishing first and second in a sporting event is <1%. Therefore, it is important to be able to detect small changes with performance protocols. A quantitative value of sensitivity may be accomplished through the signal : noise ratio, where the signal is the percentage improvement in performance and the noise is the CV.

Keywords

Time Trial Performance Protocol Match Play Cycling Time Trial Repeated Sprint Ability 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Notes

Acknowledgements

No sources of funding were used to assist in the preparation of this review. The authors have no conflicts of interest that are directly relevant to the content of this review.

References

  1. 1.
    Jeukendrup A, Saris WHM, Brouns F, et al. A new validated endurance performance test. Med Sci Sports Exerc 1996; 28 (2): 266–70PubMedGoogle Scholar
  2. 2.
    Hopkins WG, Schabort EJ, Hawley JA. Reliability of power in physical performance tests. Sports Med 2001; 31 (3): 211–34PubMedGoogle Scholar
  3. 3.
    Atkinson G. Sport performance: variable or construct? J Sports Sci 2002; 20 (4): 291–2PubMedGoogle Scholar
  4. 4.
    Reilly T, Gilbourne D. Science and football: a review of applied research in the football codes. J Sports Sci 2003; 21 (9): 693–705PubMedGoogle Scholar
  5. 5.
    Halson SL, Bridge MW, Meeusen R, et al. Time course of performance changes and fatigue markers during intensified training in trained cyclists. J Appl Physiol 2002; 93 (3): 947–56PubMedGoogle Scholar
  6. 6.
    Hopkins WG. Measures of reliability in sports medicine and science. Sports Med 2000; 30 (1): 1–15PubMedGoogle Scholar
  7. 7.
    Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med 1998; 26 (4): 217–38PubMedGoogle Scholar
  8. 8.
    Thomas JR, Nelson JK. Research methods in physical activity. Champaign (IL): Human Kinetics, 1990Google Scholar
  9. 9.
    Thomas JR, Nelson JK. Research methods in physical activity. Champaign (IL): Human Kinetics, 2001Google Scholar
  10. 10.
    Hawley JA, Noakes TD. Peak power output predicts maximal oxygen uptake and performance time in trained cyclists. Eur J Appl Physiol 1992; 65 (1): 79–83Google Scholar
  11. 11.
    Williams C, Nute MG, Broadbank L, et al. Influence of fluid intake on endurance running performance: a comparison between water, glucose and fructose solutions. Eur J Appl Physiol Occup Physiol 1990; 60 (2): 112–9PubMedGoogle Scholar
  12. 12.
    Foster C, Green MA, Snyder AC, et al. Physiological responses during simulated competition. Med Sci Sports Exerc 1993; 25 (7): 877–82PubMedGoogle Scholar
  13. 13.
    Palmer GS, Hawley JA, Dennis SC, et al. Heart rate responses during a 4−d cycle stage race. Med Sci Sports Exerc 1994; 26 (10): 1278–83PubMedGoogle Scholar
  14. 14.
    Liedl MA, Swain DP, Branch JD. Physiological effects of constant versus variable power during endurance cycling. Med Sci Sports Exerc 1999; 31 (10): 1472–7PubMedGoogle Scholar
  15. 15.
    Palmer GS, Borghouts LB, Noakes TD, et al. Metabolic and performance responses to constant—load vs variable—intensity exercise in trained cyclists. J Appl Physiol 1999; 87 (3): 1186–96PubMedGoogle Scholar
  16. 16.
    Laursen PB, Rhodes EC, Langill RH, et al. Relationship of exercise test variables to cycling performance in an Ironman triathlon. Eur J Appl Physiol 2002; 87 (4-5): 433–40PubMedGoogle Scholar
  17. 17.
    Palmer GS, Dennis SC, Noakes TD, et al. Assessment of the reproducibility of performance testing on an air—braked cycle ergometer. Int J Sports Med 1996; 17 (4): 293–8PubMedGoogle Scholar
  18. 18.
    Russell RD, Redmann SM, Ravussin E, et al. Reproducibility of endurance performance on a treadmill using a preloaded time trial. Med Sci Sports Exerc 2004; 36 (4): 717–24PubMedGoogle Scholar
  19. 19.
    Smith MF, Davison RC, Balmer J, et al. Reliability of mean power recorded during indoor and outdoor self—paced 40 km cycling time—trials. Int J Sports Med 2001; 22 (4): 270–4PubMedGoogle Scholar
  20. 20.
    Elliott B, Lyttle A, Birkett O. The rowperfect ergometer; a training aid for on water single scull rowing. Sports Biomech 2002; 1 (2): 123–34PubMedGoogle Scholar
  21. 21.
    Helgerud J, Engen LC, Wisloff U, et al. Aerobic endurance training improves soccer performance. Med Sci Sports Exerc 2001; 33 (11): 1925–31PubMedGoogle Scholar
  22. 22.
    Zeederberg C, Leach L, Lambert EV, et al. The effect of carbohydrate ingestion on the motor skill proficiency of soccer players. Int J Sport Nutr 1996; 6 (4): 348–55PubMedGoogle Scholar
  23. 23.
    Di Salvo V, Collins A, Mc Neill B, et al. Validation of prozone: a new video based performance analysis system. Int J Perf Analysis Sport 2006; 6 (1): 108–19Google Scholar
  24. 24.
    Drust B, Reilly T, Cable NT. Physiological responses to laboratory—based soccer—specific intermittent and continuous exercise. J Sports Sci 2000; 18 (11): 885–92PubMedGoogle Scholar
  25. 25.
    Reilly T, Thomas V. A motion analysis of work—rate in different positional roles in professional football match play. J Hum Move Stud 1976; 2: 87–97Google Scholar
  26. 26.
    Thatcher R, Betterham A. Development and validation of a sport specific exercise protocol for elite youth players. J Sports Med Phys Fitness 2004; 44 (1): 15–22PubMedGoogle Scholar
  27. 27.
    MP G, Mc Naughton LR, Lovell R. Physiological and mechanical response to soccer specific intermittent activity and steady state activity. Res Sports Med 2006; 14 (1): 29–52Google Scholar
  28. 28.
    Nicholas CW, Nuttall FE, Williams C. The Loughborough Intermittent Shuttle Test: a field test that simulates the activity pattern of soccer. J Sports Sci 2000; 18 (2): 97–104PubMedGoogle Scholar
  29. 29.
    Bangsbo J, Lindquist F. Comparison of various exercise tests with endurance performance during soccer in professional players. Int J Sports Med 1992; 13 (2): 125–32PubMedGoogle Scholar
  30. 30.
    Rampinini E, Bishop D, Marcora S, et al. Validity of simple field tests as indicators of match related physical performance in top level professional soccer players. Int J Sport Med 2007; 28 (3): 228–35Google Scholar
  31. 31.
    Krustrup P, Mohr M, Amstrup T, et al. The yo—yo intermittent recovery test: physiological response, reliability, and validity. Med Sci Sports Exerc 2003; 35 (4): 697–705PubMedGoogle Scholar
  32. 32.
    Abt G, Zhou S, Weatherby R. The effect of a high—carbohydrate diet on the skill performance of midfield soccer players after intermittent treadmill exercise. J Sci Med Sport 1998; 1 (4): 203–12PubMedGoogle Scholar
  33. 33.
    Cox G, Mujika I, Tumilty D, et al. Acute creatine supplementation and performance during a field test simulating match play in elite female soccer players. Int J Sport Nutr Exerc Metab 2002; 12 (1): 33–46PubMedGoogle Scholar
  34. 34.
    Welsh RS, Davis JM, Burke JR, et al. Carbohydrates and physical/mental performance during intermittent exercise to fatigue. Med Sci Sports Exerc 2002; 34 (4): 723–31PubMedGoogle Scholar
  35. 35.
    Mc Gregor SJ, Nicholas CW, Lakomy HK, et al. The influence of intermittent high—intensity shuttle running and fluid ingestion on the performance of a soccer skill. J Sports Sci 1999; 17 (11): 895–903Google Scholar
  36. 36.
    Ostojic S, Mazic S. Effects of a carbohydrate—electrolyte drink on specific soccer tests and performance. J Sports Sci Med 2002; 1: 47–53Google Scholar
  37. 37.
    Vergauwen L, Spaepen AJ, Lefevre J, et al. Evaluation of stroke performance in tennis. Med Sci Sports Exerc 1998; 30 (8): 1281–8PubMedGoogle Scholar
  38. 38.
    Williams AM. Perceptual skill in soccer: implications for talent identification and development. J Sports Sci 2000; 18 (9): 737–50PubMedGoogle Scholar
  39. 39.
    Bagger M, Petersen PH, Pedersen PK. Biological variation in variables associated with exercise training. Int J Sports Med 2003; 24 (6): 433–40PubMedGoogle Scholar
  40. 40.
    Vincent W. Statistics in kinesiology. 3rd ed. Champaign (IL): Human Kinetics, 2005Google Scholar
  41. 41.
    Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; I (8476): 307–10Google Scholar
  42. 42.
    Lindsay FH, Hawley JA, Myburgh KH, et al. Improved athletic performance in highly trained cyclists after interval training. Med Sci Sports Exerc 1996; 28 (11): 1427–34PubMedGoogle Scholar
  43. 43.
    Coggan AR, Costill DL. Biological and technological variability of three anaerobic ergometer tests. Int J Sports Med 1984; 5 (3): 142–5PubMedGoogle Scholar
  44. 44.
    Graham K, Mc Lellan T. Variability of time to exhaustion and oxygen deficit in supramaximal exercise. Aust J Sci Med Sport 1989; 21 (4): 11–4Google Scholar
  45. 45.
    Billat V, Renoux JC, Pinoteau J, et al. Reproducibility of running time to exhaustion at V̇O2max in subelite runners. Med Sci Sports Exerc 1994; 26 (2): 254–7PubMedGoogle Scholar
  46. 46.
    Laursen PB, Francis GT, Abbiss CR, et al. Reliability of time to exhaustion versus time trial running tests in runners. Med Sci Sports Exerc 2007; 39 (8): 1374–9PubMedGoogle Scholar
  47. 47.
    Mc Lellan TM, Cheung SS, Jacobs I. Variability of time to exhaustion during submaximal exercise. Can J Appl Physiol 1995; 20 (1): 39–51Google Scholar
  48. 48.
    Krebs P, Powers S. Reliability of laboratory endurance tests [abstract]. Med Sci Sports Exerc 1989; 21: S10Google Scholar
  49. 49.
    Maughan RJ, Fenn CE, Leiper JB. Effects of fluid, electrolyte and substrate ingestion on endurance capacity. Eur J Appl Physiol Occup Physiol 1989; 58 (5): 481–6PubMedGoogle Scholar
  50. 50.
    Gleser MA, Vogel JA. Endurance exercise: effect of work—rest schedules and repeated testing. J Appl Physiol 1971; 31 (5): 735–9PubMedGoogle Scholar
  51. 51.
    Hickey MS, Costill DL, Mc Conell sGK, et al. Day to day variation in time trial cycling performance. Int J Sports Med 1992; 13 (6): 467–70PubMedGoogle Scholar
  52. 52.
    Hodges K, Hancock S, Currell K, et al. Pseudoephedrine enhances performance in 1500−m runners. Med Sci Sports Exerc 2006; 38 (2): 329–33PubMedGoogle Scholar
  53. 53.
    Jensen K, Johansen L. Reproducibility and validity of physiological parameters measured in cyclists riding on racing bikes placed on a stationary magnetic brake. Scand J Med Sci Sports 1998; 8 (1): 1–6PubMedGoogle Scholar
  54. 54.
    Nicholson RM, Sleivert GG. Indices of lactate threshold and their relationship with 10−km running velocity. Med Sci Sports Exerc 2001; 33 (2): 339–42PubMedGoogle Scholar
  55. 55.
    Currell K, Jentjens R, Jeukendrup A. Reliability of a cycling time trial in a glycogen depleted state. Eur J Appl Physiol 2006; 98 (6): 583–9PubMedGoogle Scholar
  56. 56.
    Tan F, Aziz A. Reproducibility of outdoor flat and uphill cycling time trials and their performance correlates with peak power output in moderately trained cyclists. J Sports Sci Med 2005; 4: 278–84Google Scholar
  57. 57.
    Laursen PB, Shing CM, Jenkins DG. Reproducibility of a laboratory—based 40−km cycle time—trial on a stationary wind—trainer in highly trained cyclists. Int J Sports Med 2003; 24 (7): 481–5PubMedGoogle Scholar
  58. 58.
    Widrick JJ, Costill DL, Fink WJ, et al. Carbohydrate feedings and exercise performance: effect of initial muscle glycogen concentration. J Appl Physiol 1993; 74 (6): 2998–3005PubMedGoogle Scholar
  59. 59.
    Schabort EJ, Hawley JA, Hopkins WG, et al. A new reliable laboratory test of endurance performance for road cyclists. Med Sci Sports Exerc 1998; 30 (12): 1744–50PubMedGoogle Scholar
  60. 60.
    Madsen K, Mac Lean DA, Kiens B, et al. Effects of glucose, glucose plus branched—chain amino acids, or placebo on bike performance over 100 km. J Appl Physiol 1996; 81 (6): 2644–50PubMedGoogle Scholar
  61. 61.
    Doherty M, Balmer J, Davison RC, et al. Reliability of a combined 3−min constant load and performance cycling test. Int J Sports Med 2003; 24 (5): 366–71PubMedGoogle Scholar
  62. 62.
    Paton CD, Hopkins WG. Ergometer error and biological variation in power output in a performance test with three cycle ergometers. Int J Sports Med 2006; 27 (6): 444–7PubMedGoogle Scholar
  63. 63.
    Bishop D. Reliability of a 1−h endurance performance test in trained female cyclists. Med Sci Sports Exerc 1997; 29 (4): 554–9PubMedGoogle Scholar
  64. 64.
    Schabort EJ, Hopkins WG, Hawley JA. Reproducibility of self—paced treadmill performance of trained endurance runners. Int J Sports Med 1998; 19 (1): 48–51PubMedGoogle Scholar
  65. 65.
    Hinckson EA, Hopkins WG. Reliability of time to exhaustion analyzed with critical—power and log—log modeling. Med Sci Sports Exerc 2005; 37 (4): 696–701PubMedGoogle Scholar
  66. 66.
    Jeukendrup AE, Currell K. Should time trial performance be predicted from three serial time—to—exhaustion tests? Med Sci Sports Exerc 2005; 37 (10): 1820; author reply 1821PubMedGoogle Scholar
  67. 67.
    Soper G, Hume PA. Reliability of power output during rowing changes with ergometer type and race distance. Sports Biomech 2004; 3 (2): 237–48PubMedGoogle Scholar
  68. 68.
    American College of Sports Medicine, American Dietetic Association, Dietitians of Canada. Joint position statement: nutrition and athletic performance. Med Sci Sports Exerc 2000; 32 (12): 2130–45Google Scholar
  69. 69.
    Rauch HG, St Clair Gibson A, Lambert EV, et al. A signalling role for muscle glycogen in the regulation of pace during prolonged exercise. Br J Sports Med 2005; 39 (1): 34–8PubMedGoogle Scholar
  70. 70.
    Schabort EJ, Hawley JA, Hopkins WG, et al. High reliability of performance of well—trained rowers on a rowing ergometer. J Sports Sci 1999; 17 (8): 627–32PubMedGoogle Scholar
  71. 71.
    Mohr M, Krustrup P, Bangsbo J. Match performance of high standard soccer players with special reference to developement of fatigue. J Sport Sci 2003; 21 (7): 519–28Google Scholar
  72. 72.
    Rampinini E, Coutts A, Castagna C, et al. Variation in top level soccer match performance. Int J Sport Med 2007; 28 (12): 1018–24Google Scholar
  73. 73.
    Di Salvo V, Baron R, Tschan H, et al. Performance characteristics according to playing position in elite soccer. Int J Sport Med 2007; 28 (3): 222–7Google Scholar
  74. 74.
    Weston M, Castagna C, Impellizzeri FM, et al. Analysis of physical match performance in English Premier League soccer referees with particular reference to first half and player work rates. J Sci Med Sport 2007; 10 (6): 390–7PubMedGoogle Scholar
  75. 75.
    Krustrup P, Mohr M, Nybo L, et al. The Yo—Yo IR2 test: physiological response, reliability, and application to elite soccer. Med Sci Sports Exerc 2006; 38 (9): 1666–73PubMedGoogle Scholar
  76. 76.
    Mc Gregor SJ, Hulse M, Strudwick A, et al. The reliability and validity of two tests of soccer skill [abstract]. J Sport Sci 1999; 17: 815Google Scholar
  77. 77.
    Avery C, Richardson P, Jackson W. A practical tennis serve test: measurement of skill under simulated game conditions. Res Q Exerc Sport 1998; 50: 554–64Google Scholar
  78. 78.
    Percell K. A tennis forehand—backhand drive skill test which measures ball control and stroke firmness. Res Q Exerc Sport 1981; 52: 238–45Google Scholar
  79. 79.
    Hopkins WG, Hawley JA, Burke LM. Design and analysis of research on sport performance enhancement. Med Sci Sports Exerc 1999; 31 (3): 472–85PubMedGoogle Scholar
  80. 80.
    Paton CD, Hopkins WG. Tests of cycling performance. Sports Med 2001; 31 (7): 489–96PubMedGoogle Scholar
  81. 81.
    Hopkins WG, Hewson DJ. Variability of competitive performance of distance runners. Med Sci Sports Exerc 2001; 33 (9): 1588–92PubMedGoogle Scholar
  82. 82.
    Jeukendrup AE, Martin J. Improving cycling performance: how should we spend our time and money. Sports Med 2001; 31 (7): 559–69PubMedGoogle Scholar
  83. 83.
    Jeukendrup AE. Carbohydrate intake during exercise and performance. Nutrition 2004; 20 (7-8): 669–77PubMedGoogle Scholar
  84. 84.
    Jeukendrup AE, Brouns F, Wagenmakers AJM, et al. Carbohydrate feedings improve 1 h trial cycling performance. Int J Sports Med 1997; 18: 125–9PubMedGoogle Scholar
  85. 85.
    Davis JM, Lamb DR, Pate RR, et al. Carbohydrate—electrolyte drinks: effects on endurance cycling in the heat. Am J Clin Nutr 1988; 48 (4): 1023–30PubMedGoogle Scholar
  86. 86.
    Carter J, Jeukendrup AE, Mundel T, et al. Carbohydrate supplementation improves moderate and high—intensity exercise in the heat. Pflugers Arch 2003; 446 (2): 211–9PubMedGoogle Scholar
  87. 87.
    Chryssanthopoulos C, Hennessy LC, Williams C. The influence of pre—exercise glucose ingestion on endurance running capacity. Br J Sports Med 1994; 28 (2): 105–9PubMedGoogle Scholar
  88. 88.
    Wilber RL, Moffatt RJ. Influence of carbohydrate ingestion on blood glucose and performance in runners. Int J Sport Nutr 1992; 2 (4): 317–27PubMedGoogle Scholar
  89. 89.
    Coggan AR, Coyle EF. Metabolism and performance following carbohydrate ingestion late in exercise. Med Sci Sports Exerc 1989; 21 (1): 59–65PubMedGoogle Scholar
  90. 90.
    Laursen PB, Shing CM, Peake JM, et al. Interval training program optimization in highly trained endurance cyclists. Med Sci Sports Exerc 2002; 34 (11): 1801–7PubMedGoogle Scholar
  91. 91.
    St Clair Gibson A, Noakes TD. Evidence for complex system integration and dynamic neural regulation of skeletal muscle recruitment during exercise in humans. Br J Sports Med 2004; 38 (6): 797–806Google Scholar
  92. 92.
    Hulleman M, De Koning JJ, Hettinga F, et al. The effect of extrinsic motivation on cycle time trial performance. Med Sci Sports Exerc 2007; 39 (4): 709–15PubMedGoogle Scholar
  93. 93.
    Atkinson G, Wilson D, Eubank M. Effects of music on work rate distribution during a cycling time trial. Int J Sports Med 2004; 25 (8): 611–5PubMedGoogle Scholar
  94. 94.
    Pujol TJ, Langenfeld ME. Influence of music on Wingate Anaerobic Test performance. Percept Mot Skills 1999; 88 (1): 292–6PubMedGoogle Scholar
  95. 95.
    Karageorghis CI, Terry PC. The psychological effects of music in sport and exercise: a review. J Sports Behav 1997; 20 (1): 54–68Google Scholar
  96. 96.
    Szmedra L, Bacharach DW. Effect of music on perceived exertion, plasma lactate, norepinephrine and cardiovascular hemodynamics during treadmill running. Int J Sports Med 1998; 19 (1): 32–7PubMedGoogle Scholar
  97. 97.
    Boutcher S, Trenske M. The effects of sensory deprivation and music on perceived exertion and affect during exercise. J Sport Exerc Psychol 1990; 12: 167–76Google Scholar
  98. 98.
    Nikolopoulos V, Arkinstall MJ, Hawley JA. Pacing strategy in simulated cycle time—trials is based on perceived rather than actual distance. J Sci Med Sport 2001; 4 (2): 212–9PubMedGoogle Scholar
  99. 99.
    Paterson S, Marino FE. Effect of deception of distance on prolonged cycling performance. Percept Motor Skills 2004; 98: 1017–26PubMedGoogle Scholar
  100. 100.
    Nethery VM. Competition between internal and external sources of information during exercise: influence on RPE and the impact of the exercise load. J Sports Med Phys Fitness 2002; 42 (2): 172–8PubMedGoogle Scholar
  101. 101.
    Jentjens RL, Jeukendrup AE. Effects of pre—exercise ingestion of trehalose, galactose and glucose on subsequent metabolism and cycling performance. Eur J Appl Physiol 2003; 88 (4-5): 459–65PubMedGoogle Scholar

Copyright information

© Adis Data Information BV 2008

Authors and Affiliations

  1. 1.School of Sport and Exercise SciencesUniversity of BirminghamEdgbastonUK

Personalised recommendations