Advertisement

International Journal of Public Health

, Volume 61, Issue 3, pp 329–336 | Cite as

Test–retest reliability of the scale of participation in organized activities among adolescents in the Czech Republic and Slovakia

  • Lucia Bosakova
  • Peter Kolarcik
  • Daniela Bobakova
  • Martina Sulcova
  • Jitse P. Van Dijk
  • Sijmen A. Reijneveld
  • Andrea Madarasova Geckova
Original Article

Abstract

Objectives

Participation in organized activities is related with a range of positive outcomes, but the way such participation is measured has not been scrutinized. Test–retest reliability as an important indicator of a scale’s reliability has been assessed rarely and for “The scale of participation in organized activities” lacks completely. This test–retest study is based on the Health Behaviour in School-aged Children study and is consistent with its methodology.

Methods

We obtained data from 353 Czech (51.9 % boys) and 227 Slovak (52.9 % boys) primary school pupils, grades five and nine, who participated in this study in 2013. We used Cohen’s kappa statistic and single measures of the intraclass correlation coefficient to estimate the test–retest reliability of all selected items in the sample, stratified by gender, age and country.

Results

We mostly observed a large correlation between the test and retest in all of the examined variables (κ ranged from 0.46 to 0.68). Test–retest reliability of the sum score of individual items showed substantial agreement (ICC = 0.64).

Conclusions

The scale of participation in organized activities has an acceptable level of agreement, indicating good reliability.

Keywords

Organized activities Adolescents HBSC Test–retest Reliability 

Notes

Acknowledgments

This work was supported by the Slovak Research and Development Agency under Contract No. APVV-0032-11 and by the IGA UP research project “Leisure Time in School-aged Children—HBSC Study”, Reg. No. FTK_2013_020, by the Grant Agency of the Czech Republic through the project “Social determinants of health in socially and physically disadvantaged and other groups of population” (Reg. No. CZ.1.07/2.3.00/20.0063) and by the ECOP project “Strengthening the scientific potential of research teams in promoting physical activity at Palacky University” Reg. No. CZ.1.07/2.3.00/20.0171.

Compliance with ethical standards

Conflict of interest

The authors declare no conflict of interest.

References

  1. Agans JP, Champine RB, DeSouza LM, Mueller MK, Johnson SK, Lerner RM (2014) Activity involvement as an ecological asset: profiles of participation and youth outcomes. J Youth Adolesc 43:919–932CrossRefPubMedGoogle Scholar
  2. Allen MJ, Yen WM (1979) Introduction to measurement theory. Brooks/Cole, MontereyGoogle Scholar
  3. Badura P, Madarasova Geckova A, Sigmundova D, van Dijk JP, Reijneveld SA (2015) When children play, they feel better: organized activity participation and health in adolescents (Under revision in BMC Public Health)Google Scholar
  4. Bobakova D, Hamrik Z, Badura P, Sigmundova D, Nalecz H, Kalman M (2015) Test–retest reliability of selected physical activity and sedentary behaviour HBSC items in the Czech Republic, Slovakia and Poland. Int J Public Health 60:59–67CrossRefPubMedGoogle Scholar
  5. Bohnert A, Fredricks J, Randall E (2010) Capturing unique dimensions of youth organized activity involvement: theoretical and methodological considerations. Rev Educ Res 80(4):576–610CrossRefGoogle Scholar
  6. Booth ML, Okely AD, Chey T, Bauman A (2002) The reliability and validity of the Adolescent Physical Activity Recall Questionnaire. Med Sci Sports Exerc 34:1986–1995CrossRefPubMedGoogle Scholar
  7. Bowers EP, Geldhof GJ, Johnson SK, Lerner JV, Lerner RM (2014) Special issue introduction: thriving across the adolescent years: a view of the issues. J Youth Adolesc 43:859–868Google Scholar
  8. Bult MK, Verschuren O, Gorter JW, Jongmans MJ, Piskur B, Ketelaar M (2010) Cross-cultural validation and psychometric evaluation of the Dutch language version of the Children’s Assessment of Participation and Enjoyment (CAPE) in children with and without physical disabilities. Clin Rehabil 24(9):843–853CrossRefPubMedGoogle Scholar
  9. Cohen J (ed) (1988) Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates, New JerseyGoogle Scholar
  10. Cook DA, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119:166.e7–166.e16Google Scholar
  11. Currie C, Zanotti C, Morgan A, Currie D, de Looze M, Roberts C, Samdal O, Smith ORF, Barnekow V (2012) Social determinants of health and well-being among young people. HBSC International Report from the 2009/2010 Survey. Health Policy for Children and Adolescents No. 6Google Scholar
  12. DeVellis RF (2003) Scale development: theory and applications, 2nd edn. Sage Publications, Thousand OaksGoogle Scholar
  13. Downing SM (2004) Reliability: on the reproducibility of assessment data. Med Educ 38:1006–1012CrossRefPubMedGoogle Scholar
  14. Eccles JS, Barber BL, Stone M, Hunt J (2003) Extracurricular activities and adolescent development. J Soc Issues 59:865–889CrossRefGoogle Scholar
  15. Fatusi AO, Hindin MJ (2010) Adolescents and youth in developing countries: health and development issues in context. J Adolesc 33:499–508CrossRefPubMedGoogle Scholar
  16. Fawcet LM, Garton AF, Dandy J (2009) Role of motivation, self-efficacy and parent support in adolescent structured leisure activity participation. Aust J Psychol 61:175–182CrossRefGoogle Scholar
  17. Feder M (2008) Test–retest reliability. Encyclopedia of survey research methods. In: Lavrakas PJ (ed) SAGE Publications, Inc, Thousand Oaks, pp 888–890Google Scholar
  18. Fredrics JA, Eccles JS (2006) Extracurricular involvement and adolescent adjustment: impact of duration, number of activities, and breadth of participation. Appl Dev Sci 10:132–146CrossRefGoogle Scholar
  19. Hong TK, Trang NHHD, van der Ploeg HP, Hardy LL, Dibley MJ (2012) Validity and reliability of a physical activity questionnaire for Vietnamese adolescents. Int J Behav Nutr Phys Act 9:1–7CrossRefGoogle Scholar
  20. King GA, Law M, King S, Hurley P, Hanna S, Kertoy M, Rosenbaum P, Young N (2004) Children´s assessment of participation and enjoyment (CAPE) and preferences for activities of children (PAC). Harcourt Assessment Inc, San AntonioGoogle Scholar
  21. King GA, Law M, King S, Hurley P, Hanna S, Kertoy M, Rosenbaum P (2006) Measuring children’s participation in recreation and leisure activities: construct validation of the CAPE and PAC. Child Care Health Dev 33(1):28–39CrossRefGoogle Scholar
  22. Kohl HW, Fulton JE, Caspersen CJ (2000) Assessment of physical activity among children and adolescents: a review and synthesis. Prev Med 31:54–76CrossRefGoogle Scholar
  23. Kurpius SER, Stafford ME (2006) Testing and measurement: a user-friendly guide. Sage Publications Inc, CaliforniaGoogle Scholar
  24. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMedGoogle Scholar
  25. Larson RW (2000) Toward a psychology of positive youth development. Am Psychol 55:170–183CrossRefPubMedGoogle Scholar
  26. Leversen I, Rodriguez CM, Munoz-Tinoco V, Samdal O, Wold B (2005) Health behaviour in school-aged children: a WHO cross-national study. Research protocol for the 2005/2006 Survey. pp 1–15Google Scholar
  27. Leversen I, Danielsen AG, Birkeland MS, Samdal O (2012) Basic psychological need satisfaction in leisure activities and adolescents’ life satisfaction. J Youth Adolesc 41:1588–1599CrossRefPubMedPubMedCentralGoogle Scholar
  28. Liu Y, Wang M, Tynjälä J, Lv Y, Villberg J, Zhang Z, Kannas L (2010) Test–retest reliability of selected items of health behaviour in school-aged children (HBSC) survey questionnaire in Beijing, China. BMC Med Res Methodol 10(73):1–9Google Scholar
  29. Mahoney JL, Larson R, Eccles J, Lord H (2005) Organized activities as developmental contexts for children and adolescents. In: Mahoney J, Larson R, Eccles J (eds) Organized activities as contexts of development: extracurricural activities, after-school and community programs. Lawrence Erlbaum Associates, New JerseyGoogle Scholar
  30. Mahoney JL, Harris AL, Eccles JS (2006) Organized activity participation, positive youth development, and the over-scheduling hypothesis. Social policy report. Giving child and youth development knowledge away. A publication of the society for research in child development, Vol XX, Number IVGoogle Scholar
  31. Mahoney JL, Harris AL, Eccles JS (2008) The over-scheduling myth. Research-to-results brief. Child Trends Inc, Washington, DCGoogle Scholar
  32. Nickerson CAE (1997) A note on “a concordance correlation coefficient to evaluate reproducibility”. Biometrics 53(4):1503–1507CrossRefGoogle Scholar
  33. Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New YorkGoogle Scholar
  34. Persson A, Kerr M, Stattin H (2007) Staying in or moving away from structured activities: explanations involving parents and peers. Dev Psychol 43:197–207CrossRefPubMedGoogle Scholar
  35. Rhodes J, Spencer R (2005) Someone to watch over me: mentoring programs in the after-school lives of children and adolescents. In: Mahoney J, Larson R, Eccles J (eds) Organized activities as contexts of development. extracurricular activities, after-school and community programs. Lawrence Erlbaum Associates, Mahwah, New JerseyGoogle Scholar
  36. Roberts C, Freeman J, Samdal O, Schnohr C, de Looze ME, Nic Gabhainn S, Iannotti R, Rasmussen M, International HBSC Study Group (2009) The health behaviour in school-aged children (HBSC) study: methodological developments and current tensions. Int J Public Health 54(Suppl 2):140–150Google Scholar
  37. Smith C, Lundquist Denton M, Faris R, Regnerus M (2002) Mapping American adolescent religious participation. J Sci Study Relig 41(4):597–612CrossRefGoogle Scholar
  38. Trinh OT, Nguyen ND, van der Ploeg HP, Dibley MJ, Bauman A (2009) Test–retest repeatability and relative validity of the Global Physical Activity Questionnaire in a developing country context. J Phys Act Health 6(1):S46–S53PubMedGoogle Scholar
  39. Youniss J, McLellan J, Su Y, Yates M (1999) The role of community service in identity development: normative, unconventional, and deviant orientations. J Adolesc Res 14:248–261CrossRefGoogle Scholar
  40. Zambon A, Morgan A, Vereecken C, Colombini S, Boyce W, Mazur J, Lemma P, Cavallo F (2010) The contribution of clubs participation to adolescent health: evidence from six countries. J Epidemiol Community Health 61:89–95CrossRefGoogle Scholar

Copyright information

© Swiss School of Public Health (SSPH+) 2015

Authors and Affiliations

  • Lucia Bosakova
    • 1
    • 2
    • 3
  • Peter Kolarcik
    • 1
    • 3
  • Daniela Bobakova
    • 1
    • 3
  • Martina Sulcova
    • 4
  • Jitse P. Van Dijk
    • 1
    • 5
  • Sijmen A. Reijneveld
    • 5
  • Andrea Madarasova Geckova
    • 1
    • 3
  1. 1.Department of Health Psychology, Medical FacultyP. J. Safarik University in KosiceKosiceSlovak Republic
  2. 2.Department of Quantitative Methods, Faculty of Business Economy in KosiceUniversity of Economics in BratislavaBratislavaSlovak Republic
  3. 3.Olomouc University Social Health Institute (OUSHI)Palacky University in OlomoucOlomoucCzech Republic
  4. 4.Department of Recreation and Leisure Studies, Faculty of Physical CulturePalacky University in OlomoucOlomoucCzech Republic
  5. 5.Department of Social MedicineUniversity Medical Center Groningen, University of GroningenGroningenThe Netherlands

Personalised recommendations