Skip to main content
SpringerLink
Log in

Test–retest reliability of the scale of participation in organized activities among adolescents in the Czech Republic and Slovakia

  • Original Article
  • Published:
International Journal of Public Health

Abstract

Objectives

Participation in organized activities is related with a range of positive outcomes, but the way such participation is measured has not been scrutinized. Test–retest reliability as an important indicator of a scale’s reliability has been assessed rarely and for “The scale of participation in organized activities” lacks completely. This test–retest study is based on the Health Behaviour in School-aged Children study and is consistent with its methodology.

Methods

We obtained data from 353 Czech (51.9 % boys) and 227 Slovak (52.9 % boys) primary school pupils, grades five and nine, who participated in this study in 2013. We used Cohen’s kappa statistic and single measures of the intraclass correlation coefficient to estimate the test–retest reliability of all selected items in the sample, stratified by gender, age and country.

Results

We mostly observed a large correlation between the test and retest in all of the examined variables (κ ranged from 0.46 to 0.68). Test–retest reliability of the sum score of individual items showed substantial agreement (ICC = 0.64).

Conclusions

The scale of participation in organized activities has an acceptable level of agreement, indicating good reliability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Agans JP, Champine RB, DeSouza LM, Mueller MK, Johnson SK, Lerner RM (2014) Activity involvement as an ecological asset: profiles of participation and youth outcomes. J Youth Adolesc 43:919–932

    Article  PubMed  Google Scholar 

  • Allen MJ, Yen WM (1979) Introduction to measurement theory. Brooks/Cole, Monterey

    Google Scholar 

  • Badura P, Madarasova Geckova A, Sigmundova D, van Dijk JP, Reijneveld SA (2015) When children play, they feel better: organized activity participation and health in adolescents (Under revision in BMC Public Health)

  • Bobakova D, Hamrik Z, Badura P, Sigmundova D, Nalecz H, Kalman M (2015) Test–retest reliability of selected physical activity and sedentary behaviour HBSC items in the Czech Republic, Slovakia and Poland. Int J Public Health 60:59–67

    Article  PubMed  Google Scholar 

  • Bohnert A, Fredricks J, Randall E (2010) Capturing unique dimensions of youth organized activity involvement: theoretical and methodological considerations. Rev Educ Res 80(4):576–610

    Article  Google Scholar 

  • Booth ML, Okely AD, Chey T, Bauman A (2002) The reliability and validity of the Adolescent Physical Activity Recall Questionnaire. Med Sci Sports Exerc 34:1986–1995

    Article  PubMed  Google Scholar 

  • Bowers EP, Geldhof GJ, Johnson SK, Lerner JV, Lerner RM (2014) Special issue introduction: thriving across the adolescent years: a view of the issues. J Youth Adolesc 43:859–868

  • Bult MK, Verschuren O, Gorter JW, Jongmans MJ, Piskur B, Ketelaar M (2010) Cross-cultural validation and psychometric evaluation of the Dutch language version of the Children’s Assessment of Participation and Enjoyment (CAPE) in children with and without physical disabilities. Clin Rehabil 24(9):843–853

    Article  CAS  PubMed  Google Scholar 

  • Cohen J (ed) (1988) Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates, New Jersey

    Google Scholar 

  • Cook DA, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119:166.e7–166.e16

  • Currie C, Zanotti C, Morgan A, Currie D, de Looze M, Roberts C, Samdal O, Smith ORF, Barnekow V (2012) Social determinants of health and well-being among young people. HBSC International Report from the 2009/2010 Survey. Health Policy for Children and Adolescents No. 6

  • DeVellis RF (2003) Scale development: theory and applications, 2nd edn. Sage Publications, Thousand Oaks

    Google Scholar 

  • Downing SM (2004) Reliability: on the reproducibility of assessment data. Med Educ 38:1006–1012

    Article  PubMed  Google Scholar 

  • Eccles JS, Barber BL, Stone M, Hunt J (2003) Extracurricular activities and adolescent development. J Soc Issues 59:865–889

    Article  Google Scholar 

  • Fatusi AO, Hindin MJ (2010) Adolescents and youth in developing countries: health and development issues in context. J Adolesc 33:499–508

    Article  PubMed  Google Scholar 

  • Fawcet LM, Garton AF, Dandy J (2009) Role of motivation, self-efficacy and parent support in adolescent structured leisure activity participation. Aust J Psychol 61:175–182

    Article  Google Scholar 

  • Feder M (2008) Test–retest reliability. Encyclopedia of survey research methods. In: Lavrakas PJ (ed) SAGE Publications, Inc, Thousand Oaks, pp 888–890

  • Fredrics JA, Eccles JS (2006) Extracurricular involvement and adolescent adjustment: impact of duration, number of activities, and breadth of participation. Appl Dev Sci 10:132–146

    Article  Google Scholar 

  • Hong TK, Trang NHHD, van der Ploeg HP, Hardy LL, Dibley MJ (2012) Validity and reliability of a physical activity questionnaire for Vietnamese adolescents. Int J Behav Nutr Phys Act 9:1–7

    Article  Google Scholar 

  • King GA, Law M, King S, Hurley P, Hanna S, Kertoy M, Rosenbaum P, Young N (2004) Children´s assessment of participation and enjoyment (CAPE) and preferences for activities of children (PAC). Harcourt Assessment Inc, San Antonio

    Google Scholar 

  • King GA, Law M, King S, Hurley P, Hanna S, Kertoy M, Rosenbaum P (2006) Measuring children’s participation in recreation and leisure activities: construct validation of the CAPE and PAC. Child Care Health Dev 33(1):28–39

    Article  Google Scholar 

  • Kohl HW, Fulton JE, Caspersen CJ (2000) Assessment of physical activity among children and adolescents: a review and synthesis. Prev Med 31:54–76

    Article  Google Scholar 

  • Kurpius SER, Stafford ME (2006) Testing and measurement: a user-friendly guide. Sage Publications Inc, California

    Google Scholar 

  • Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174

    Article  CAS  PubMed  Google Scholar 

  • Larson RW (2000) Toward a psychology of positive youth development. Am Psychol 55:170–183

    Article  CAS  PubMed  Google Scholar 

  • Leversen I, Rodriguez CM, Munoz-Tinoco V, Samdal O, Wold B (2005) Health behaviour in school-aged children: a WHO cross-national study. Research protocol for the 2005/2006 Survey. pp 1–15

  • Leversen I, Danielsen AG, Birkeland MS, Samdal O (2012) Basic psychological need satisfaction in leisure activities and adolescents’ life satisfaction. J Youth Adolesc 41:1588–1599

    Article  PubMed  PubMed Central  Google Scholar 

  • Liu Y, Wang M, Tynjälä J, Lv Y, Villberg J, Zhang Z, Kannas L (2010) Test–retest reliability of selected items of health behaviour in school-aged children (HBSC) survey questionnaire in Beijing, China. BMC Med Res Methodol 10(73):1–9

    CAS  Google Scholar 

  • Mahoney JL, Larson R, Eccles J, Lord H (2005) Organized activities as developmental contexts for children and adolescents. In: Mahoney J, Larson R, Eccles J (eds) Organized activities as contexts of development: extracurricural activities, after-school and community programs. Lawrence Erlbaum Associates, New Jersey

    Google Scholar 

  • Mahoney JL, Harris AL, Eccles JS (2006) Organized activity participation, positive youth development, and the over-scheduling hypothesis. Social policy report. Giving child and youth development knowledge away. A publication of the society for research in child development, Vol XX, Number IV

  • Mahoney JL, Harris AL, Eccles JS (2008) The over-scheduling myth. Research-to-results brief. Child Trends Inc, Washington, DC

    Google Scholar 

  • Nickerson CAE (1997) A note on “a concordance correlation coefficient to evaluate reproducibility”. Biometrics 53(4):1503–1507

    Article  Google Scholar 

  • Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New York

    Google Scholar 

  • Persson A, Kerr M, Stattin H (2007) Staying in or moving away from structured activities: explanations involving parents and peers. Dev Psychol 43:197–207

    Article  PubMed  Google Scholar 

  • Rhodes J, Spencer R (2005) Someone to watch over me: mentoring programs in the after-school lives of children and adolescents. In: Mahoney J, Larson R, Eccles J (eds) Organized activities as contexts of development. extracurricular activities, after-school and community programs. Lawrence Erlbaum Associates, Mahwah, New Jersey

  • Roberts C, Freeman J, Samdal O, Schnohr C, de Looze ME, Nic Gabhainn S, Iannotti R, Rasmussen M, International HBSC Study Group (2009) The health behaviour in school-aged children (HBSC) study: methodological developments and current tensions. Int J Public Health 54(Suppl 2):140–150

  • Smith C, Lundquist Denton M, Faris R, Regnerus M (2002) Mapping American adolescent religious participation. J Sci Study Relig 41(4):597–612

    Article  Google Scholar 

  • Trinh OT, Nguyen ND, van der Ploeg HP, Dibley MJ, Bauman A (2009) Test–retest repeatability and relative validity of the Global Physical Activity Questionnaire in a developing country context. J Phys Act Health 6(1):S46–S53

    PubMed  Google Scholar 

  • Youniss J, McLellan J, Su Y, Yates M (1999) The role of community service in identity development: normative, unconventional, and deviant orientations. J Adolesc Res 14:248–261

    Article  Google Scholar 

  • Zambon A, Morgan A, Vereecken C, Colombini S, Boyce W, Mazur J, Lemma P, Cavallo F (2010) The contribution of clubs participation to adolescent health: evidence from six countries. J Epidemiol Community Health 61:89–95

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the Slovak Research and Development Agency under Contract No. APVV-0032-11 and by the IGA UP research project “Leisure Time in School-aged Children—HBSC Study”, Reg. No. FTK_2013_020, by the Grant Agency of the Czech Republic through the project “Social determinants of health in socially and physically disadvantaged and other groups of population” (Reg. No. CZ.1.07/2.3.00/20.0063) and by the ECOP project “Strengthening the scientific potential of research teams in promoting physical activity at Palacky University” Reg. No. CZ.1.07/2.3.00/20.0171.

Author information

Authors and Affiliations

  1. Department of Health Psychology, Medical Faculty, P. J. Safarik University in Kosice, Kosice, Slovak Republic

    Lucia Bosakova, Peter Kolarcik, Daniela Bobakova, Jitse P. Van Dijk & Andrea Madarasova Geckova

  2. Department of Quantitative Methods, Faculty of Business Economy in Kosice, University of Economics in Bratislava, Bratislava, Slovak Republic

    Lucia Bosakova

  3. Olomouc University Social Health Institute (OUSHI), Palacky University in Olomouc, Olomouc, Czech Republic

    Lucia Bosakova, Peter Kolarcik, Daniela Bobakova & Andrea Madarasova Geckova

  4. Department of Recreation and Leisure Studies, Faculty of Physical Culture, Palacky University in Olomouc, Olomouc, Czech Republic

    Martina Sulcova

  5. Department of Social Medicine, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands

    Jitse P. Van Dijk & Sijmen A. Reijneveld

Authors
  1. Lucia Bosakova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peter Kolarcik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniela Bobakova
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martina Sulcova
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jitse P. Van Dijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sijmen A. Reijneveld
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Andrea Madarasova Geckova
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lucia Bosakova.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bosakova, L., Kolarcik, P., Bobakova, D. et al. Test–retest reliability of the scale of participation in organized activities among adolescents in the Czech Republic and Slovakia. Int J Public Health 61, 329–336 (2016). https://doi.org/10.1007/s00038-015-0749-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00038-015-0749-9

Keywords

Search

Navigation