Test–retest reliability of the scale of participation in organized activities among adolescents in the Czech Republic and Slovakia
Participation in organized activities is related with a range of positive outcomes, but the way such participation is measured has not been scrutinized. Test–retest reliability as an important indicator of a scale’s reliability has been assessed rarely and for “The scale of participation in organized activities” lacks completely. This test–retest study is based on the Health Behaviour in School-aged Children study and is consistent with its methodology.
We obtained data from 353 Czech (51.9 % boys) and 227 Slovak (52.9 % boys) primary school pupils, grades five and nine, who participated in this study in 2013. We used Cohen’s kappa statistic and single measures of the intraclass correlation coefficient to estimate the test–retest reliability of all selected items in the sample, stratified by gender, age and country.
We mostly observed a large correlation between the test and retest in all of the examined variables (κ ranged from 0.46 to 0.68). Test–retest reliability of the sum score of individual items showed substantial agreement (ICC = 0.64).
The scale of participation in organized activities has an acceptable level of agreement, indicating good reliability.
KeywordsOrganized activities Adolescents HBSC Test–retest Reliability
This work was supported by the Slovak Research and Development Agency under Contract No. APVV-0032-11 and by the IGA UP research project “Leisure Time in School-aged Children—HBSC Study”, Reg. No. FTK_2013_020, by the Grant Agency of the Czech Republic through the project “Social determinants of health in socially and physically disadvantaged and other groups of population” (Reg. No. CZ.1.07/2.3.00/20.0063) and by the ECOP project “Strengthening the scientific potential of research teams in promoting physical activity at Palacky University” Reg. No. CZ.1.07/2.3.00/20.0171.
Compliance with ethical standards
Conflict of interest
The authors declare no conflict of interest.
- Allen MJ, Yen WM (1979) Introduction to measurement theory. Brooks/Cole, MontereyGoogle Scholar
- Badura P, Madarasova Geckova A, Sigmundova D, van Dijk JP, Reijneveld SA (2015) When children play, they feel better: organized activity participation and health in adolescents (Under revision in BMC Public Health)Google Scholar
- Bowers EP, Geldhof GJ, Johnson SK, Lerner JV, Lerner RM (2014) Special issue introduction: thriving across the adolescent years: a view of the issues. J Youth Adolesc 43:859–868Google Scholar
- Bult MK, Verschuren O, Gorter JW, Jongmans MJ, Piskur B, Ketelaar M (2010) Cross-cultural validation and psychometric evaluation of the Dutch language version of the Children’s Assessment of Participation and Enjoyment (CAPE) in children with and without physical disabilities. Clin Rehabil 24(9):843–853CrossRefPubMedGoogle Scholar
- Cohen J (ed) (1988) Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates, New JerseyGoogle Scholar
- Cook DA, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119:166.e7–166.e16Google Scholar
- Currie C, Zanotti C, Morgan A, Currie D, de Looze M, Roberts C, Samdal O, Smith ORF, Barnekow V (2012) Social determinants of health and well-being among young people. HBSC International Report from the 2009/2010 Survey. Health Policy for Children and Adolescents No. 6Google Scholar
- DeVellis RF (2003) Scale development: theory and applications, 2nd edn. Sage Publications, Thousand OaksGoogle Scholar
- Feder M (2008) Test–retest reliability. Encyclopedia of survey research methods. In: Lavrakas PJ (ed) SAGE Publications, Inc, Thousand Oaks, pp 888–890Google Scholar
- King GA, Law M, King S, Hurley P, Hanna S, Kertoy M, Rosenbaum P, Young N (2004) Children´s assessment of participation and enjoyment (CAPE) and preferences for activities of children (PAC). Harcourt Assessment Inc, San AntonioGoogle Scholar
- Kurpius SER, Stafford ME (2006) Testing and measurement: a user-friendly guide. Sage Publications Inc, CaliforniaGoogle Scholar
- Leversen I, Rodriguez CM, Munoz-Tinoco V, Samdal O, Wold B (2005) Health behaviour in school-aged children: a WHO cross-national study. Research protocol for the 2005/2006 Survey. pp 1–15Google Scholar
- Liu Y, Wang M, Tynjälä J, Lv Y, Villberg J, Zhang Z, Kannas L (2010) Test–retest reliability of selected items of health behaviour in school-aged children (HBSC) survey questionnaire in Beijing, China. BMC Med Res Methodol 10(73):1–9Google Scholar
- Mahoney JL, Larson R, Eccles J, Lord H (2005) Organized activities as developmental contexts for children and adolescents. In: Mahoney J, Larson R, Eccles J (eds) Organized activities as contexts of development: extracurricural activities, after-school and community programs. Lawrence Erlbaum Associates, New JerseyGoogle Scholar
- Mahoney JL, Harris AL, Eccles JS (2006) Organized activity participation, positive youth development, and the over-scheduling hypothesis. Social policy report. Giving child and youth development knowledge away. A publication of the society for research in child development, Vol XX, Number IVGoogle Scholar
- Mahoney JL, Harris AL, Eccles JS (2008) The over-scheduling myth. Research-to-results brief. Child Trends Inc, Washington, DCGoogle Scholar
- Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New YorkGoogle Scholar
- Rhodes J, Spencer R (2005) Someone to watch over me: mentoring programs in the after-school lives of children and adolescents. In: Mahoney J, Larson R, Eccles J (eds) Organized activities as contexts of development. extracurricular activities, after-school and community programs. Lawrence Erlbaum Associates, Mahwah, New JerseyGoogle Scholar
- Roberts C, Freeman J, Samdal O, Schnohr C, de Looze ME, Nic Gabhainn S, Iannotti R, Rasmussen M, International HBSC Study Group (2009) The health behaviour in school-aged children (HBSC) study: methodological developments and current tensions. Int J Public Health 54(Suppl 2):140–150Google Scholar