Skip to main content

Advertisement

Log in

Internal and External Validity of Self-Report and Parent-Report Measures of Sluggish Cognitive Tempo in South Korean Adolescents

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

This study evaluated the internal and external validity of self-report and parent-report measures of sluggish cognitive tempo (SCT) in South Korean adolescents. Adolescents (N = 469, ages 13–17 years; 50.2% boys) completed self-report measures of SCT and attention-deficit/hyperactivity disorder inattention (ADHD-IN) in addition to measures of internalizing and externalizing psychopathology, social problems, and grades. Parents rated adolescents on SCT, ADHD-IN, internalizing and externalizing psychopathology, and social problems. Using adolescent self-report, 11 of 15 SCT symptoms showed convergent and discriminant validity with ADHD-IN. Using parent-report, all 15 SCT symptoms showed convergent and discriminant validity with ADHD-IN. For within source analyses, SCT showed unique and stronger associations than ADHD-IN with internalizing psychopathology whereas ADHD-IN showed unique and stronger associations than SCT with externalizing psychopathology. SCT and ADHD-IN showed similar unique associations with social problems, whereas ADHD-IN was more strongly related than SCT to grades. Across source analyses also supported the differential unique associations of SCT and ADHD-IN with internalizing and externalizing psychopathologies. This study provides initial evidence for the internal and external validity of SCT with South Korean adolescents, extending support for the transcultural validity of SCT to the important developmental period of adolescence.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. The SCT item lacks motivation to complete tasks (e.g., apathetic) consistently showed a stronger loading on the ADHD-IN than the SCT factor, thus this item was not retained in the final set of 15 SCT items shown in Table 1.

  2. The correlations of youth self-reported of the 11 SCT symptoms with the 3 YSR SCT items and 4 CBCL SCT items were .55 (p < .001) and .22 (p < .001), respectively. The correlations of the 15 parent-reported SCT symptoms with the 4 CBCL SCT items and 3 YSR SCT items were .51 (p < .001) and .17 (p < .01), respectively. The correlation of the 3 YSR SCT items with the 4 CBCL SCT items was .21 (p < .001).

References

  • Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.

    Google Scholar 

  • Barkley, R. A. (2012). Distinguishing sluggish cognitive tempo from attention-deficit/hyperactivity disorder in adults. Journal of Abnormal Psychology, 121, 978–990. https://doi.org/10.1037/a0023961.

    Article  PubMed  Google Scholar 

  • Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-second edition manual. San Antonio, TX: Psychological Corporation.

    Google Scholar 

  • Becker, S. P. (2015). Child concentration inventory, second edition (CCI-2). Cincinnati, OH: Author.

    Google Scholar 

  • Becker, S. P. (2019). Sluggish cognitive tempo: The need for global inquiry. World Psychiatry, 18, 237–238.

    Article  Google Scholar 

  • Becker, S. P., & Willcutt, E. G. (2019). Advancing the study of sluggish cognitive tempo via DSM, RDoC, and hierarchical models of psychopathology. European Child & Adolescent Psychiatry, 28, 603–613. https://doi.org/10.1007/s00787-018-1136-x.

    Article  Google Scholar 

  • Becker, S. P., Langberg, J. M., Luebbe, A. M., Dvorsky, M. R., & Flannery, A. J. (2014a). Sluggish cognitive tempo is associated with academic functioning and internalizing symptoms in college students with and without attention-deficit/hyperactivity disorder. Journal of Clinical Psychology, 70, 388–403. https://doi.org/10.1002/jclp.22046.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Luebbe, A. M., & Langberg, J. M. (2014b). Attention-deficit/hyperactivity disorder dimensions and sluggish cognitive tempo symptoms in relation to college students' sleep functioning. Child Psychiatry and Human Development, 45, 675–685. https://doi.org/10.1007/s10578-014-0436-8.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Luebbe, A. M., & Joyce, A. M. (2015). The child concentration inventory (CCI): Initial validation of a child self-report measure of sluggish cognitive tempo. Psychological Assessment, 27, 1037–1052. https://doi.org/10.1037/pas0000083.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Garner, A. A., & Byars, K. C. (2016a). Sluggish cognitive tempo in children referred to a pediatric sleep disorders center: Examining possible overlap with sleep problems and associations with impairment. Journal of Psychiatric Research, 77, 116–124. https://doi.org/10.1016/j.jpsychires.2016.03.005.

    Article  PubMed  PubMed Central  Google Scholar 

  • Becker, S. P., Leopold, D. R., Burns, G. L., Jarrett, M. A., Langberg, J. M., Marshall, S. A., McBurnett, K., Waschbusch, D. A., & Willcutt, E. G. (2016b). The internal, external, and diagnostic validity of sluggish cognitive tempo: A meta-analysis and critical review. Journal of the American Academy of Child and Adolescent Psychiatry, 55, 163–178. https://doi.org/10.1016/j.jaac.2015.12.006.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Burns, G. L., Garner, A. A., Jarrett, M. A., Luebbe, A. M., Epstein, J. N., & Willcutt, E. G. (2018a). Sluggish cognitive tempo in adults: Psychometric validation of the adult concentration inventory. Psychological Assessment, 30, 296–310. https://doi.org/10.1037/pas0000476.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Burns, G. L., Leopold, D. R., Olson, R. K., & Willcutt, E. G. (2018b). Differential impact of trait sluggish cognitive tempo and ADHD inattention in early childhood on adolescent functioning. Journal of Child Psychology and Psychiatry, 59, 1094–1104. https://doi.org/10.1111/jcpp.12946.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Burns, G. L., Schmitt, A. P., Epstein, J. N., & Tamm, L. (2019a). Toward establishing a standard symptom set for assessing sluggish cognitive tempo in children: Evidence from teacher ratings in a community sample. Assessment, 26, 1128–1141. https://doi.org/10.1177/1073191117715732.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Epstein, J. N., Tamm, L., Tilford, A. A., Tischner, C. M., Isaacson, P. A., Simon, J. O., & Beebe, D. W. (2019b). Shortened sleep duration causes sleepiness, inattention, and oppositionality in adolescents with attention-deficit/hyperactivity disorder: Findings from a crossover sleep restriction/extension study. Journal of the American Academy of Child and Adolescent Psychiatry, 58, 433–442. https://doi.org/10.1016/j.jaac.2018.09.439.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Garner, A. A., Tamm, L., Antonini, T. N., & Epstein, J. N. (2019c). Honing in on the social difficulties associated with sluggish cognitive tempo in children: Withdrawal, peer ignoring, and low engagement. Journal of Clinical Child and Adolescent Psychology, 48, 228–237. https://doi.org/10.1080/15374416.2017.1286595.

    Article  PubMed  Google Scholar 

  • Becker, S. P., Burns, G. L., Smith, Z. R., & Langberg, J. M. (2020). Sluggish cognitive tempo in adolescents with and without ADHD: Differentiation from adolescent-reported ADHD inattention and unique associations with internalizing domains. Journal of Abnormal Child Psychology, 48, 391–406. https://doi.org/10.1007/s10802-019-00603-9.

    Article  PubMed  PubMed Central  Google Scholar 

  • Burns, G. L., & Becker, S. P. (2019). Sluggish cognitive tempo and ADHD symptoms in a nationally representative sample of U.S. children: Differentiation using categorical and dimensional approaches. Journal of Clinical Child and Adolescent Psychology. https://doi.org/10.1080/15374416.2019.1678165.

  • Burns, G. L., Lee, S., Servera, M., McBurnett, K., & Becker, S. P. (2015). Child and adolescent behavior inventory - parent version 1.0. Pullman, WA: Author.

    Google Scholar 

  • Cho, S. K., & Lee, S. (2020). A study of longitudinal changes and relevant factors of adolescents’ sleep duration. Studies on Korean Youth, 31(1), 5–32.

    Article  Google Scholar 

  • Chung, G. H., & Cheon, Y. M. (2017). A daily diary study of adolescents’ academic stress, physical and psychological well-being, and the moderating effect of family affluence. Korean Journal of Youth Studies, 24, 251–276. https://doi.org/10.21509/KJYS.2017.02.24.2.251.

    Article  Google Scholar 

  • Combs, M. A., Canu, W. H., Broman-Fulks, J. J., Rocheleau, C. A., & Nieman, D. C. (2015). Perceived stress and ADHD symptoms in adults. Journal of Attention Disorders, 19, 425–434. https://doi.org/10.1177/1087054712459558.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. https://doi.org/10.1037/a0038498.

    Article  PubMed  PubMed Central  Google Scholar 

  • DuPaul, G. J., Anastopoulos, A. D., Power, T. J., Reid, R., Ikeda, M. J., & McGoey, K. E. (1998). Parent ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavioral Assessment, 20, 83–102. https://doi.org/10.1023/A:1023087410712.

    Article  Google Scholar 

  • Garner, A. A., Becker, S. P., McAlister, S., Baxley, C., Hansen, A., Nalepka, P., et al. (2016). Impact of sleep extension on sluggish cognitive tempo symptoms and driving behavior among chronically sleep deprived adolescents. Sleep, 39, A11.

    Article  Google Scholar 

  • Khadka, G., Burns, G. L., & Becker, S. P. (2016). Internal and external validity of sluggish cognitive tempo and ADHD inattention dimensions with teacher ratings of Nepali children. Journal of Psychopathology and Behavioral Assessment, 38, 433–442. https://doi.org/10.1007/s10862-015-9534-6.

    Article  PubMed  Google Scholar 

  • Kim, J., Rapee, R. M., Ja Oh, K., & Moon, H. S. (2008). Retrospective report of social withdrawal during adolescence and current maladjustment in young adulthood: Cross-cultural comparisons between Australian and south Korean students. Journal of Adolescence, 31, 543–563. https://doi.org/10.1016/j.adolescence.2007.10.011.

    Article  PubMed  Google Scholar 

  • Kim, J. H., Kim, S. B., & Jung, I. K. (2014a). The mediating effect of stress coping strategies on the relationship between academic stress and the school adjustment in Korean adolescents. Studies on Korean Youth, 25, 241–269.

    Article  Google Scholar 

  • Kim, J. H., Lee, E. H., Hwang, S. T., & Hong, S. H. (2014b). Beck depression inventory-second edition manual. Daegu: Korea Psychological Corporation.

    Google Scholar 

  • Kim, Y. S., So, Y. K., Noh, J. S., Choi, N. K., Kim, S. J., & Koh, Y. J. (2003). Normative data on the Korean ADHD rating scales (K-ARS) for parents and teachers. Journal of the Korean Neuropsychiatric Association, 42, 352–359.

    Google Scholar 

  • Korea Centers for Disease. (2019). 2019 Adolescents Health Behavior Survey Statistics. Retrieved from https://www.cdc.go.kr/yhs/home.jsp?id=m03_02

  • Lee, J. Y., Nam, S. K., Lee, M. K., Lee, J. H., & Lee, S. M. (2009). Rosenberg’ self-esteem scale: Analysis of item-level validity. Korean Journal of Counseling and Psychotherapy, 21, 173–189.

    Google Scholar 

  • Lee, S., Burns, G. L., Snell, J., & McBurnett, K. (2014). Validity of the sluggish cognitive tempo symptom dimension in children: Sluggish cognitive tempo and ADHD-inattention as distinct symptom dimensions. Journal of Abnormal Child Psychology, 42, 7–19. https://doi.org/10.1007/s10802-013-9714-3.

    Article  PubMed  Google Scholar 

  • Lee, S., Burns, G. L., & Becker, S. P. (2017). Can sluggish cognitive tempo be distinguished from ADHD inattention in very young children? Evidence from a sample of Korean preschool children. Journal of Attention Disorders, 21, 623–631. https://doi.org/10.1177/1087054716680077.

    Article  PubMed  Google Scholar 

  • Lee, S., Burns, G. L., & Becker, S. P. (2018). Toward establishing the transcultural validity of sluggish cognitive tempo: Evidence from a sample of south Korean children. Journal of Clinical Child and Adolescent Psychology, 47, 61–68. https://doi.org/10.1080/15374416.2016.1144192.

    Article  PubMed  Google Scholar 

  • Marshall, S. A., Evans, S. W., Eiraldi, R. B., Becker, S. P., & Power, T. J. (2014). Social and academic impairment in youth with ADHD, predominately inattentive type and sluggish cognitive tempo. Journal of Abnormal Child Psychology, 42, 77–90. https://doi.org/10.1007/s10802-013-9758-4.

    Article  PubMed  Google Scholar 

  • McBurnett, K., Villodas, M., Burns, G. L., Hinshaw, S. P., Beaulieu, A., & Pfiffner, L. J. (2014). Structure and validity of sluggish cognitive tempo using an expanded item pool in children with attention-deficit/hyperactivity disorder. Journal of Abnormal Child Psychology, 42, 37–48. https://doi.org/10.1007/s10802-013-9801-5.

    Article  PubMed  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998-2018). Mplus user’s guide (Eigth ed.). Los Angeles, CA: Muthén & Muthén.

  • Oh, K. J., Kim, Y. A., Ha, E. H., Lee, H. R., & Hong, K. U. (2010). Manual for the ASEBA School-age Forms & Profiles. Seoul: Huno Inc..

    Google Scholar 

  • Penny, A. M., Waschbusch, D. A., Klein, R. M., Corkum, P., & Eskes, G. (2009). Developing a measure of sluggish cognitive tempo for children: Content validity, factor structure, and reliability. Psychological Assessment, 21, 380–389. https://doi.org/10.1037/a0016600.

    Article  PubMed  Google Scholar 

  • Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, N.J: Princeton University Press.

    Book  Google Scholar 

  • Sáez, B., Servera, M., Becker, S. P., & Burns, G. L. (2019a). Optimal items for assessing sluggish cognitive tempo in children across mother, father, and teacher ratings. Journal of Clinical Child and Adolescent Psychology, 48, 1–15. https://doi.org/10.1080/15374416.2017.1416619.

    Article  Google Scholar 

  • Sáez, B., Servera, M., Burns, G. L., & Becker, S. P. (2019b). Advancing the multi-informant assessment of sluggish cognitive tempo: Child self-report in relation to parent and teacher ratings of SCT and impairment. Journal of Abnormal Child Psychology, 47, 35–46. https://doi.org/10.1007/s10802-018-0436-4.

    Article  PubMed  PubMed Central  Google Scholar 

  • Servera, M., Saez, B., Burns, G. L., & Becker, S. P. (2018). Clinical differentiation of sluggish cognitive tempo and attention-deficit/hyperactivity disorder in children. Journal of Abnormal Psychology, 127, 818–829. https://doi.org/10.1037/abn0000375.

    Article  PubMed  PubMed Central  Google Scholar 

  • Smith, Z. R., Becker, S. P., Garner, A. A., Rudolph, C. W., Molitor, S. J., Oddo, L. E., & Langberg, J. M. (2018). Evaluating the structure of sluggish cognitive tempo using confirmatory factor analytic and bifactor modeling with parent and youth ratings. Assessment, 25, 99–111. https://doi.org/10.1177/1073191116653471.

    Article  PubMed  Google Scholar 

  • Takeda, T., Burns, G. L., Jiang, Y., Becker, S. P., & McBurnett, K. (2019). Psychometric properties of a sluggish cognitive tempo scale in Japanese adults with and without ADHD. Atten Defic Hyperact Disord, 11, 353–362. https://doi.org/10.1007/s12402-019-00300-z.

    Article  PubMed  PubMed Central  Google Scholar 

  • We, J. H., & Chae, K. M. (2004). Internet addiction disorder of attention-deficit hyperactivity disorder adolescents, psychological characteristics. Korean Journal of Clinical Psychology, 23, 397–416.

    Google Scholar 

  • Willcutt, E. G., Nigg, J. T., Pennington, B. F., Solanto, M. V., Rohde, L. A., Tannock, R., Loo, S. K., Carlson, C. L., McBurnett, K., & Lahey, B. B. (2012). Validity of DSM-IV attention deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology, 121, 991–1010. https://doi.org/10.1037/a0027347.

    Article  PubMed  PubMed Central  Google Scholar 

  • Willcutt, E. G., Chhabildas, N., Kinnear, M., DeFries, J. C., Olson, R. K., Leopold, D. R., Keenan, J. M., & Pennington, B. F. (2014). The internal and external validity of sluggish cognitive tempo and its relation with DSM-IV ADHD. Journal of Abnormal Child Psychology, 42, 21–35. https://doi.org/10.1007/s10802-013-9800-6.

    Article  PubMed  PubMed Central  Google Scholar 

  • Won, K. R., & Lee, H. J. (2019). Academic stress and suicidal ideation: The mediating effects of school connectedness, depression and anxiety in adolescents. Korean Journal of Youth Studies, 26, 79–104. https://doi.org/10.21509/KJYS.2019.09.26.9.79.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to SoYean Lee.

Ethics declarations

Conflict of Interest

Author So-Hee Jung, SoYean Lee, G. Leonard Burns, and Stephen Becker declares that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(DOCX 24 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jung, SH., Lee, S., Burns, G.L. et al. Internal and External Validity of Self-Report and Parent-Report Measures of Sluggish Cognitive Tempo in South Korean Adolescents. J Psychopathol Behav Assess 43, 355–366 (2021). https://doi.org/10.1007/s10862-020-09821-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-020-09821-8

Keywords

Navigation