Abstract
This study evaluated the internal and external validity of self-report and parent-report measures of sluggish cognitive tempo (SCT) in South Korean adolescents. Adolescents (N = 469, ages 13–17 years; 50.2% boys) completed self-report measures of SCT and attention-deficit/hyperactivity disorder inattention (ADHD-IN) in addition to measures of internalizing and externalizing psychopathology, social problems, and grades. Parents rated adolescents on SCT, ADHD-IN, internalizing and externalizing psychopathology, and social problems. Using adolescent self-report, 11 of 15 SCT symptoms showed convergent and discriminant validity with ADHD-IN. Using parent-report, all 15 SCT symptoms showed convergent and discriminant validity with ADHD-IN. For within source analyses, SCT showed unique and stronger associations than ADHD-IN with internalizing psychopathology whereas ADHD-IN showed unique and stronger associations than SCT with externalizing psychopathology. SCT and ADHD-IN showed similar unique associations with social problems, whereas ADHD-IN was more strongly related than SCT to grades. Across source analyses also supported the differential unique associations of SCT and ADHD-IN with internalizing and externalizing psychopathologies. This study provides initial evidence for the internal and external validity of SCT with South Korean adolescents, extending support for the transcultural validity of SCT to the important developmental period of adolescence.
Similar content being viewed by others
Notes
The SCT item lacks motivation to complete tasks (e.g., apathetic) consistently showed a stronger loading on the ADHD-IN than the SCT factor, thus this item was not retained in the final set of 15 SCT items shown in Table 1.
The correlations of youth self-reported of the 11 SCT symptoms with the 3 YSR SCT items and 4 CBCL SCT items were .55 (p < .001) and .22 (p < .001), respectively. The correlations of the 15 parent-reported SCT symptoms with the 4 CBCL SCT items and 3 YSR SCT items were .51 (p < .001) and .17 (p < .01), respectively. The correlation of the 3 YSR SCT items with the 4 CBCL SCT items was .21 (p < .001).
References
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.
Barkley, R. A. (2012). Distinguishing sluggish cognitive tempo from attention-deficit/hyperactivity disorder in adults. Journal of Abnormal Psychology, 121, 978–990. https://doi.org/10.1037/a0023961.
Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-second edition manual. San Antonio, TX: Psychological Corporation.
Becker, S. P. (2015). Child concentration inventory, second edition (CCI-2). Cincinnati, OH: Author.
Becker, S. P. (2019). Sluggish cognitive tempo: The need for global inquiry. World Psychiatry, 18, 237–238.
Becker, S. P., & Willcutt, E. G. (2019). Advancing the study of sluggish cognitive tempo via DSM, RDoC, and hierarchical models of psychopathology. European Child & Adolescent Psychiatry, 28, 603–613. https://doi.org/10.1007/s00787-018-1136-x.
Becker, S. P., Langberg, J. M., Luebbe, A. M., Dvorsky, M. R., & Flannery, A. J. (2014a). Sluggish cognitive tempo is associated with academic functioning and internalizing symptoms in college students with and without attention-deficit/hyperactivity disorder. Journal of Clinical Psychology, 70, 388–403. https://doi.org/10.1002/jclp.22046.
Becker, S. P., Luebbe, A. M., & Langberg, J. M. (2014b). Attention-deficit/hyperactivity disorder dimensions and sluggish cognitive tempo symptoms in relation to college students' sleep functioning. Child Psychiatry and Human Development, 45, 675–685. https://doi.org/10.1007/s10578-014-0436-8.
Becker, S. P., Luebbe, A. M., & Joyce, A. M. (2015). The child concentration inventory (CCI): Initial validation of a child self-report measure of sluggish cognitive tempo. Psychological Assessment, 27, 1037–1052. https://doi.org/10.1037/pas0000083.
Becker, S. P., Garner, A. A., & Byars, K. C. (2016a). Sluggish cognitive tempo in children referred to a pediatric sleep disorders center: Examining possible overlap with sleep problems and associations with impairment. Journal of Psychiatric Research, 77, 116–124. https://doi.org/10.1016/j.jpsychires.2016.03.005.
Becker, S. P., Leopold, D. R., Burns, G. L., Jarrett, M. A., Langberg, J. M., Marshall, S. A., McBurnett, K., Waschbusch, D. A., & Willcutt, E. G. (2016b). The internal, external, and diagnostic validity of sluggish cognitive tempo: A meta-analysis and critical review. Journal of the American Academy of Child and Adolescent Psychiatry, 55, 163–178. https://doi.org/10.1016/j.jaac.2015.12.006.
Becker, S. P., Burns, G. L., Garner, A. A., Jarrett, M. A., Luebbe, A. M., Epstein, J. N., & Willcutt, E. G. (2018a). Sluggish cognitive tempo in adults: Psychometric validation of the adult concentration inventory. Psychological Assessment, 30, 296–310. https://doi.org/10.1037/pas0000476.
Becker, S. P., Burns, G. L., Leopold, D. R., Olson, R. K., & Willcutt, E. G. (2018b). Differential impact of trait sluggish cognitive tempo and ADHD inattention in early childhood on adolescent functioning. Journal of Child Psychology and Psychiatry, 59, 1094–1104. https://doi.org/10.1111/jcpp.12946.
Becker, S. P., Burns, G. L., Schmitt, A. P., Epstein, J. N., & Tamm, L. (2019a). Toward establishing a standard symptom set for assessing sluggish cognitive tempo in children: Evidence from teacher ratings in a community sample. Assessment, 26, 1128–1141. https://doi.org/10.1177/1073191117715732.
Becker, S. P., Epstein, J. N., Tamm, L., Tilford, A. A., Tischner, C. M., Isaacson, P. A., Simon, J. O., & Beebe, D. W. (2019b). Shortened sleep duration causes sleepiness, inattention, and oppositionality in adolescents with attention-deficit/hyperactivity disorder: Findings from a crossover sleep restriction/extension study. Journal of the American Academy of Child and Adolescent Psychiatry, 58, 433–442. https://doi.org/10.1016/j.jaac.2018.09.439.
Becker, S. P., Garner, A. A., Tamm, L., Antonini, T. N., & Epstein, J. N. (2019c). Honing in on the social difficulties associated with sluggish cognitive tempo in children: Withdrawal, peer ignoring, and low engagement. Journal of Clinical Child and Adolescent Psychology, 48, 228–237. https://doi.org/10.1080/15374416.2017.1286595.
Becker, S. P., Burns, G. L., Smith, Z. R., & Langberg, J. M. (2020). Sluggish cognitive tempo in adolescents with and without ADHD: Differentiation from adolescent-reported ADHD inattention and unique associations with internalizing domains. Journal of Abnormal Child Psychology, 48, 391–406. https://doi.org/10.1007/s10802-019-00603-9.
Burns, G. L., & Becker, S. P. (2019). Sluggish cognitive tempo and ADHD symptoms in a nationally representative sample of U.S. children: Differentiation using categorical and dimensional approaches. Journal of Clinical Child and Adolescent Psychology. https://doi.org/10.1080/15374416.2019.1678165.
Burns, G. L., Lee, S., Servera, M., McBurnett, K., & Becker, S. P. (2015). Child and adolescent behavior inventory - parent version 1.0. Pullman, WA: Author.
Cho, S. K., & Lee, S. (2020). A study of longitudinal changes and relevant factors of adolescents’ sleep duration. Studies on Korean Youth, 31(1), 5–32.
Chung, G. H., & Cheon, Y. M. (2017). A daily diary study of adolescents’ academic stress, physical and psychological well-being, and the moderating effect of family affluence. Korean Journal of Youth Studies, 24, 251–276. https://doi.org/10.21509/KJYS.2017.02.24.2.251.
Combs, M. A., Canu, W. H., Broman-Fulks, J. J., Rocheleau, C. A., & Nieman, D. C. (2015). Perceived stress and ADHD symptoms in adults. Journal of Attention Disorders, 19, 425–434. https://doi.org/10.1177/1087054712459558.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. https://doi.org/10.1037/a0038498.
DuPaul, G. J., Anastopoulos, A. D., Power, T. J., Reid, R., Ikeda, M. J., & McGoey, K. E. (1998). Parent ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavioral Assessment, 20, 83–102. https://doi.org/10.1023/A:1023087410712.
Garner, A. A., Becker, S. P., McAlister, S., Baxley, C., Hansen, A., Nalepka, P., et al. (2016). Impact of sleep extension on sluggish cognitive tempo symptoms and driving behavior among chronically sleep deprived adolescents. Sleep, 39, A11.
Khadka, G., Burns, G. L., & Becker, S. P. (2016). Internal and external validity of sluggish cognitive tempo and ADHD inattention dimensions with teacher ratings of Nepali children. Journal of Psychopathology and Behavioral Assessment, 38, 433–442. https://doi.org/10.1007/s10862-015-9534-6.
Kim, J., Rapee, R. M., Ja Oh, K., & Moon, H. S. (2008). Retrospective report of social withdrawal during adolescence and current maladjustment in young adulthood: Cross-cultural comparisons between Australian and south Korean students. Journal of Adolescence, 31, 543–563. https://doi.org/10.1016/j.adolescence.2007.10.011.
Kim, J. H., Kim, S. B., & Jung, I. K. (2014a). The mediating effect of stress coping strategies on the relationship between academic stress and the school adjustment in Korean adolescents. Studies on Korean Youth, 25, 241–269.
Kim, J. H., Lee, E. H., Hwang, S. T., & Hong, S. H. (2014b). Beck depression inventory-second edition manual. Daegu: Korea Psychological Corporation.
Kim, Y. S., So, Y. K., Noh, J. S., Choi, N. K., Kim, S. J., & Koh, Y. J. (2003). Normative data on the Korean ADHD rating scales (K-ARS) for parents and teachers. Journal of the Korean Neuropsychiatric Association, 42, 352–359.
Korea Centers for Disease. (2019). 2019 Adolescents Health Behavior Survey Statistics. Retrieved from https://www.cdc.go.kr/yhs/home.jsp?id=m03_02
Lee, J. Y., Nam, S. K., Lee, M. K., Lee, J. H., & Lee, S. M. (2009). Rosenberg’ self-esteem scale: Analysis of item-level validity. Korean Journal of Counseling and Psychotherapy, 21, 173–189.
Lee, S., Burns, G. L., Snell, J., & McBurnett, K. (2014). Validity of the sluggish cognitive tempo symptom dimension in children: Sluggish cognitive tempo and ADHD-inattention as distinct symptom dimensions. Journal of Abnormal Child Psychology, 42, 7–19. https://doi.org/10.1007/s10802-013-9714-3.
Lee, S., Burns, G. L., & Becker, S. P. (2017). Can sluggish cognitive tempo be distinguished from ADHD inattention in very young children? Evidence from a sample of Korean preschool children. Journal of Attention Disorders, 21, 623–631. https://doi.org/10.1177/1087054716680077.
Lee, S., Burns, G. L., & Becker, S. P. (2018). Toward establishing the transcultural validity of sluggish cognitive tempo: Evidence from a sample of south Korean children. Journal of Clinical Child and Adolescent Psychology, 47, 61–68. https://doi.org/10.1080/15374416.2016.1144192.
Marshall, S. A., Evans, S. W., Eiraldi, R. B., Becker, S. P., & Power, T. J. (2014). Social and academic impairment in youth with ADHD, predominately inattentive type and sluggish cognitive tempo. Journal of Abnormal Child Psychology, 42, 77–90. https://doi.org/10.1007/s10802-013-9758-4.
McBurnett, K., Villodas, M., Burns, G. L., Hinshaw, S. P., Beaulieu, A., & Pfiffner, L. J. (2014). Structure and validity of sluggish cognitive tempo using an expanded item pool in children with attention-deficit/hyperactivity disorder. Journal of Abnormal Child Psychology, 42, 37–48. https://doi.org/10.1007/s10802-013-9801-5.
Muthén, L. K., & Muthén, B. O. (1998-2018). Mplus user’s guide (Eigth ed.). Los Angeles, CA: Muthén & Muthén.
Oh, K. J., Kim, Y. A., Ha, E. H., Lee, H. R., & Hong, K. U. (2010). Manual for the ASEBA School-age Forms & Profiles. Seoul: Huno Inc..
Penny, A. M., Waschbusch, D. A., Klein, R. M., Corkum, P., & Eskes, G. (2009). Developing a measure of sluggish cognitive tempo for children: Content validity, factor structure, and reliability. Psychological Assessment, 21, 380–389. https://doi.org/10.1037/a0016600.
Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, N.J: Princeton University Press.
Sáez, B., Servera, M., Becker, S. P., & Burns, G. L. (2019a). Optimal items for assessing sluggish cognitive tempo in children across mother, father, and teacher ratings. Journal of Clinical Child and Adolescent Psychology, 48, 1–15. https://doi.org/10.1080/15374416.2017.1416619.
Sáez, B., Servera, M., Burns, G. L., & Becker, S. P. (2019b). Advancing the multi-informant assessment of sluggish cognitive tempo: Child self-report in relation to parent and teacher ratings of SCT and impairment. Journal of Abnormal Child Psychology, 47, 35–46. https://doi.org/10.1007/s10802-018-0436-4.
Servera, M., Saez, B., Burns, G. L., & Becker, S. P. (2018). Clinical differentiation of sluggish cognitive tempo and attention-deficit/hyperactivity disorder in children. Journal of Abnormal Psychology, 127, 818–829. https://doi.org/10.1037/abn0000375.
Smith, Z. R., Becker, S. P., Garner, A. A., Rudolph, C. W., Molitor, S. J., Oddo, L. E., & Langberg, J. M. (2018). Evaluating the structure of sluggish cognitive tempo using confirmatory factor analytic and bifactor modeling with parent and youth ratings. Assessment, 25, 99–111. https://doi.org/10.1177/1073191116653471.
Takeda, T., Burns, G. L., Jiang, Y., Becker, S. P., & McBurnett, K. (2019). Psychometric properties of a sluggish cognitive tempo scale in Japanese adults with and without ADHD. Atten Defic Hyperact Disord, 11, 353–362. https://doi.org/10.1007/s12402-019-00300-z.
We, J. H., & Chae, K. M. (2004). Internet addiction disorder of attention-deficit hyperactivity disorder adolescents, psychological characteristics. Korean Journal of Clinical Psychology, 23, 397–416.
Willcutt, E. G., Nigg, J. T., Pennington, B. F., Solanto, M. V., Rohde, L. A., Tannock, R., Loo, S. K., Carlson, C. L., McBurnett, K., & Lahey, B. B. (2012). Validity of DSM-IV attention deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology, 121, 991–1010. https://doi.org/10.1037/a0027347.
Willcutt, E. G., Chhabildas, N., Kinnear, M., DeFries, J. C., Olson, R. K., Leopold, D. R., Keenan, J. M., & Pennington, B. F. (2014). The internal and external validity of sluggish cognitive tempo and its relation with DSM-IV ADHD. Journal of Abnormal Child Psychology, 42, 21–35. https://doi.org/10.1007/s10802-013-9800-6.
Won, K. R., & Lee, H. J. (2019). Academic stress and suicidal ideation: The mediating effects of school connectedness, depression and anxiety in adolescents. Korean Journal of Youth Studies, 26, 79–104. https://doi.org/10.21509/KJYS.2019.09.26.9.79.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Author So-Hee Jung, SoYean Lee, G. Leonard Burns, and Stephen Becker declares that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(DOCX 24 kb)
Rights and permissions
About this article
Cite this article
Jung, SH., Lee, S., Burns, G.L. et al. Internal and External Validity of Self-Report and Parent-Report Measures of Sluggish Cognitive Tempo in South Korean Adolescents. J Psychopathol Behav Assess 43, 355–366 (2021). https://doi.org/10.1007/s10862-020-09821-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-020-09821-8