Skip to main content
Log in

Preliminary evaluation of a short version questionnaire for Executive Functioning Self-Report (EF-SR)

  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

The aim of the present study is the development and the evaluation of preliminary psychometric characteristics of a short form self-report questionnaire to assess executive functioning (EF). The research was conducted in a sample of 316 Italian children that attended primary or secondary schools, with an age range between 7 and 11. EFA showed that Executive Functioning Self-Report (EF-SR) is composed of eleven items that are adequately represented by a single factor that characterizes the total score of the EFs. Furthermore, preliminary analyses showed an adequate level of skewness and kurtosis, of internal reliabilities, and test-retest reliability. Finally, the EF-SR showed positive moderate correlation with Stroop Congruent Trials, and with the Stroop Control trials, while the correlations with the other measures were not significance (Color Word Stroop task, the Corsi Block Tapping and the Tower of London), demonstrating appropriate discriminant validity. In conclusion, the EF-SR proves to have the potential to be an easy and fast questionnaire for measuring EF, especially in children.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Acar, I. H., Frohn, S., Prokasky, A., Molfese, V. J., & Bates, J. E. (2019). Examining the associations between performance-based and ratings of focused attention in toddlers: Are we measuring the same constructs? Infant and Child Development, 28(1), e2116.

    Article  PubMed  Google Scholar 

  • Alesi, M., Galassi, C., & Pepi, A. (2017). Programma motorio arricchito (enriched motor program). Parma: Edizioni Junior, Gruppo Spaggiari.

    Google Scholar 

  • Anderson, V. A., Anderson, P., Northam, E., Jacobs, R., & Mikiewicz, O. (2002). Relationships between cognitive and behavioral measures of executive function in children with brain disease. Child Neuropsychology, 8(4), 231–240.

    Article  PubMed  Google Scholar 

  • Baddeley, A. D. (1986). Working memory. New York: Oxford University Press.

    Google Scholar 

  • Berch, D. B., Krikorian, R., & Huha, E. M. (1998). The Corsi block-tapping task: Methodological and theoretical considerations. Brain and Cognition, 38(3), 317–338.

    Article  PubMed  Google Scholar 

  • Berg, W. K., & Byrd, D. L. (2002). The tower of London spatial problem-solving task: Enhancing clinical and research implementation. Journal of Clinical and Experimental Neuropsychology, 24(5), 586–604.

    Article  Google Scholar 

  • Best, J. R., & Miller, P. H. (2010). A developmental perspective on executive function. Child Development, 81(6), 1641–1660.

  • Best, J. R., Miller, P. H., & Jones, L. L. (2009). Executive functions after age 5: Changes and correlates. Developmental Review, 29(3), 180–200.

    Article  PubMed  Google Scholar 

  • Boccia, M., Marin, D., D’Antuono, G., Ciurli, P., Incoccia, C., Antonucci, G., et al. (2017). The tower of London (ToL) in Italy: Standardization of the ToL test in an Italian population. Neurological Sciences, 38(7), 1263–1270.

    Article  PubMed  Google Scholar 

  • Bowie, C. R., & Harvey, P. (2006). Administration and interpretation of the trail making test. Nature Protocols, 1(5), 2277–2281.

    Article  PubMed  Google Scholar 

  • Byerley, A. K., & Donders, J. (2013). Clinical utility of the behavior rating inventory of executive function–self-report (BRIEF–SR) in adolescents with traumatic brain injury. Rehabilitation Psychology, 58(4), 412–421.

    Article  PubMed  Google Scholar 

  • Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21(3), 217–227.

    Article  PubMed  Google Scholar 

  • Choudhury, N., & Gorman, K. S. (2000). The relationship between sustained attention and cognitive performance in 17–24-month old toddlers. Infant and Child Development: An International Journal of Research and Practice, 9(3), 127–146.

    Article  Google Scholar 

  • Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309–319.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd edn.). Hillsdale: Erlbaum.

  • Corsi, P. M. (1972). Human memory and the medial temporal region of the brain. Dissertation Abstracts International, 34, 819B.

    Google Scholar 

  • Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9.

    Google Scholar 

  • Cox, C. S., Chee, E., Chase, G. A., Baumgardner, T. L., Schuerholz, L. J., Reader, M. J., et al. (1997). Reading proficiency affects the construct validity of the Stroop test interference score. The Clinical Neuropsychologist, 11(2), 105–110.

    Article  Google Scholar 

  • DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2, 292–307.

    Article  Google Scholar 

  • Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168.

    Article  PubMed  Google Scholar 

  • Diamond, A., Barnett, W. S., Thomas, J., & Munro, S. (2007). Preschool program improves cognitive control. Science, 318(5855), 1387–1388.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dimitrov, M., Grafman, J., & Hollnagel, C. (1996). The effects of frontal lobe damage on everyday problem solving. Cortex, 32, 357–366.

    Article  PubMed  Google Scholar 

  • Ebesutani, C., Bernstein, A., Martinez, J. I., Chorpita, B. F., & Weisz, J. R. (2011). The youth self report: Applicability and validity across younger and older youths. Journal of Clinical Child & Adolescent Psychology, 40(2), 338–346.

    Article  Google Scholar 

  • FDA. (2006). Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims: Draft guidance. Health and Quality of Life Outcomes, 4, 1–20.

    Article  Google Scholar 

  • Field, A. (2013). Discovering statistics using IBM SPSS statistics (4th ed.). London: Sage.

    Google Scholar 

  • Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). BRIEF: Behavior rating inventory of executive function. Psychological Assessment Resources.

  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Upper Saddle River: Pearson Prentice Hall.

    Google Scholar 

  • Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtis, G. (1993). Wisconsin card sorting test (WCST) manual, revised and expanded. Odessa: Psychological Assessment Resources.

    Google Scholar 

  • Homack, S., & Riccio, C. A. (2004). A meta-analysis of the sensitivity and specificity of the Stroop color and word test with children. Archives of Clinical Neuropsychology, 19(6), 725–743.

    Article  PubMed  Google Scholar 

  • Hughes, D. M., Turkstra, L. S., & Wulfeck, B. B. (2009). Parent and self-ratings of executive function in adolescents with specific language impairment. International Journal of Language & Communication Disorders, 44(6), 901–916.

    Google Scholar 

  • Hughes, C., Ensor, R., Wilson, A., & Graham, A. (2010). Tracking executive function across the transition to school: A latent variable approach. Developmental Neuropsychology, 35, 20–36.

    Article  PubMed  Google Scholar 

  • Jensen, A. R., & Rohwer Jr., W. D. (1966). The Stroop colorword test: A review. Acta Psychologica, 25, 36–93.

    Article  PubMed  Google Scholar 

  • Kessels, R. P. C., van Zandvoort, M. J. E., Postma, A., Kappelle, L. J., & de Haan, E. H. F. (2000). The Corsi block-tapping task: Standardization and normative data. Applied Neuropsychology, 7(4), 252–258.

    Article  PubMed  Google Scholar 

  • Korkman, M., Kirk, U., & Kemp, S. (1998). NEPSY: a developmental neuropsychological assessment. San Antonio: The Psychological Corporation.

    Google Scholar 

  • Köstering, L., Schmidt, C. S., Egger, K., Amtage, F., Peter, J., Klöppel, S., Beume, L. A., Hoeren, M., Weiller, C., & Kaller, C. P. (2015). Assessment of planning performance in clinical samples: Reliability and validity of the tower of London task (TOL-F). Neuropsychologia, 75, 646–655.

    Article  PubMed  Google Scholar 

  • Lee, K., Bull, R., & Ho, R. M. (2013). Developmental changes in executive functioning. Child Development, 84(6), 1933–1953.

    Article  PubMed  Google Scholar 

  • MacLeod, C. M. (1991). Half a century of research on the Stroop effect: an integrative review. Psychological Bulletin, 109(2), 163.

  • Mahone, E. M., Zabel, T. A., Levey, E., Verda, M., & Kinsman, S. (2002). Parent and self-report ratings of executive function in adolescents with myelomeningocele and hydrocephalus. Child Neuropsychology, 8(4), 258–270.

    Article  PubMed  Google Scholar 

  • Marzocchi, G. M., & Valagussa, S. (2011). Le Funzioni esecutive in età evolutiva. Milano: FrancoAngeli.

    Google Scholar 

  • Mellor, D. (2004). Furthering the use of the strengths and difficulties questionnaire: Reliability with younger child respondents. Psychological Assessment, 16(4), 396–401.

    Article  PubMed  Google Scholar 

  • Meyers, L. S., Gamst, G. C., & Guarino, A. J. (2013). Performing data analysis using IBM SPSS. Wiley.

  • Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14.

    Article  PubMed  PubMed Central  Google Scholar 

  • Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100.

    Article  PubMed  Google Scholar 

  • Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., et al. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences, 108(7), 2693–2698.

    Article  Google Scholar 

  • Pennington, B. F., & Ozonoff, S. (1996). Executive functions and developmental psychopathology. Journal of Child Psychology and Psychiatry, 37(1), 51–87.

    Article  PubMed  Google Scholar 

  • Rabbitt, P., Maylor, E., McInnes, L., Bent, N., & Moore, B. (1995). What goods can self-assessment questionnaires deliver for cognitive gerontology? Applied Cognitive Psychology, 9(7), S127–S152.

    Article  Google Scholar 

  • Reitan, R. M. (1955). The relation of the Trail Making Test to organic brain damage. Journal of Consulting Psychology, 19(5), 393–394.

  • Reitan, R. M. (1958). Validity of the trail making test as an Indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276.

    Article  Google Scholar 

  • Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 298(1089), 199–209.

    Article  PubMed  Google Scholar 

  • Shallice, T. I. M., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114(2), 727–741.

    Article  PubMed  Google Scholar 

  • Solanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., Hechtman, L., Hinshaw, S., & Turkel, E. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215–228.

    Article  PubMed  Google Scholar 

  • Spreen, O., & Strauss, E. (1998). A compendium of neuropsychological tests. Administration, norms, and commentary. New York: Oxford University Press.

    Google Scholar 

  • Stanton, J. M., Sinar, E. F., Balzer, W. K., & Smith, P. C. (2002). Issues and strategies for reducing the length of self-report scales. Personnel Psychology, 55, 167–194.

    Article  Google Scholar 

  • Strauss, E., Sherman, E. M. X., & Spreen, O. (2006). A compendium of neuropsychological tests (3rd ed.). New York: Oxford University Press.

    Google Scholar 

  • Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643–662.

    Article  Google Scholar 

  • Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston: Pearson.

    Google Scholar 

  • Theunissen, M. H., Vogels, A. G., de Wolff, M. S., Crone, M. R., & Reijneveld, S. A. (2015). Comparing three short questionnaires to detect psychosocial problems among 3 to 4-year olds. BMC Pediatrics, 15, 1–8.

    Article  Google Scholar 

  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54, 131–143.

    Article  PubMed  Google Scholar 

  • Van der Ven, S. H., Kroesbergen, E. H., Boom, J., & Leseman, P. P. (2012). The development of executive functions and early mathematics: A dynamic relationship. British Journal of Educational Psychology, 82(1), 100–119.

    Article  Google Scholar 

  • Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321–327.

    Article  Google Scholar 

  • Velicer, W. F., Eaton, C. A., & Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In Problems and solutions in human assessment (pp. 41–71). Boston: Springer.

    Chapter  Google Scholar 

  • Vogels, A. G. C. (2008). The identification by Dutch preventive child health care of children with psychosocial problems: Do short questionnaires help? University of Groningen.

  • Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246.

    Article  Google Scholar 

  • Watson, J. C. (2017). Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50, 232–238.

    Article  Google Scholar 

  • Wiebe, S. A., Sheffield, T., Nelson, J. M., Clark, C. A., Chevalier, N., & Espy, K. A. (2011). The structure of executive function in 3-year-olds. Journal of Experimental Child Psychology, 108, 436–452.

    Article  PubMed  Google Scholar 

  • Willoughby, M. T., Blair, C. B., Wirth, R. J., & Greenberg, M. (2012). The measurement of executive function at age 5: Psychometric properties and relationship to academic achievement. Psychological Assessment, 24, 226–239.

    Article  PubMed  Google Scholar 

  • Woods, D. L., Kishiyama, M. M., Yund, E. W., Herron, T. J., Edwards, B., Poliva, O., et al. (2011). Improving digit span assessment of short-term verbal memory. Journal of Clinical and Experimental Neuropsychology, 33(1), 101–111.

    Article  PubMed  PubMed Central  Google Scholar 

  • Xu, F., Han, Y., Sabbagh, M. A., Wang, T., Ren, X., & Li, C. (2013). Developmental differences in the structure of executive function in middle childhood and adolescence. PLoS One, 8(10), e77770.

    Article  PubMed  PubMed Central  Google Scholar 

  • Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in quantitative methods for psychology, 9, 79–94.

    Article  Google Scholar 

  • Zelazo, P. D. (2006). The dimensional change card Sort (DCCS): A method of assessing executive function in children. Nature Protocols, 1, 297–301.

    Article  PubMed  Google Scholar 

Download references

Funding

This work was supported by the Erasmus+ Sport Programme (2017-2019) Call EAC/A04/2015 – Round 2 E+ SPORT PROJECT – 579661-EPP-1-2016-2-IT-SPO-SCP “Enriched Sport Activities Program” – Agreement number 2016-3723/001-001.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sebastiano Costa.

Ethics declarations

Conflict of Interest

The authors declare that the research was conducted in the absence of any potential conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Costa, S., Bianco, A., Scifo, L. et al. Preliminary evaluation of a short version questionnaire for Executive Functioning Self-Report (EF-SR). Curr Psychol 41, 2099–2108 (2022). https://doi.org/10.1007/s12144-020-00733-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12144-020-00733-0

Keywords

Navigation