Abstract
The test of variables of attention (TOVA) is a continuous performance test commonly used as an aid for diagnosis of ADHD and assessment of treatment response. It has been studied and standardized in both children and adults. As a repetitive measurement of treatment efficacy, used both in research and in the clinic, it’s important to disprove a practice effect. A retrospective cohort analysis was done, using only the placebo-arm participants from two different randomized, multicenter, double-blind clinical trials on the efficacy of a non-stimulant (metadoxine-XR). In order to reveal the practice effects, only the participants that showed no placebo effect (< 25% improvement), in the Conners’ Adult ADHD Rating Scale–investigator rated (CAARS-Inv), the gold standard, were included. Demographic data, CAARS-Inv baseline and TOVA results during each visit were recorded and analyzed. Ninety-one participants from two studies were pooled (2014 n = 24, 2016 n = 67). They did not differ significantly in any demographic parameter, most side effect frequencies, and CAARS-Inv baseline scores. The baseline TOVA performances demonstrated similarity in the degree of inattention, variability, impulsivity, and response time. The TOVA scores were not altered significantly between visits, as assessed by repeated-measures analysis of variance. No significant differences were detected between the TOVA baseline-to-endpoint scores as assessed by paired t test. No practice effects were detected, in both clinical trials, suggesting that the results of the TOVA are likely to represent genuine changes in attentional performance. Further studies are needed to replicate these findings.
This is a preview of subscription content, log in via an institution to check access.
References
Ben-Sheetrit J, Zurawel M, Weizman A, Manor I (2016) Symptoms versus impairment in adults with ADHD: intercorrelations of the BRIEF-A, CAARS, and TOVA. J Atten Disord. https://doi.org/10.1177/1087054716682334
Ben-Sheetrit J, Peskin M, Newcorn JH, Daniely Y, Shbiro L, Rotem A, Manor I (2018) Characterizing the placebo response in adults with ADHD. J Atten Disord. https://doi.org/10.1177/1087054718780328
Bird CM, Papadopoulou K, Ricciardelli P, Rossor MN, Cipolotti L (2003) Test-retest reliability, practice effects and reliable change indices for the recognition memory test. Br J Clin Psychol 42(4):407–425
Calamia M, Markon K, Tranel D (2012) Scoring higher the second time around: meta-analyses of practice effects in neuropsychological assessment. The Clin Neuropsychol 26(4):543–570
Chen HC, Koh CL, Hsieh CL, Hsueh IP (2009) Test–retest reliability of two sustained attention tests in persons with chronic stroke. Brain Inj 23(9):715–722
Conners CK, Erhardt D, Sparrow E (1999) Conners’ ADULT ADHD Rating Scales (CAARS). Multi-Health Systems, New York
Forbes GB (1998) Clinical utility of the test of variables of attention (TOVA) in the diagnosis of attention-deficit/hyperactivity disorder. J Clin Psychol 54(4):461–476
Goldberg TE, Harvey PD, Wesnes KA, Snyder PJ, Schneider LS (2015) Practice effects due to serial cognitive assessment: implications for preclinical Alzheimer’s disease randomized controlled trials. Alzheimer’s Dement Diagn Assess Dis Monit 1(1):103–111
Greenberg LM, Waldman ID (1993) Developmental normative data on the test of variables of attention (TOVA™). J Child Psychol Psychiatry 34(6):1019–1030
Greenberg LM, Kindschi CL, Dupuy TR, Hughes SJ (1994) Test of variables of attention continuous performance test. The TOVA Company, Alamitos
Heilbronner RL, Sweet JJ, Attix DK, Krull KR, Henry GK, Hart RP (2010) Official position of the American Academy of Clinical Neuropsychology on serial neuropsychological assessments: the utility and challenges of repeat test administrations in clinical and forensic contexts. Clin Neuropsychol 24(8):1267–1278
Loring DW, Meador KJ (2004) Cognitive side effects of antiepileptic drugs in children. Neurology 62(6):872–877
Manor I, Ben-Hayun R, Aharon-Peretz J, Salomy D, Weizman A, Daniely Y, Adler LA (2012) A randomized, double-blind, placebo-controlled, multicenter study evaluating the efficacy, safety, and tolerability of extended-release metadoxine-XR in adults with attention-deficit/hyperactivity disorder. J Clin Psychiatry 73(12):1517–1523
McCaffrey RJ, Duff K, Westervelt HJ (eds) (2000) Practitioner’s guide to evaluating change with neuropsychological assessment instruments. Springer, Berlin
Shahaf G, Nitzan U, Erez G, Mendelovic S, Bloch Y (2018) Monitoring attention in ADHD with an easy-to-use electrophysiological index. Front Hum Neurosci 12:32
Weisler R, Adler L, Rubin J, Daniely Y, Manor I (2014) A phase 3, randomized, double-blind, placebo-controlled study of metadoxine-XR extended release 1400 mg compared with placebo once daily in 300 adults with attention-deficit/hyperactivity disorder. In: Poster session presented at the annual convention of the american academy of child and adolescent psychiatry, San Diego, CA
Wilens TE, Biederman J, Faraone SV, Martelon M, Westerberg D, Spencer TJ (2009) Presenting ADHD symptoms, subtypes, and comorbid disorders in clinically referred adults with ADHD. J Clin Psychiatry 70(11):1557
Zabel TA, von Thomsen C, Cole C, Martin R, Mahone EM (2009) Reliability concerns in the repeated computerized assessment of attention in children. Clin Neuropsychol 23(7):1213–1231
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest regarding the current study.
Informed consent
Informed consent was obtained from all individual participants included in the 2014, 2016 studies in all the centers that were involved in them.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Additional information
It is a submission for the Special Issue “65th birthday Jan Buitelaar.”
Appendices
Appendix 1
Analysis of the actual original data that are shown in Tables 4 and 7.
Appendix 2
Analysis of the actual original data that are shown in Tables 5 and 8.
Appendix 3
Analysis of the actual original data that are shown in Tables 6 and 9.
Rights and permissions
About this article
Cite this article
Rotem, A., Danieli, Y., Ben-Sheetrit, J. et al. Apparent lack of practice effects in the Test of Variables of Attention (TOVA) in adult ADHD. ADHD Atten Def Hyp Disord 11, 73–81 (2019). https://doi.org/10.1007/s12402-018-0278-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12402-018-0278-5