Neuropsychology Review

, Volume 5, Issue 3, pp 203–221 | Cite as

Issues associated with repeated neuropsychological assessments

  • Robert J. McCaffrey
  • Holly James Westervelt
Article

Abstract

Distinguishing practice effects from other factors in repeated neuropsychological assessments are discussed in the context of research studies and clinical/forensic assessments. Potential methodological procedures for reducing the impact of practice effects in research settings are outlined. In contrast, the potential clinical utility and interpretation of practice effects in clinical assessments and forensic evaluations are highlighted.

Key Words

practice effects regression to the mean serial assessments forensic evaluations clinical assessments neuropsychological assessment 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Albert, M., Duffy, F. H., and Naeser, M. (1987). Nonlinear changes in cognition with age and their neuropsychological correlates.Canadian Journal of Psychology 41: 141–157.PubMedGoogle Scholar
  2. Anastasi, A. (1988).Psychological testing (6th ed.), Macmillan, New York.Google Scholar
  3. Barth, J. T., Gideon, D. A., Scieara, A. D., Hulsey, P. H., and Anchor, K. N. (1986). Forensic aspects of mild head trauma.Journal of Head Trauma Rehabilitation 1: 63–70.Google Scholar
  4. Brown, S. J., Rourke, B. P., and Cicchetti, D. V. (1989). Rehabilities of tests and measures used in neuropsychological assessment of children.The Clinical Neuropsychologist 3: 353–368.Google Scholar
  5. Bourgeois, B. F. D., Prensky, A. L., Palkes, H. S., Talent, B. K., and Busch, S. G. (1983), Intelligence in epilepsy: A prospective study in children.Annals of Neurology 14: 438–444.PubMedGoogle Scholar
  6. Brouwers, P., and Mohr, E. (1989). A metric for the evaluation of change in clinical trials.Clinical Neuropharmacology 12: 129–133.PubMedGoogle Scholar
  7. Butters, N., Grant, I., Haxby, J., Judd, L. L., Martin, A., McClelland, J., Pequegnat, W., Schacter, D., and Stover, E. (1990). Assessment of AIDS-related cognitive changes: Recommendations of the NIMH workshop on neuropsychological assessment approaches.Journal of Clinical and Experimental Neuropsychology 12: 963–978.PubMedGoogle Scholar
  8. Chelune, G. (1991). Impact of confidence intervals and base-rate data on clinical interpretation [Summary].The Clinical Neuropsychologist 5: 263.Google Scholar
  9. Coutts, R. L., Lichstein, L., Bermudez, J. M., Daigle, M., Mann, D. P., Charbonnel, T. S., Michaud, R., and Williams, C. R. (1987). Treatment assessment of learning disabled children: Is there a role for frequently repeated neuropsychological testing?Archives of Clinical Neuropsychology 2: 237–244.PubMedGoogle Scholar
  10. Dikmen, S., Machamer, J., Temkin, N., and McLean, A. (1990). Neuropsychological recovery in patients with moderate to severe head injury: 2 year follow-up.Journal of Clinical and Experimental Neuropsychology 12: 507–519.PubMedGoogle Scholar
  11. Dirks, J. (1982). The effect of a commerical game on children's Block Design scores on the WISC-R IQ Test.Intelligence 6: 109–123.Google Scholar
  12. Dodrill, C. B., and Troupin, A. S. (1975). Effects of repeated administration of a comprehensive neuropsychological battery among chronic epileptics.Journal of Nervous and Mental Disease 161: 185–190.PubMedGoogle Scholar
  13. Dyche, G. M., and Johnson, D. A. (1991). Development and evaluation of CHIPASAT, an attention test for children: II. Test-retest reliability and practice effect for a normal sample.Perceptual and Motor Skills 72: 563–572.PubMedGoogle Scholar
  14. Francis, D. J., Fletcher, J. M., Davidson, K. C., and Steubing, K. K. (1991). Conceptual and statistical issues in modeling individual growth and recovery [Summary].Journal of Clinical and Experimental Neuropsychology 13: 48–49.Google Scholar
  15. Goldstein, G. (1991). Practice effect phenomena in a national hypertension study [Summary].The Clinical Neuropsychologist 5: 263.Google Scholar
  16. Hays, W. L. (1988).Statistics (4th ed.), Holt, Rinehart and Winston, New York.Google Scholar
  17. Hermann, B., and Wyler, A. R. (1991). The impact of regression toward the mean and interpretation of test-retest data [Summary].The Clinical Neuropsychologist 5: 263.Google Scholar
  18. Johnson, B. F., and Kane, R. L. (1991). An assessment of pretraining, cross-over design, and learning curve analysis in separating practice from medication effects [Summary].Journal of Clinical and Experimental Neuropsychology 13: 50.Google Scholar
  19. Kane, R. L. (1991). Standardized and flexible batteries in neuropsychology: An assessment update.Neuropsychology Review 2: 281–339.PubMedGoogle Scholar
  20. Kay, G. (1991). Repeated testing applications employing computer-based performance assessment measures [Summary].Journal of Clinical and Experimental Neuropsychology 13: 50.Google Scholar
  21. Kilburn, K. H., Warsaw, R. H., and Shields, M. G. (1989). Neurobehavioral dysfunction in firemen exposed to polychlorinated biphenyls (PCBs): Possible improvement after detoxification.Archives of Environmental Health 44: 345–350.PubMedGoogle Scholar
  22. Knight, R. G., and Shelton, E. J. (1983). Tables for evaluating predicted retest changes in Wechsler Adult Intelligence Scale scores.British Journal of Clinical Psychology 22: 77–81.Google Scholar
  23. Levin, H. S., Ewing-Cobbd, L., and Fletcher, J. M. (1989). Neurobehavioral outcome of mild head injury in children. In Levin, H. S., Eisenberg, H. M., and Benton, A. L. (Eds.),Mild Head Injury (pp. 189–213), Oxford University Press, New York.Google Scholar
  24. Lewis, R. F., and Rennick, P. M. (1979).Manual for the repeatable cognitive-Perceptual-Motor Battery. Axon Publishing Company, Grosse Pointe Park, MI.Google Scholar
  25. Lezak, M. D. (1982, June).The test-retest stability and reliability of some tests commonly used in neuropsychological assessment. Paper presented at the fifth European conference of the International Neuropsychological Society, Deauville, France.Google Scholar
  26. Longstreth, L. E., and Alcorn, M. B. (1990). Susceptibility of Weschler Spatial Ability to experience with related games.Educational and Psychological Measurement 50: 1–6.Google Scholar
  27. Matarazzo, J. D., Carmody, T. P., and Jacobs, L. D. (1980). Test-retest reliability and stability of the WAIS: A literature review with implications for clinical practice.Journal of Clinical Neuropsychology 2: 89–105.Google Scholar
  28. Matarazzo, J. D., Weins, A. N., Matarazzo, R. G., and Goldstein, S. G. (1974). Psychometric and clinical test-retest reliability of the Halstead Impairment index in a sample of healthy, young, normal men.The Journal of Nervous and Mental Disease 158: 37–49.PubMedGoogle Scholar
  29. Matarazzo, R. G., Wiens, A. N., Matarazzo, J. D., and Manaugh, T. S. (1973). Test-retest reliability of the WAIS in a normal population.Journal of Clinical Psychology 29: 194–197.Google Scholar
  30. McCaffrey, R. J. (1991). Clinical issues in the reliability and stability of neuropsychological instruments in four patient samples [Summary].The Clinical Neuropsychologist 5: 263–264.Google Scholar
  31. McCaffrey, R. J., Orsillo, S. M., Lefkowicz, D. P., Ortega, A., Haase, R. F., Wagner, H., and Ruckdeschel, J. C. (1990, November).Neuropsychological sequelae of chemotherapy and prophylactic cranial irradiation: An extension of earlier findings. Presented at the Annual Meeding of the National Academy of Neuropsychology, Reno, NV.Google Scholar
  32. McCaffrey, R. J., Ortega, A., Orsillo, S. M., Nelles, W. B., and Haase, R. F. (1992). Practice effects in repeated neuropsychological assessments.The Clinical Neuropsychologist 6: 32–42.Google Scholar
  33. McCaffrey, R. J., Ortega, A., Orsillo, S. M., Haase, R. F., and McCoy, G. C. (1992). Neuropsychological and physical side effects of metoprolol in essential hypertensives.Neuropsychology 6: 225–238.Google Scholar
  34. McCaffrey, R. J., Ortega, A., and Haase, R. F. (1993). Effects of repeated neuropsychological assessments.Archives of Clinical Neuropsychology 8: 519–524.PubMedGoogle Scholar
  35. McCaffrey, R. J., Cousins, J. P., Westervelt, H. J., Martynowicz, M., Remick, S. C., Szebenyi, S., Wagle, W. A., Bottomley, P. A., Hardy, C. J., and Haase, R. F. (1995). Practice effects with the NIMH AIDS Abbreviated Neuropsychological Battery.Archives of Clinical Neuropsychology 10: 241–250.PubMedGoogle Scholar
  36. McCaffrey, R. J., Williams, A. D., Fisher, J. M., and Laing, L. C. (in preparation). The Practice of Forensic Neuropsychology, Plenum Press, New York.Google Scholar
  37. Meredith, W., and Tisak, J. (1990). Latent curve analysis.Psychometrika 55: 107–122.Google Scholar
  38. Mitrushina, M., and Satz, P. (1991). Effect of repeated administration of a neuropsychological battery in the elder.Journal of Clinical Psychology 47: 790–801.PubMedGoogle Scholar
  39. Mohr, E., and Brouwers, P. (Eds.). (1991). Handbook of Clinical Trials: The Neurobehavioral Approach. Swets & Zeitlinger, Netherlands.Google Scholar
  40. Puente, A. E., and McCaffrey, R. J. (Eds.). (1992).Handbook of Neuropsychological Assessment: A Biopsychosocial Perspective, Plenum Press, New York.Google Scholar
  41. Putnam, S. H., Adams, K. M., and Schneider, A. M. (1992). One-day test-retest reliability of neuropsychological tests in a personal injury case.Psychological Assessment 4: 312–316.Google Scholar
  42. Rawlings, D. B., and Crewe, N. M. (1992). Test-retest practice effects and test score changes of the WAIS-R in recovering traumatically brain-injured survivors.The Clinical Neuropsychologist 6: 415–430.Google Scholar
  43. Reitan, R. M., and Wolfson, D. (1993, October). Issues in the interpretation of difficult cases using the Halstead-Reitan neuropsychological test battery. Presented at the annual meeting of the National Academy of Neuropsychology, Phoenix, AZ.Google Scholar
  44. Ryan, J. J., Paolo, A. M., and Brungardt, T. M. (1992). WAIS-R test-retest stability in normal persons 75 years and older.The Clinical Neuropsychologist 6: 3–8.Google Scholar
  45. Schain, R. J., Ward, J. W., and Guthrie, D. (1977). Carbamazepine as an anticonvulsant in children.Neurology 27: 476–480.PubMedGoogle Scholar
  46. Seidenberg, M., O'Leary, D. S., Giordani, B., Berent, S., Boll, T. J. (1981). Test-retest IQ changes of epilepsy patients: Assessing the influence of practice effects.Journal of Clinical Neuropsychology 3: 237–255.PubMedGoogle Scholar
  47. Shatz, M. W. (1981). WAIS practice effects in clinical neuropsychology.Journal of Clinical Neuropsychology 3: 171–179.PubMedGoogle Scholar
  48. Spector, J. (1991). Within-session repeated measures of neuropsychological functioning [Summary].Journal of Clinical and Experimental Neuropsychology 13: 50.Google Scholar
  49. Standards for Educational and Psychological Testing. (1985). American Psychological Association, Washington, DC.Google Scholar
  50. Stuss, D. T., Stethem, L. L., Hugenholtz, H., and Richard, M. T. (1989). Traumatic brain injury: A comparison of three clinical tests, and an analysis of recovery.The Clinical Neuropsychologist 3: 145–156.Google Scholar
  51. Stuss, D. T., Stethem, L. L., and Poirier, C. A. (1987). Comparison of three tests of attention and rapid information processing across six age groups.The Clinical Neuropsychologist 1: 139–152.Google Scholar
  52. Su, R., and Yerxa, E. J. (1984). Comparison of the motor test of the SCSIT and the LNNBC.The Occupational Theorapy Journal of Research 4: 96–108.Google Scholar
  53. Thorndike, R. L. (1949).Personnel Selection, Wiley, New York.Google Scholar
  54. Tisak, J., and Meredith, W. (1989). Exploratory longitudinal factor analysis in multiple populations.Psychometrika 54: 261–281.Google Scholar
  55. Van Gorp, W. G., Lamb, D. G., Schmitt, F. A. (1993). Methodologic issues in neuropsychological research with HIV-spectrum disease.Archives of Clinical Neuropsychology 8: 17–33.PubMedGoogle Scholar
  56. Wechsler, D. (1945). A standardized memory scale for clinical use.Journal of Psychology 19: 87–95.Google Scholar
  57. Welford, A. T. (1985). Practice effects in relation to age: A review and a theory.Developmental Neuropsychology 1: 173–190.Google Scholar
  58. Welford, A. T. (1987). On rates of improvement with practice.Journal of Motor Behavior 19: 401–415.PubMedGoogle Scholar
  59. Zentall, S. S., and Zentall, T. R. (1986). Hyperactivity ratings: Statistical regression provides an insufficient explanation of practice effects.Journal of Pediatric Psychology 11: 393–396.PubMedGoogle Scholar

Copyright information

© Plenum Publishing Corporation 1995

Authors and Affiliations

  • Robert J. McCaffrey
    • 1
  • Holly James Westervelt
    • 1
  1. 1.Department of PsychologyUniversity at Albany, State University of New YorkAlbany

Personalised recommendations