Advertisement

Psychometrics

  • Paul G. Michael
  • Susan T. Li
Reference work entry

Abstract:

Clinical psychologists must develop a specific set of competencies in the area of psychometrics and measurement theory in order to be successful professionals. The competency models put forth by professional organizations within psychology have provided the framework for identifying the broader foundational and functional competencies that pertain to the field of psychometrics, specifically assessment, and research and evaluation. As producers and consumers of research, clinical psychologists must have a firm understanding of measurement development and the ability to interpret and summarize information obtained from various types of assessment tools. Thus, the main focus of this chapter is to describe the application of psychometric concepts in clinical endeavors. Central to this discussion are psychometric concepts such as, scales of measurement, reliability and validity of psychological instruments, and approaches to test theory. Both basic and expert competencies in psychometrics are reviewed and discussed in the context of training professional psychologists at different levels of readiness (e.g., practicum, internship, licensure, etc.). However, it is noted that there are certainly areas in which there may be a difference of opinion as to what constitutes the core body of knowledge in psychometrics. Further, there is less consensus and literature on the definition of expert or master as compared to the articulation of basic competencies. Nonetheless, what is evident is the need to increase efforts to integrate psychology and new innovations occurring in the field of psychometrics. Additionally, as we prepare and train the next generation consideration should be given to developing ways to increase the number of psychologists entering the field of quantitative psychology.

Keywords

Item Response Theory American Psychological Association Clinical Psychologist Classical Test Theory Competency Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.PubMedCrossRefGoogle Scholar
  2. Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R. (1990). Graduate training in statistics, methodology, and measurement in psychology. American Psychologist, 45, 721–734.CrossRefGoogle Scholar
  3. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). The standards for educational and psychological testing. Washington, DC: Author.Google Scholar
  4. American Psychological Association. (2002). Ethical principles of psychologists and code of conduct. American Psychologist, 47, 1597–1611.Google Scholar
  5. American Psychological Association Division 12 Presidential Task Force. (1999). Assessment for the twenty-first century: A model curriculum. Clinical Psychologist, 52, 10–15.Google Scholar
  6. American Psychological Association. (2008). Task force for increasing the number of quantitative psychologists. Retrieved January 2, 2009, from http://www.apa.org/science/bsaweb-tfinqp.html.
  7. Antshel, K. M., & Waisbren, S. A. (2003). Developmental timing of exposure to elevated levels of phenylalanine is associated with ADHD symptom expression. Journal of Abnormal Child Psychology, 31(6), 565–574.PubMedCrossRefGoogle Scholar
  8. Association of State and Provincial Psychology Boards. (2008). Test specifications and summary of EPPP Content Areas. In ASPPB information for candidates (Appendix A). Retrieved September 1, 2008, from http://www.asppb.org/publications/pdf/IFC.pdf.
  9. Boorsboom, D. (2006). The attack of the psychometricians. Psychometrika, 71(3), 425–440.CrossRefGoogle Scholar
  10. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.PubMedCrossRefGoogle Scholar
  11. Channon, S., German, E., Cassina, C., & Lee, P. (2004). Executive functioning, memory, and learning in phenylketonuria. Neuropsychology, 18, 613–620.PubMedCrossRefGoogle Scholar
  12. Childs, R. A., & Eyde, L. D. (2002). Assessment training in clinical psychology doctoral programs: What should we teach? What do we teach? Journal of Personality Assessment, 78(1), 130–144.PubMedCrossRefGoogle Scholar
  13. Clay, R. (2005). Too few in quantitative psychology. Monitor on Psychology, 36(8), 26.Google Scholar
  14. Clemence, A. J., & Handler, L. (2001). Psychological assessment on internship: A survey of training directors and their expectations for students. Journal of Personality Assessment, 76(1), 18–47.PubMedCrossRefGoogle Scholar
  15. Council of Credentialing Organizations in Professional Psychology. (2004). A conceptual framework for specialization in the health service domain of professional psychology. San Diego, CA: Author.Google Scholar
  16. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity of psychological tests. Psychological Bulletin, 52, 281–302.PubMedCrossRefGoogle Scholar
  17. Delis, D. C., Kaplan, E., & Kramer, J. H. (2001). Delis-Kaplan Executive Function System (D-KEFS). Pearson Assessments.Google Scholar
  18. Dugbartey, A. T., Sanchez, P. N., Rosenbaum, J., Mahurin, R. K., Mark Davis, J., & Townes, B. D. (1999). WAIS-III matrix reasoning test performance in a mixed clinical sample. The Clinical Neuropsychologist, 13(4), 396–404.PubMedCrossRefGoogle Scholar
  19. ETS (Educational Testing Service). (2002). ETS standards for quality and fairness. Princeton, NJ: Author.Google Scholar
  20. Fishler, K., Azen, C. G., Henderson, R., Friedman, E. G., & Koch, R. (1987). Psychoeducational findings among children treatment with phenylketonuria. American Journal of Mental Deficiency, 92(1), 65–73.PubMedGoogle Scholar
  21. Gassio, R., Artuch, R., Vilaseca, M. A., Fuste, E., Boix, C., Sans, A., & Campistol, J. (2005). Cognitive functions in classic phenylketonuria and mild hyperphenylalainaemia: Experience in a paediatric population. Develop-mental Medicine & Child Neurology, 47, 443–448.CrossRefGoogle Scholar
  22. Gleason, L. A., Michals, K., Matalon, R., Langenberg, P., & Kamath, S. (1992). A treatment program for adolescents with phenylketonuria. Clinical Pediatrics, 31, 331–335.PubMedCrossRefGoogle Scholar
  23. Griffiths, P., Paterson, L., & Harvie, A. (1995). Neuropsychological effects of subsequent exposure to phenylalanine in adolescents and young adults with early-treated phenylketonuria. Journal of Intellectual Disability Research, 39, 365–372.PubMedCrossRefGoogle Scholar
  24. Hatcher, R. L., & Lassiter, K. D. (2007). Initial training in professional psychology: The practicum competencies outline. Training and Education in Professional Psychology, 1(1), 49–63.CrossRefGoogle Scholar
  25. Ievers-Landis, C. E., Hoff, A. L., Brez, C., Cancilliere, M. K., McConnell, J., & Kerr, D. (2005). Situational analysis of dietary challenges of the treatment regimen for children and adolescents with phenylketonuria and their primary caregivers. Developmental and Behavioral Pediatrics, 26(3), 186–193.CrossRefGoogle Scholar
  26. Institute of Education Sciences. (2008). Program announcement: Postdoctoral research training in the education sciences CFDA 84305B. Retrieved January 2, 2009, from http://ies.ed.gov/funding/.
  27. Interdisciplinary Research Training Programs in the Education Sciences. (2007). Building the capacity for education research. Retrieved January 2, 2009, from http://pirt.wceruw.org/index.php.
  28. Kanaya, T., Scullin, M. H., & Ceci, S. J. (2003). The Flynn effect and U.S. policies: The impact of rising IQ scores on American society via mental retardation diagnoses. American Psychologist, 58, 778–790.PubMedCrossRefGoogle Scholar
  29. Kaslow, N. J. (2004). Competencies in professional psychology. American Psychologist, 59, 774–781.PubMedCrossRefGoogle Scholar
  30. Kaslow, N. J., Borden, K. A., Collins, F. L., Jr., Forrest, L., Illfelder-Kaye, J., Nelson, P. D., & Rallo, J. S. (2004). Competencies conference: Future directions in education and credentialing in professional psychology. Journal of Clinical Psychology, 60(7), 699–712.PubMedCrossRefGoogle Scholar
  31. Koocher, G. P. (1993). Ethical issues in the psychological assessment of children. In Ollendick, T. H., & Hersen, M. (Eds.), Handbook of child and adolescent assessment (pp. 51–61). Boston: Allyn & Bacon.Google Scholar
  32. Krishnamurthy, R., VandeCreek, L., Kaslow, N. J., Tazeau, Y. N., Miville, M. L., Kerns, R., Stegman, R., Suzuki, L., & Benton, S. A. (2004). Achieving competency in psychological assessment: Directions for education and training. Journal of Clinical Psychology, 60(7), 725–739.PubMedCrossRefGoogle Scholar
  33. Levy, L. H. (1974). A multifaceted model of training in psychological assessment. The Clinical Psychologist, 28(1), 16–17.Google Scholar
  34. Marlowe, D. B., Wetzler, S., & Gibbings, E. N. (1992). Graduate training in psychological assessment: What Psy.D.’s and Ph.D.’s must know. The Journal of Training and Practice in Professional Psychology, 6, 9–18.Google Scholar
  35. Merenda, P. F. (2007). Update on the decline in the education and training in psychological measurement and assessment. Psychological Reports, 101(1), 153–155.PubMedCrossRefGoogle Scholar
  36. National Council of Schools and Programs of Professional Psychology. (2007). Competency develop-mental achievement levels (DALs) of the National Council of Schools and Programs in Professional Psy-chology (NCSPP). Retrieved September 1, 2008, from http://www.ncspp.info/DALof%20NCSPP%209-21-07.pdf.
  37. National Institutes of Health Consensus Development Panel. (2001). National Institutes of Health consensus development conference statement: Phenylketonuria: Screening and management, October 16–18, 2000. Pediatrics, 108, 972–982.Google Scholar
  38. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.Google Scholar
  39. Peterson, R. L. (2004). Evaluation and the cultures of professional psychology education programs. Pro-fessional Psychology: Research and Practice, 35, 420–426.CrossRefGoogle Scholar
  40. Peterson, R. L., Peterson, D. R., Abrams, J. C., & Stricker, G. (1997). The National Council of Schools and Programs of Professional Psychology educational model. Professional Psychology: Research and Practice, 28(4), 373–386.CrossRefGoogle Scholar
  41. Piotrowski, C., & Keller, J. W. (1992). Psychological testing in applied settings: A literature review from 1982–1992. The Journal of Training & Practice in Professional Psychology, 6(2), 74–82.Google Scholar
  42. Psychometric Society. (2008). Psychometric Society Homepage. Retrieved January 2, 2009, from http://www.psychometricsociety.org.
  43. Reynolds, C. R. (2007). Subtest level profile analysis of intelligence tests: Editor’s remarks and introduction. Applied Neuropsychology, 14(1), 1.CrossRefGoogle Scholar
  44. Rodolfa, E., Bent, R., Eisman, E., Nelson, P., Rehm, L., & Ritchie, P. (2005). A cube model for competency development: Implications for psychology educators and regulators. Professional Psychology: Research and Practice, 36(4), 347–354.CrossRefGoogle Scholar
  45. Rosenthal, R., & Rosnow, R. L. (1991). Essentials of behavioral research: Methods and data analysis (2nd ed.). New York: McGraw-Hill.Google Scholar
  46. Rubin, N. J., Bebeau, M., Leigh, I. W., Lichtenberg, J. W., Nelson, P. D., Portnoy, S. M., Smith, I. L., & Kaslow, N. J. (2007). The competency movement within psychology: An historical perspective. Professional Psychology: Research and Practice, 38(5), 452–462.CrossRefGoogle Scholar
  47. Ryan, A. M., & Sackett, P. R. (1992). Relationships between graduate training, professional affiliation, and individual psychological assessment practices for personnel decisions. Personnel Psychology, 45, 363–387.CrossRefGoogle Scholar
  48. Society for Personality Assessment. (2006). Standards for education and training in psychological assessment: Position of the society for personality assessment – An official statement of the board of trustees of the society for personality assessment. Journal of Personality Assessment, 87(3), 355–357.Google Scholar
  49. Sullivan, J. E., & Chang, P. (1999). Review: Emotional and behavioral functioning in phenylketonuria. Journal of Pediatric Psychology, 24(3), 281–299.PubMedCrossRefGoogle Scholar
  50. Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103, 677–680.CrossRefGoogle Scholar
  51. Stout, C. E. (1992). Psychological assessment training in professional schools: Literature review and personal impressions. The Journal of Training & Practice in Professional Psychology, 6(1), 14–21.Google Scholar
  52. Streiner, D. L. (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80(1), 99–103.PubMedCrossRefGoogle Scholar
  53. Turner, S. M., DeMers, S. T., Fox, H. R., & Reed, G. M. (2001). APA’s guidelines for test user qualifications: An executive summary. American Psychologist, 56, 1099–1113.CrossRefGoogle Scholar
  54. Wechsler, D. (1955). Wechsler Adult Intelligence Scale (WAIS). New York: Psychological Corporation.Google Scholar
  55. Wechsler, D. (1981). Wechsler Adult Intelligence Scale-Revised (WAIS-R). San Antonio: Psychological Corporation.Google Scholar
  56. Wechsler, D. (1997). Wechsler Adult Intelligence Scale-Third Edition (WAIS-III). San Antonio: Harcourt Assessment.Google Scholar
  57. Wechsler, D. (2001). Wechsler Individual Achievement Test– Second Edition (WIAT-II). Pearson Assessments.Google Scholar
  58. Wechsler, D. (2003). Wechsler Intelligence Scale for Children (WISC-IV). Pearson Assessments.Google Scholar
  59. Wechsler, D. (2008). Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV). Pearson Assessments.Google Scholar
  60. Weiner, I. B. (2007). President’s message: Education and training in personality assessment. Spa Exchange, 19(1), 1–11.Google Scholar
  61. Weiner, E., & Stewart, B. (1984). Assessing individuals. Boston: Little, Brown.Google Scholar
  62. Woodcock, R. W., McGrew, K. S., & Mather, N. (2006). Woodcock-Johnson Tests of Achievement – Third Edition, Norm Update (WJ-III NU). Riverside Publishing.Google Scholar

Copyright information

© Springer Science+Business Media LLC 2010

Authors and Affiliations

  • Paul G. Michael
    • 1
  • Susan T. Li
    • 1
  1. 1.Pacific UniversityHillsboroUSA

Personalised recommendations