Abstract
The Rorschach Performance Assessment System (R-PAS; Meyer et al. 2011) is a new system for administering, scoring, and interpreting the Rorschach Inkblot Test that is designed to make the best possible use of currently available scientific and clinical evidence. Many features of R-PAS are well-suited to forensic evaluation generally and to psychological evaluations in psychological injury cases in particular. Among them, R-PAS: (a) offers an alternative to self-report methods that adds incremental validity, (b) provides a useful check against exaggerated or minimized symptom presentation, (d) generates evidence concerning implicit traits and behavioral tendencies, (e) offers techniques for adjusting for abnormal response sets, (f) uses internationally applicable reference data that do not exaggerate or minimize pathology, (g) organizes results according to the strength of the evidence, and (h) presents results on which are interpretations are based in a manner easy for the intelligent layperson to grasp. Despite its recent formal introduction to the professional assessment community, R-PAS takes advantage of decades of research in peer-reviewed publications (including the insights of Rorschach critics) and builds on established validity and general acceptance for most of its procedures and features. The article describes the standards and criteria applying to expert psychological testimony in U.S. federal and state courts and applies them to Rorschach-based testimony in general and R-PAS-based testimony specifically. It is argued that when the system is properly used and applied and when such testimony is appropriately formulated, it should be found admissible in both state and federal courtrooms
Similar content being viewed by others
Notes
For a more comprehensive discussion of these matters, see Faigman, Blumenthal, Cheng, Mnookin, Murphy, & Saunders (2011).
To a large extent, traditional clinical testimony has historically escaped close scrutiny under the Frye standard, either because general acceptance was specifically assumed or because it was considered a less than fully scientific kind of expertise (Melton, Petrila, Poythress, & Slobogin, 2007). For example, in People v. Beckley (1990) the Michigan Supreme Court opined as follows:
Psychologists, when called as experts, do not talk about things or objects; they talk about people. They do not dehumanize people with whom they deal by treating them as objects composed of interacting biological systems. Rather, they speak of the whole person… The experts in each case are merely outlining probable responses to a traumatic event [citation omitted]. It is clearly within the realm of all human experience to expect that a person would react to a traumatic event and that such reactions would not be consistent or predictable in all persons. Finally, there is a fundamental difference between techniques and procedures based on chemical, biological, or other physical sciences as contrasted with theories and assumptions that are based on the behavioral sciences…We would hold that so long as the purpose of the evidence is merely to offer an explanation for certain behavior, the Davis–Frye test is inapplicable. (p. 12).
In a prior case, People v Martin (1971) the Michigan Supreme Court also doubted the reliability of “the field of human medicine” in criminal matters and declined to apply the Davis–Frye standard to expert psychiatric testimony.
In his Introduction to the Federal Judicial Center reference manual on scientific evidence (2000) Justice Stephen Breyer offered the following commentary to clarify the intent of Daubert:
The search is not a search for scientific precision. We cannot hope to investigate all the subtleties that characterize good scientific work. A judge is not a scientist, and a courtroom is not a scientific laboratory. But consider the remark made by the physicist, Wolfgang Pauli. After a colleague asked whether a certain scientific paper was wrong, Pauli replied, “That paper isn’t even good enough to be wrong!” Our objective is to avoid legal decisions that reflect that paper’s so-called science. The law must seek decisions that fall within the boundaries of scientifically sound knowledge. (p. 4).
As explained by Margaret Berger, writing for the Federal Judicial Center Reference Manual on Scientific Evidence (2000):
The Court endorsed a nondoctrinaire, flexible approach that requires district courts to focus “upon the particular circumstances of the particular case at issue.” The Court did not develop further the technique it used in Daubert of pointing to particular factors that spell out reliability with regard to a particular kind of expertise. That is not to say that the factors discussed in Daubert are now irrelevant. They “may or may not be pertinent,” even with regard to expert scientific proof, depending on the issue, the expertise in question, and the subject of the expert’s testimony. The choice of factors to be used in determining reliability is also left to the trial court’s discretion. (p. 38; citations omitted).
Among other guidelines that have been proposed, one of particular interest for R-PAS is from McCormick (1982): analogy to other scientific techniques whose results are admissible.
Indeed, in California alone, the application of Kelly–Frye to as seemingly cut-and-dry a question as the admissibility of DNA-based evidence in criminal cases was the subject of a storm of legal controversy and widely varying judicial results (see Chan, 1995)
Parsi, Berumen, and Packman (2011) wrote:
With the clear and increasing studies evidencing the benefits of the newer RPAS [sic] system over the previous traditional Exner CS approach, it is curious why the RPAS system is not yet more admissible in forensic cases. The reason for this deficiency is that the ability for forensic psychologists to apply the most useful tool at their disposal lies in the “lag time” created between the time that a new scientific tool has been “vetted” by the developers’ peers and the time when its popularity can safeguard it from heated cross-examination. (p. 28).
Similar systematically collected data concerning these variables with children and adolescents are not currently available. For this and other reasons, R-PAS users are cautioned to be particularly cautious and conservative in the inferences they draw based on Rorschach data obtained from children and younger adolescents.
Mihura et al. (2012) studied only CS variables, of which most R-PAS variables (sometimes with minor modifications to improve reliable coding or validity) are a carefully selected subset. Those (non-CS) R-PAS variables not part of the Mihura et al. meta-analysis were selected for their particularly strong empirical support. Thus, we have reason to believe that Mihura et al.’s average effect size for CS variables substantially understates that for R-PAS.
References
Ackerman, M. J. & Ackerman, M. C. (1997). Custody evaluation practice: A survey of experienced professionals (revisited). Professional Psychology: Research and Practice, 28, 137–145.
Ackerman, M. J. & Kane, A. W. (2011). Psychological experts in divorce actions (5th ed.). New York: Aspen.
Archer, R. P., Buffington-Vollum, J. K., Stredney, R. V. & Handel, R. W. (2006). A survey of psychological test use patterns among forensic psychologists. Journal of Personality Assessment, 87, 84–95.
Archer, R. P. & Newsome, C. R. (2000). Psychological test usage with adolescent clients: Survey update. Assessment, 7, 227–235.
Beck, A. T., Steer, R. A., Ball, R. & Ranieri, W. (1996). Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. Journal of Personality Assessment, 67, 588–597.
Boccacini, M. T. & Brodsky, S. L. (1999). Diagnostic test usage by forensic psychologists in emotional injury cases. Professional Psychology: Research and Practice, 30, 253–259.
Bombel, G., Mihura, J. L. & Meyer, G. J. (2009). An examination of the construct validity of the Rorschach Mutual of Autonomy (MOA) Scale. Journal of Personality Assessment, 91, 227–237.
Bornstein, R. F. (1996). Construct validity of the Rorschach Oral Dependency Scale: 1967–1995. Psychological Assessment, 8, 200–205.
Bornstein, R. F. (2002). A process dissociation approach to objective–projective test score interrelationships. Journal of Personality Assessment, 78, 47–68.
Bornstein, R. F. & Masling, J. M. (2005). The Rorschach Oral Dependency Scale. In R. F. Bornstein & J. M. Masling (Eds.), Scoring the Rorschach: Seven validated systems (pp. 135–157). Mahwah: Erlbaum.
Borum, R. & Grisso, T. (1995). Psychological tests and criminal forensic evaluations. Professional Psychology: Research and Practice, 26, 465–473.
Braun v. Lorillard, Inc. (1996). 84 F.3d 230 (7th Cir.), cert. denied, 519 U.S. 992.
Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A. & Kaemmer (2001). Manual for the Minnesota Multiphasic Personality Inventory-2 (MMPI) (rev.). Minneapolis: University of Minnesota Press.
Butcher, J. N. & Rouse, S. V. (1996). Personality: Individual differences and clinical assessment. Annual Review of Psychology, 47, 87–111.
Camara, W. J., Nathan, J. S. & Puente, A. E. (2000). Psychological test usage: Implications in professional psychology. Professional Psychology: Research and Practice, 31, 141–154.
Chan, D. W. (1995). Notes: DNA evidence in California courts: Untangling the doublehelix. San Diego Justice Journal, 2, 239.
Daubert v. Merrell Dow Pharmaceuticals, Inc. (1993). 509, U.S. 579, 113 S.Ct. 2786.
Daubert v. Merrell Dow Pharmaceuticals, Inc. (1995). 43 F.3d 1311 (9th Cir.) [Daubert II]
Dumitrascu, Mihura, & Meyer. (2011, March). Selected R-PAS variables and their relationship to level of education (as a proxy for cognitive sophistication). Paper presented at the annual Meeting of the Society for Personality Assessment, Boston, MA.
Erard, R. E. (2005). What the Rorschach can contribute to custody and parenting time evaluations. Journal of Child Custody, 2(1–2), 119–142.
Erard, R. E. (2007). Picking cherries with blinders on: A comment on Erickson et al. (2007) regarding the use of tests in family court. Family Court Review, 45, 175–184.
Erdberg, P. (2008). Multimethod assessment as a forensic standard. In C. B. Gacono & F. B. Evans (Eds.), The handbook of forensic Rorschach assessment (pp. 561–566). New York: Taylor & Francis.
Erickson, S. K., Lilienfeld, S. O. & Vitacco, M. J. (2007). A critical examination of the suitability and limitations of psychological tests in family court. Family Court Review, 45, 157–174.
Exner, J. E. (2003). The Rorschach: A comprehensive system: Vol. I: Basic foundations (4th ed.). Hoboken: Wiley.
Exner, J. E. (2007). A new U.S. adult nonpatient sample. Journal of Personality Assessment, 89, S154–S158.
Faigman, D. L., Blumenthal, J. A., Cheng, E. K., Mnookin, J. L., Murphy, E. E. & Saunders, J. (2011). Modern scientific evidence: The law and science of expert testimony (2011–2012th ed., Vol. 1). Egan: West.
Federal Judicial Center (2000). Federal Judicial Center reference manual on scientific evidence. (2nd ed.) Retrieved from http://air.fjc.gov/public/fjcweb.nsf/pages/16
Finn, S. E. (2011). Journeys through the valley of death: Multimethod psychological assessment and personality transformation in long-term psychotherapy. Journal of Personality Assessment, 93, 123–141.
First, M. B., Spitzer, R. L., Gibbon, M. & Williams, J. B. W. (2002). Structured Clinical Interview for DSM-IV-TR Axis I Disorders, research version, patient edition. (SCID-I/P). New York: Biometrics Research, New York State Psychiatric Institute.
Foa, E. B., Cashman, L., Jaycox, L. & Perry, K. (1997). The validation of a self-report measure of posttraumatic stress disorder: The Posttraumatic Diagnostic Scale. Psychological Assessment, 9, 445–451.
Foster, S. L. & Cone, J. D. (1995). Validity issues in clinical assessment. Psychological Assessment, 7, 248–260.
Frisch, M. B. (1994). QOLI assessment and treatment manual. San Antonio: Pearson.
Frye v. United States (1923). 392, F. 1013 (D.C. Cir.).
Gacono, C. B., Bannatyne-Gacono, L., Meloy, J. R. & Baity, M. R. (2005). The Rorschach Extended Aggression scores. Rorschachiana, 27, 164–190.
Gacono, C. B. & Evans, F. B. (Eds.). (2008). The handbook of forensic Rorschach assessment (pp. 561–566). New York: Taylor & Francis.
Gacono, C. B. & Meloy, J. R. (1994). The Rorschach assessment of aggressive and psychopathic personalities. Hillsdale: Lawrence Erlbaum.
Ganellen, R. J. (1994). Attempting to conceal psychological disturbance: MMPI defensive response sets and the Rorschach. Journal of Personality Assessment, 63, 423–427.
Ganellen, R. J. (2008). Rorschach assessment of malingering and response sets. In C. B. Gacono & F. B. Evans (Eds.), The handbook of forensic Rorschach assessment (pp. 89–120). New York: Taylor & Francis.
Ganellen, R. J., Wasyliw, O. W., Haywood, T. W. & Grossman, L. S. (1996). Can psychosis be malingered on the Rorschach? An empirical study. Journal of Personality Assessment, 66, 65–80.
Garb, H. N., Lilienfeld, S. O., & Wood, J. M. (2011). Projective techniques: Scientific status. In D. L. Faigman, M. J. Saks, J. Sanders, & E. K. Cheng (Eds.), Modern scientific evidence: The law and science of expert testimony (2011–2012th ed., Vol. 2., pp. 255–288). Egan: West.
General Electric v. Joiner (1997). 522 US 136, 118, S. Ct. 512, 139 L Ed 2d 508.
Grossman, L. S., Wasyliw, O. E., Benn, A. F. & Gyoerkoe, K. L. (2002). Can sex offenders who minimize on the MMPI conceal psychopathology on the Rorschach? Journal of Personality Assessment, 78, 484–501.
Grove, W. M. & Barden, R. C. (1999). Protecting the integrity of the legal system: The admissibility of testimony from mental health experts under Daubert/Kumho analyses. Psychology, Public Policy, and Law, 5, 224–242.
Grove, W. M., Barden, R. C., Garb, H. N. & Lilienfeld, S. O. (2002). Failure of Rorschach-Comprehensive-System-based testimony to be admissible under the Daubert-Joiner-Kumho standard. Psychology, Public Policy, and Law, 8, 216–234.
Hamel, M., Shaffer, T. & Erdberg, P. (2000). A study of nonpatient preadolescent Rorschach protocols. Journal of Personality Assessment, 75, 280–294.
Hemphill, J. F. (2003). Interpreting the magnitudes of correlation coefficients. American Psychologist, 58, 78–79.
Hiller, J. B., Rosenthal, R., Bornstein, R. F., Berry, D. T. R. & Brunell-Neuleib, S. (1999). A comparative meta-analysis of Rorschach and MMPI validity. Psychological Assessment, 11, 279–296.
Hilsenroth, M. J. & Stricker, G. (2004). A consideration of challenges to psychological assessment instruments used in forensic settings: Rorschach as exemplar. Journal of Personality Assessment, 83, 141–152.
Hunsley, J. & Bailey, J. M. (2001). Whither the Rorschach? An analysis of the evidence. Psychological Assessment, 13, 472–485.
Hunsley, J. & Di Giulio, G. (2001). Norms, norming, and clinical assessment. Clinical Psychology: Science and Practice, 8, 378–382.
Kumho Tire v. Carmichael (1999). 526 US, 199 S Ct 1167.
Lilienfeld, S. O., Wood, J. M. & Garb, H. N. (2000). The scientific status of projective techniques. Psychological Science in the Public Interest, 1, 27–66.
McCann, J. T. & Evans, F. B. (2008). Admissibility of the Rorschach. In C. B. Gacono & F. B. Evans (Eds.), The handbook of forensic Rorschach assessment (pp. 55–78). New York: Taylor & Francis.
McClelland, D. C., Koestner, R. & Weinberger, J. (1989). How do self-attributed and implicit motives differ? Psychological Review, 96, 690–702.
McCormick, M. (1982). Scientific evidence: Crafting a new approach to admissibility. Iowa Law Review, 67, 911–912.
McGrath, R. E. (2008). The Rorschach in the context of performance-based personality assessment. Journal of Personality Assessment, 90, 465–475.
Meloy, J. R. (2008). The authority of the Rorschach: An update. In C. B. Gacono & F. B. Evans (Eds.), The handbook of forensic Rorschach assessment (pp. 79–87). New York: Taylor & Francis.
Meloy, J. R., Hansen, T. L. & Weiner, I. B. (1987). Authority of the Rorschach: Legal citations during the past 50 years. Journal of Personality Assessment, 69, 53–82.
Melton, G. B., Petrila, J., Poythress, N. G. & Slobogin, C. (2007). Psychological evaluations for the courts: A handbook for mental health professionals and lawyers (3rd ed.). New York: Guilford.
Meyer, G. J. (1999). The convergent validity of MMPI and Rorschach scales: An extension using profile scores to define response and character styles on both methods and a reexamination of simple Rorschach response frequency. Journal of Personality Assessment, 72, 1–35.
Meyer, G. J. (2004). The reliability and validity of the Rorschach and TAT compared to other psychological and medical procedures: An analysis of systematically gathered evidence. In M. Hilsenroth & D. Segal (Eds.), Personality assessment: Vol. 2. Comprehensive handbook of psychological assessment (pp. 315–342). Hoboken: Wiley.
Meyer, G. J. & Archer, R. P. (2001). The hard science of Rorschach research: Where do we go from here? Psychological Assessment, 13, 486–502.
Meyer, G. J., Erdberg, P. & Shaffer, T. W. (2007). Toward international normative reference data for the Comprehensive System. Journal of Personality Assessment, 89(S1), 201–216.
Meyer, G. J., Hsiao, W.-C., Viglione, D. J., Mihura, J. L., & Abraham, L. H. (2012). A survey of applied clinical validity for the Rorschach. Journal of Personality Assessment. In press
Meyer, G. J., Riethmiller, R. J., Brooks, R. D., Benoit, W. A. & Handler, L. (2000). A replication of Rorschach and MMPI-2 convergent validity. Journal of Personality Assessment, 74, 175–215.
Meyer, G. J., & Viglione, D. J. (2006, March). The influence of R, Form%, R-Engagement, and complexity on interpretive benchmarks for comprehensive system variables. Paper presented at the annual meeting of the Society for Personality Assessment, San Diego, CA.
Meyer, G. J., Viglione, D. J., Mihura, J. L., Erard, R. E. & Erdberg, P. (2011). Rorschach performance assessment system: Administration, coding, interpretation, and technical manual. Toledo: Rorschach Performance Assessment System.
Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2012). A systematic review and meta-analysis of the Rorschach Comprehensive System validity literature. Psychological Bulletin. In press
Millon, T. (2009). Millon Clinical Multiaxial Inventory-III manual (4th ed.). San Antonio: Pearson.
Mnookin, J. L. (2008). Expert evidence, partisanship, and epistemic competence. Brooklyn Law Review, 73, 1009–1033.
Morey, L. C. (1991). Personality Assessment Inventory—professional manual. Lutz: Psychological Assessment Resources.
Musewicz, J., Marczyk, G., Knauss, L. & York, D. (2009). Current assessment practice, personality measurement, and Rorschach usage by psychologists. Journal of Personality Assessment, 91, 453–461.
Parsi, H., Berumen, M. & Packman, W. (2011, July–August). Psychologists’ duty to advance the field: The Rorschach in a forensic setting. California Psychologist, 44, 27–28.
People v. Beckley (1990). 434 Mich. 691; 456 NW2nd 391.
People v. Davis (1955). 343 Mich. 348.
People v. Kelly (1976). 17 Cal.3d 24, 130 Cal.Rptr. 144.
People v. Martin (1971). 386 Mich 407, 421; 192 NW2d 215.
Perry, W. & Viglione, D. J. (1991). The Ego Impairment Index as a predictor of outcome in melancholic depressed patients treated with tricyclic antidepressants. Journal of Personality Assessment, 56, 487–501.
Piotrowski, C. & Zalewski, C. (1993). Training in psychodiagnostic testing in APA-approved PsyD and PhD clinical psychology programs. Journal of Personality Assessment, 61, 394–405.
Quinnell, F. A. & Bow, J. N. (2001). Psychological tests used in child custody evaluations. Behavioral Sciences & the Law, 19, 491–501.
Ramirez v. State (1995). 651 So.2d 1164 (Fla.).
Ritzler, B., Erard, R. & Pettigrew, G. (2002a). Protecting the integrity of Rorschach expert witnesses: A reply to Grove and Barden (1999) re: The admissibility of testimony under Daubert/Kumho analyses. Psychology, Public Policy, and Law, 8(2), 201–215.
Ritzler, B., Erard, R. & Pettigrew, G. (2002b). A final reply to Grove and Barden: The relevance of the Rorschach Comprehensive System for expert testimony. Psychology, Public Policy, and Law, 8(2), 236–246.
Rogers, R., Bagby, R. M. & Dickens, S. E. (1992). Structured Interview of Reported Symptoms (SIRS), Professional manual. Lutz: Psychological Assessment Resources.
Shaffer, T. W., Erdberg, P. & Haroian, J. (1999). Current nonpatient data for the Rorschach, WAIS-R, and MMPI-2. Journal of Personality Assessment, 73, 305–316.
Shaffer, T. W., Erdberg, P., & Meyer, G. J. (Eds.). (2007). International reference samples for the Rorschach Comprehensive System [Special issue]. Journal of Personality Assessment, 89(S1).
Shedler, J., Mayman, M. & Manis, M. (1993). The illusion of mental health. American Psychologist, 48, 1117–1131.
Stokes, J. M., Pogge, D. L., Powell-Lunder, J., Ward, A. W., Bilginer, L. & Deluca, V. A. (2003). The Rorschach Ego Impairment Index: Predicting treatment outcome in a child population. Journal of Personality Assessment, 81, 11–19.
Tibon, S. & Rothschild, L. (2009). Exploring the clinical implications of the international CS reference data for children and adolescents. Journal of Personality Assessment, 91, 497–499.
Urist, J. (1977). The Rorschach test and the assessment of object relations. Journal of Personality Assessment, 41(1), 3–9.
U.S. v. Battle (2001). 235 F. Supp 2d 1301.
Viglione, D. J., Perry, W., Giromini, L. & Meyer, G. J. (2011). Revising the Rorschach Ego Impairment Index to accommodate recent recommendations about improving Rorschach validity. International Journal of Testing, 11, 349–364.
Viglione, D. J. & Rivera, B. (2003). Assessing personality and psychopathology with projective methods. In J. R. Graham & J. A. Naglieri (Eds.), Handbook of psychology: Assessment psychology (Vol. 10, pp. 531–552). Hoboken: Wiley.
Watkins, C. E., Campbell, V. L., Nieberding, R. & Hallmark, R. (1995). Contemporary practice of psychological assessment by clinical psychologists. Professional Psychology: Research and Practice, 26, 54–60.
Weiner, I. B. (1999). What the Rorschach can do for you: Incremental validity in clinical applications. Assessment, 6, 327–339.
Weiner, I., Exner, J. & Sciara, A. (1996). Is the Rorschach welcome in the courtroom? Journal of Personality Assessment, 67, 422–424.
Wood, J. M., Nezworski, M. T., Garb, H. N. & Lilienfeld, S. O. (2001). The misperception of psychopathology: Problems with the norms of the comprehensive system for the Rorschach. Clinical Psychology: Science and Practice, 8, 350–373.
Wood, J. M., Nezworski, M. T., Lilienfeld, S. O., & Garb, H. N. (2009). Projective techniques in the courtroom. In J. L. Skeem, K. S. Douglas, & S. O. Lilienfeld (Eds.), Psychological Science in the Courtroom: Controversies and consensus (pp. 203–223). New York: Guilford.
Acknowledgments
The author wishes to thank Philip Erdberg, Barbara Erard, Greg Meyer, and Donald Viglione for comments on earlier drafts of this article.
Author information
Authors and Affiliations
Corresponding author
Additional information
The R-PAS Manual, web-based scoring service, and other R-PAS products and services are sold by Rorschach Performance Assessment System LLC, in which the author has a financial interest.
Rights and permissions
About this article
Cite this article
Erard, R.E. Expert Testimony Using the Rorschach Performance Assessment System in Psychological Injury Cases. Psychol. Inj. and Law 5, 122–134 (2012). https://doi.org/10.1007/s12207-012-9126-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12207-012-9126-7