Field Reliability of Competence to Stand Trial Opinions: How Often Do Evaluators Agree, and What Do Judges Decide When Evaluators Disagree?
- 51 Downloads
Despite many studies that examine the reliability of competence to stand trial (CST) evaluations, few shed light on “field reliability,” or agreement among forensic evaluators in routine practice. We reviewed 216 cases from Hawaii, which requires three separate evaluations from independent clinicians for each felony defendant referred for CST evaluation. Results revealed moderate agreement. In 71% of initial CST evaluations, all evaluators agreed about a defendant’s competence or incompetence (kappa = .65). Agreement was somewhat lower (61%, kappa = .57) in re-evaluations of defendants who were originally found incompetent and sent for restoration services. We also examined the decisions judges made about a defendant’s CST. When evaluators disagreed, judges tended to make decisions consistent with the majority opinion. But when judges disagreed with the majority opinion, they more often did so to find a defendant incompetent than competent, suggesting a generally conservative approach. Overall, results reveal moderate agreement among independent evaluators in routine practice. But we discuss the potential for standardized training and methodology to further improve the field reliability of CST evaluations.
- Bernstein, D. E. (2008). Expert witnesses, adversarial bias, and the (partial) failure of the Daubert revolution. Iowa Law Review, 92, 102–137.Google Scholar
- Boccaccini, M. T., Turner, D., & Murrie, D. C. (2008). Do some evaluators report consistently higher or lower psychopathy scores than others? Findings from a statewide sample of sexually violent predator evaluations. Psychology, Public Policy, and Law, 14, 262–283. doi:10.1037/a0014523.CrossRefGoogle Scholar
- Bonnie, R., & Grisso, T. (2000). Adjudicative competence and youthful offenders. In T. Grisso & R. Schwartz (Eds.), Youth on trial (pp. 73–103). Chicago, IL: University of Chicago Press.Google Scholar
- Fleiss, J. L. (1980). Statistical methods for rates and proportions (2nd ed.). New York: Wiley.Google Scholar
- Golding, S. L. (1992). Studies of incompetent defendants: Research and social policy implications. Forensic Reports, 5, 77–83.Google Scholar
- Golding, S. L. (2008). Evaluations of adult adjudicative competency. In R. Jackson (Ed.), Learning forensic assessment (pp. 75–108). Mahwah, NJ: Erlbaum.Google Scholar
- Goldstein, R. L., & Stone, M. (1977). When doctors disagree: Differing views on competency. Bulletin of the American Academy of Psychiatry and the Law, 8, 90–97.Google Scholar
- Gowensmith, W. N. (2010). Comparison of state forensic evaluation systems in the United States. unpublished data.Google Scholar
- Hart, S. D., & Hare, R. D. (1992). Predicting fitness to stand trial: The relative power of demographic, criminal, and clinical variables. Forensic Reports, 5, 53–65.Google Scholar
- Hawaii Revised Statutes, Vol. 14, 704-404 (2003). doi:10.1007/BF01044699.
- Homant, R. J., & Kennedy, D. B. (1987). Subjective factors in the judgment of insanity. Criminal Justice and Behavior, 14, 38–61. Retrieved from http://proquest.umi.com/pqdweb?did=41435115&Fmt=1&clientId=82498&RQT=309&VName=PQD.
- Laboratory of Community Psychiatry, Harvard Medical School. (1973). Competency to stand trial and mental illness (DHEW Publication No. ADM77-103). Rockville, MD: Department of Health, Education, and Welfare.Google Scholar
- Melton, G. B., Petrila, J., Poythress, N. G., & Slobogin, C. (2007). Psychological evaluations for the courts: A handbook for mental health professionals and lawyers (3rd ed.). New York, NY: The Guilford Press.Google Scholar
- Morris, G. H., Haroun, A. M., & Naimark, D. (2004). Health law in the criminal justice system symposium: Competency to stand trial on trial. Houston Journal of Health Law and Policy, 4, 193–238.Google Scholar
- Murrie, D. C., Boccaccini, M. T., Turner, D., Meeks, M., Woods, C., & Tussey, C. (2009). Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation? Psychology, Public Policy and Law, 15, 19–53. doi:10.1037/a0014897.CrossRefGoogle Scholar
- Perlin, M. L. (2004). Everything’s a little upside down, as a matter of fact the wheels have stopped: The fraudulence of the incompetency evaluation process. Houston Journal of Health Law and Policy, 4, 239–253.Google Scholar
- Pirelli, G., Gottdiener, W. H., & Zapf, P. A. (in press). A meta-analytic review of competency to stand trial research. Psychology, Public Policy, and Law.Google Scholar
- Poythress, N. G., & Stock, H. V. (1980). Competency to stand trial: A historical review and some new data. Psychiatry and Law, 8, 131–146.Google Scholar
- Randolph, J. J. (2008). Online kappa calculator [online application]. Retrieved March 2, 2010, from http://justus.randolph.name/kappa.
- Roesch, R., & Golding, S. L. (1980). Competency to stand trial. Urbana, IL: University of Illinois Press.Google Scholar
- Roesch, R., Zapf, P. A., & Eaves, D. (2006). Fitness interview test-revised: A structured interview for assessing competency to stand trial. Sarasota, FL: Professional Resource Press.Google Scholar
- Rogers, R., & Johannsson-Love, J. (2009). Evaluating competency to stand trial with evidence-based practice. Journal of the Academy of Psychiatry and the Law, 37, 450–460.Google Scholar
- Rogers, R., Tillbrook, C. E., & Sewell, K. W. (2004). Evaluation of competency to stand trial—revised professional manual. Lutz, FL: Psychological Assessment Resources.Google Scholar
- Shuman, D., Whitaker, E., & Champagne, A. (1994). An empirical examination of the use of expert witnesses in the courts—Part II: A three part study. Jurimetrics, 34, 193–208. Retrieved from http://proquest.umi.com/pqdweb?did=41486506&Fmt=1&clientId=82498&RQT=309&VName=PQD.
- Zapf, P. A., & Roesch, R. (2006). Competency to stand trial: A guide for evaluators. In A. K. Hess & I. B. Weiner (Eds.), Handbook of forensic psychology (3rd ed., pp. 305–331). New York: Wiley.Google Scholar
- Zapf, P. A., & Roesch, R. (2009). Evaluation of competence to stand trial. New York, NY: Oxford University Press.Google Scholar