Skip to main content

A Value-Added Methodology for Assessing the Effectiveness of Psychiatric Residency Training

Abstract

Educators often find it difficult to identify variables that accurately assess the knowledge that residents have gained due to their training. Recently in professional education circles, attention has shifted from process to outcome variables, with more emphasis being placed on student gains rather than on program resources. A methodology used extensively to assess undergraduate education is the value-added approach. This methodology is often demonstrated by a change in scores from two administrations of a test instrument that measures students’ specific knowledge or aptitudes. Residency training programs that offer standardized examinations to their residents are in a good position to utilize this evaluation technique. This article will demonstrate how the value-added technique can be used to demonstrate cognitive growth in psychiatric residents by using the Psychiatry Resident In-Training Examination.

This is a preview of subscription content, access via your institution.

References

  1. Talbott MJ, Church K: Evaluation and assessment: a literature review. Arizona Board of Regents’ Task Force on Excellence, Efficiency, and Competitiveness Final Report and Working Papers, 1988

    Google Scholar 

  2. Conrad CC, Wilson RW: Academic program reviews: institutional approaches, expectations, and controversies. ASHE-ERIC Higher Education Report No. 5, 1985

    Google Scholar 

  3. American Association of State Colleges and Universities: Value-added approach to undergraduate assessment, in Pursuit of Degree With Integrity. Washington, DC, American Association of State Colleges and Universities, 1984

    Google Scholar 

  4. McClain CJ: Assessment produces degrees with integrity. Educational Record 1987; 68:47–52

    Google Scholar 

  5. Osigweh CAB: A “value-added” model of measuring performance. College Teaching 1986; 34:28–33

    Article  Google Scholar 

  6. Krueger DW, Heisserer ML: Assessment and involvement: investments to enhance learning, in Student Outcomes Assessment: What Institutions Stand to Gain (New Directions for Higher Education), edited by Halpern DF. San Francisco, CA, Jossey-Bass, 1987

  7. Moran ET: Value-added project in early stages. Liberal Education 1987; 73:31–32

    Google Scholar 

  8. Astin AE, Ayala F: A consortial approach to assessment. Educational Record 1987; 68:47–51

    Google Scholar 

  9. Ory JC, Parker SA: Assessment activities at large research universities. Research in Higher Education 1989;30:375–385

    Article  Google Scholar 

  10. Smeltzer DJ, Jones BA: Reliability and validity of the psychiatry resident in-training examination. Academic Psychiatry 1990; 14:115–121

    Google Scholar 

  11. Pickering JW, Bowers JC: Assessing value-added outcomes assessment. Measurement and Evaluation in Counseling and Development 1990; 22:215–221

    Google Scholar 

  12. Fincher C: What is value-added education? Research in Higher Education 1985; 22:395–398

    Article  Google Scholar 

  13. Johnson ES: Value added: a case study of a geography course. Research Report from Illinois State University, 1987

    Google Scholar 

  14. Perlman CL: Critical factors in applying the value-added model: a Monte Carlo study. Paper presented at the annual meeting of the American Educational Research Association, 1982

    Google Scholar 

  15. Warren J: The blind alley of value added. AAHE Bulletin 1984; 37:10–13

    Google Scholar 

  16. Mohl PC, Miller DA, Sadler JZ: Psychiatry residency accreditation and measuring educational outcomes. Academic Psychiatry (in press)

  17. McMillan JH: Beyond value-added education. Journal of Higher Education 1988; 59:564–579

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Miller, D.A., Mohl, P.C. & Sadler, J.Z. A Value-Added Methodology for Assessing the Effectiveness of Psychiatric Residency Training. Acad Psychiatry 17, 117–124 (1993). https://doi.org/10.1007/BF03341513

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03341513

Keywords

  • Score Change
  • Residency Training
  • Training Director
  • Global Score
  • Residency Training Program