Response Determination Criteria for ELISPOT: Toward a Standard that Can Be Applied Across Laboratories

  • Zoe MoodieEmail author
  • Leah Price
  • Sylvia Janetzki
  • Cedrik M. Britten
Part of the Methods in Molecular Biology book series (MIMB, volume 792)


ELISPOT assay readout is often dichomized as positive or negative responses according to prespecified criteria. However, these criteria can vary widely across institutions. The adoption of a common response criterion is a key step toward cross-laboratory comparability. This chapter describes the two main approaches to response determination, identifying the strengths and limitations of each. Nonparametric statistical tests and consideration of data quality are recommended and instructions provided for their ready implementation by nonstatisticians and statisticians alike.

Key words

ELISPOT assay Positive response criteria Harmonization Replicate variation Statistical hypothesis test 


  1. 1.
    Czerkinsky, C., Andersson, G., Ekre, H.P., Nilsson, L.A., Klareskog, L., and Ouchterlony, O. (1988) Reverse ELISPOT assay for clonal analysis of cytokine production. I. Enumeration of gamma-interferon-secreting cells. J Immunol Methods 110:29–36CrossRefGoogle Scholar
  2. 2.
    Herr, W., Schneider, J., Lohse, A.W., Meyer zum Buschenfelde, K., and Wolfel, T. (1996) Detection and quantification of blood-derived CD8+ T lymphocytes secreting tumor necrosis factor a in response to HLA-A2.1-binding melanoma and viral peptide antigens. J Immunol Methods 191:131–142Google Scholar
  3. 3.
    Herr, W., Protzer, U., Lohse, A.W., Gerken, G., Meyer zum Buschenfelde, K.H., and Wolfel, T. (1998) Quantification of CD8+ T lymphocytes responsive to human immunodeficiency virus (HIV) peptide antigens in HIV-infected patients and seronegative persons at high risk for recent HIV exposure. J Infect Dis 178:260–265Google Scholar
  4. 4.
    Smith, S.G., Joosten. S.A., Verscheure, V., Pathan, A.A., McShane, H., Ottenhoff, T.H., et al. (2009) Identification of major factors influencing ELISpot-based monitoring of cellular responses to antigens from Mycobacterium tuberculosis. PLoS ONE 4(11): e7972. doi: 10.1371/journal.pone.0007972 PubMedCrossRefGoogle Scholar
  5. 5.
    Schloot, N.C., Meierhoff, G., Karlsson, F.M., Ott, P., Putnam, A.,and Lehmann, P., et al. (2003) Comparison of cytokine ELISpot assay formats for the detection of islet antigen autoreactive T cells. Report of the third immunology of diabetes society T-cell workshop. J Autoimmun 21:365–376Google Scholar
  6. 6.
    Asai, T., Storkus, W.J. and Whiteside, T.L. (2000) Evaluation of the modified ELISPOT assay for gamma interferon production in cancer patients receiving antitumor vaccines. Clin Diagn Lab Immunol 7:145–154PubMedGoogle Scholar
  7. 7.
    Cox, J.H., Ferrari, G., and Janetzki, S. (2006) Measurement of cytokine release at the single cell level using the ELISPOT assay. Methods 38:274–282PubMedCrossRefGoogle Scholar
  8. 8.
    Speiser, D.E., Pittet, M.J., Guillaume, P., Lubenow, N., Hoffman, E., Cerottini, J.C., et al. (2004) Ex vivo analysis of human antigen-specific CD8+ T-cell responses: quality assessment of fluorescent HLA-A2 multimer and interferon-gamma ELISPOT assays for patient immune monitoring. J Immunother 27:298–308PubMedCrossRefGoogle Scholar
  9. 9.
    Scheibenbogen, C., Romero, P., Rivoltini, L., Herr, W., Schmittel, A., Cerottini, J.C., et al. (2000) Quantitation of antigen-reactive T cells in peripheral blood by IFNgamma-ELISPOT assay and chromium-release assay: a four-­centre comparative trial. J Immunol Methods 20;244:81–89Google Scholar
  10. 10.
    Janetzki, S., Panageas, K.S., Ben-Porat, L., Boyer, J., Britten, C.M., Clay, T.M., et al. (2008) Results and harmonization guidelines from two large-scale international Elispot proficiency panels conducted by the Cancer Vaccine Consortium (CVC/SVI). Cancer Immunol Immunother 57:303–315PubMedCrossRefGoogle Scholar
  11. 11.
    Britten, C.M., Gouttefangeas, C., Welters, M.J., Pawelec, G., Koch, S., Ottensmeier, C., et al. (2008) The CIMT-monitoring panel: a two-step approach to harmonize the enumeration of antigen-specific CD8+ T lymphocytes by structural and functional assays. Cancer Immunol Immunother 57:289–302PubMedCrossRefGoogle Scholar
  12. 12.
    Cox, J.H., Ferrari, G., Kalams, S.A., Lopaczynski, W., Oden, N., and D’Souza, M.P. (2005) Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses 21:68–81PubMedCrossRefGoogle Scholar
  13. 13.
    Janetzki, S., Britten, C.M., Kalos, M., Levitsky, H.I., Maecker, H.T., Melief, C.J., et al. (2009) “MIATA”-minimal information about T cell assays. Immunity 31:527–528PubMedCrossRefGoogle Scholar
  14. 14.
    Smith, J.G., Joseph, H.R., Green, T., Field, J.A., Wooters, M., Kaufhold, R.M., et al (2007) Establishing acceptance criteria for cell-­mediated-immunity assays using frozen peripheral blood mononuclear cells stored under optimal and suboptimal conditions. Clin Vaccine Immunol 14(5):527–37PubMedCrossRefGoogle Scholar
  15. 15.
    Janetzki, S., Cox, J.H., Oden, N., Ferrari, G. (2005) Standardization and validation issues of the ELISPOT assay. Methods Mol Biol 302:51–86PubMedGoogle Scholar
  16. 16.
    Janetzki, S., Schaed, S., Blachere, N.E., Ben-Porat, L., Houghton, A.N., Panageas, K.S. (2004) Evaluation of Elispot assays: influence of method and operator on variability of results. J Immunol Methods 291(1–2):175–83PubMedCrossRefGoogle Scholar
  17. 17.
    Ryan, J.E., Ovsyannikova, I.G., Dhiman, N., Pinsky, N.A., Vierkant, R.A., Jacobson, R.M., et al. (2005) Inter-operator variation in ELISPOT analysis of measles virus-specific IFN-gamma-secreting T cells. Scand J Clin Lab Invest 65(8):681–9PubMedCrossRefGoogle Scholar
  18. 18.
    Cox, J.H., Ferrari, G., Kalams, S.A., Lopaczynski, W., Oden, N. and D’Souza, M.P. (2005) Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses 21(1):68–81PubMedCrossRefGoogle Scholar
  19. 19.
    Moodie, Z., Price, L., Gouttefangeas, C., Mander, A., Janetzki, S., Lower, M., et al. (2010) Response definition criteria for ELISPOT assays revisited. Cancer Immunol Immunother 59(10):1489–501PubMedCrossRefGoogle Scholar
  20. 20.
    Dubey, S., Clair, J., Fu, T.M., Guan, L., Long, R., Mogg, R., et al. (2007) Detection of HIV vaccine-induced cell-mediated immunity in HIV-seronegative clinical trial participants using an optimized and validated enzyme-linked immunospot assay. J Acquir Immune Defic Syndr 45:20–27PubMedCrossRefGoogle Scholar
  21. 21.
    Hudgens, M.G., Self, S.G., Chiu, Y.L., Russell, N.D., Horton, H. and McElrath, M.J. (2004) Statistical considerations for the design and analysis of the ELISpot assay in HIV-1 vaccine trials. J Immunol Methods 288:19–34PubMedCrossRefGoogle Scholar
  22. 22.
    Moodie, Z., Huang, Y., Gu, L., Hural, J. and Self, S.G. (2006) Statistical positivity criteria for the analysis of ELISpot assay data in HIV-1 vaccine trials. J Immunol Methods 315:121–132PubMedCrossRefGoogle Scholar
  23. 23.
    Herr, W., Linn, B., Leister, N., Wandel, E., Meyer zum Buschenfelde, K., and Wolfel, T. (1997) The use of computer-assisted video image analysis for the quantification of CD8+ T lymphocytes producing tumor necrosis factor spots in response to peptide antigens. J Immunol Methods 203:141–152Google Scholar
  24. 24.
    Westfall, P.H. and Young, S.S. (1993) Resampling-based multiple testing: examples and methods for p-value adjustment. John Wiley and Sons, New YorkGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Zoe Moodie
    • 1
    Email author
  • Leah Price
    • 2
  • Sylvia Janetzki
    • 3
  • Cedrik M. Britten
    • 4
  1. 1.Statistical Center for HIV/AIDS Research and PreventionFred Hutchinson Cancer Research CenterSeattleUSA
  2. 2.Division of Biostatistics, Department of Environmental MedicineNew York University School of MedicineNew YorkUSA
  3. 3.ZellNet Consulting, Inc.Fort LeeUSA
  4. 4.Department of Internal MedicineUniversity Medical Center, Johannes Gutenberg-University Mainz IIIMainzGermany

Personalised recommendations