Skip to main content

The Evaluation of Protein Structure Prediction Results

Molecular Biotechnology volume 39, pages 1–8 (2008)Cite this article

Abstract

Methods for protein structure prediction are flourishing and becoming widely available to both experimentalists and computational biologists. However, how good are they? What is their range of applicability and how can we know which method is better suited for the task at hand? These are the questions that this review tries to address, by describing the worldwide Critical Assessment of techniques for protein Structure Prediction (CASP) initiative and focusing on the specific problems of assessing the quality of a protein 3D model.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3

References

  1. Browne, W. J., North, A. C., Phillips, D. C., Brew, K., Vanaman, T. C., & Hill, R. L. (1969). A possible three-dimensional structure of bovine alpha-lactalbumin based on that of hen’s egg-white lysozyme. Journal of Molecular Biology, 42, 65–86.

    PubMed  Article  CAS  Google Scholar 

  2. Moult, J., Pedersen, J., Judson, R., & Fidelis, K. (1995). A large-scale experiment to assess protein structure prediction methods. Proteins, 23, ii–v.

    PubMed  Article  CAS  Google Scholar 

  3. Koh, I. Y., Eyrich, V. A., Marti-Renom, M. A., Przybylski, D., Madhusudhan, M. S., Eswar, N., Grana, O., Pazos, F., Valencia, A., Sali, A., & Rost, B. (2003). EVA: Evaluation of protein structure prediction servers. Nucleic Acids Research, 31, 3311–3315.

    PubMed  Article  CAS  Google Scholar 

  4. Fischer, D., Elofsson, A., & Rychlewski, L. (2000). The 2000 Olympic Games of protein structure prediction; fully automated programs are being evaluated vis-a-vis human teams in the protein structure prediction experiment CAFASP2. Protein Engineering, 13, 667–670.

    PubMed  Article  CAS  Google Scholar 

  5. Chothia, C., & Lesk, A. (1986). The relation between the divergence of sequence and structure in proteins. The EMBO Journal, 5, 823–826.

    PubMed  CAS  Google Scholar 

  6. Sippl, M. J., & Weitckus, S. (1992). Detection of native-like models for amino acid sequences of unknown three-dimensional structure in a data base of known protein conformations. Proteins, 13, 258–271.

    PubMed  Article  CAS  Google Scholar 

  7. Gribskov, M., McLachlan, A. D., & Eisenberg, D. (1987). Profile analysis: Detection of distantly related proteins. Proceedings of the National Academy of Sciences of the United States of America, 84, 4355–4358.

    PubMed  Article  CAS  Google Scholar 

  8. Simons, K. T., Bonneau, R., Ruczinski, I., & Baker, D. (1999). Ab initio protein structure prediction of CASP III targets using ROSETTA. Proteins, S3, 171–176.

    Article  Google Scholar 

  9. Bayley, M. J., Jones, G., Willett, P., & Williamson, M. P. (1998). GENFOLD: A genetic algorithm for folding protein structures using NMR restraints. Protein Science, 7, 491–499.

    PubMed  CAS  Article  Google Scholar 

  10. Eidhammer, I., Jonassen, I., & Taylor, W. R. (2005). Protein bioinformatics: An algorithmic approach to sequence and structure analysis. Chichester: Wiley & Sons.

    Google Scholar 

  11. Kryshtafovych, A., Milostan, M., Szajkowski, L., Daniluk, D., & Fidelis, K. (2005). CASP6 data processing and automatic evaluation at the protein structure prediction center. Proteins, S7, 19–23.

    Article  CAS  Google Scholar 

  12. Moult, J., Fidelis, K., Kryshtafovych, A., Rost, B., Hubbard, T., & Tramontano, A. (2007). Critical assessment of methods of protein structure prediction-Round VII. Proteins, 69, 3–9.

    PubMed  Article  CAS  Google Scholar 

  13. Hubbard, T. J. (1999) RMS/coverage graphs: a qualitative method for comparing three-dimensional protein structure predictions. Proteins, 37(Suppl 3), 15–21.

    Article  Google Scholar 

  14. Zemla, A. (2003). LGA-a method for finding 3D similarities in protein structures. Nucleic Acids Research, 31, 3370–3374.

    PubMed  Article  CAS  Google Scholar 

  15. Cozzetto, D., & Tramontano, A. (2005). Relationship between multiple sequence alignments and quality of protein comparative models. Proteins, 58, 151–157.

    PubMed  Article  CAS  Google Scholar 

  16. Cozzetto, D., & Tramontano, A. (2005). Ten years of predictions...and counting. The FEBS Journal, 272, 881–882.

    PubMed  Article  CAS  Google Scholar 

  17. Valencia, A. (2005). Protein refinement: A new challenge for CASP in ts 10th anniversary. Bioinformatics, 21, 277–277.

    PubMed  Article  CAS  Google Scholar 

  18. Read, R. J., & Chavali, G. (2007). Assessment of CASP7 predictions in the high accuracy template-based modeling category. Proteins, 69, 27–37.

    PubMed  Article  CAS  Google Scholar 

  19. Pieper, U., Eswar, N., Davis, F. P., Braberg, H., Madhusudhan, M. S., Rossi, A., Marti-Renom, M., Karchin, R., Webb, B. M., Eramian, D., Shen, M. Y., Kelly, L., Melo, F., & Sali, A. (2006). MODBASE: A database of annotated comparative protein structure models and associated resources. Nucleic Acids Research, 34, D291–D295.

    PubMed  Article  CAS  Google Scholar 

  20. Kopp, J., & Schwede, T. (2006). The SWISS-MODEL repository: New features and functionalities. Nucleic Acids Research, 34, D315–D318.

    PubMed  Article  CAS  Google Scholar 

  21. Castrignano, T., De Meo, P. D., Cozzetto, D., Talamo, I. G., & Tramontano, A. (2006). The PMDB Protein model database. Nucleic Acids Research, 34, D306–D309.

    PubMed  Article  CAS  Google Scholar 

  22. Laskowski, R. A., Rullmannn, J. A., MacArthur, M. W., Kaptein, R., & Thornton, J. M. (1996). AQUA and PROCHECK-NMR: programs for checking the quality of protein structures solved by NMR. Journal of Bimolecular NMR, 8, 477–486.

    CAS  Google Scholar 

  23. Hooft, R. W., Vriend, G., Sander, C., & Abola, E. E. (1996). Errors in protein structures. Nature, 381, 272.

    PubMed  Article  CAS  Google Scholar 

  24. Sippl, M. J. (1993). Recognition of errors in three-dimensional structures of proteins. Proteins, 17, 355–362.

    PubMed  Article  CAS  Google Scholar 

  25. Eisenberg, D., Luthy, R., & Bowie, J. U. (1997). VERIFY3D: Assessment of protein models with three-dimensional profiles. Methods in Enzymology, 277, 396–404.

    PubMed  CAS  Article  Google Scholar 

  26. Cozzetto, D., Kryshtafovych, A., Ceriani, M., & Tramontano, A. (2007). Assessment of predictions in the model quality assessment category. Proteins, 69, 175–183.

    PubMed  Article  CAS  Google Scholar 

  27. Wallner, B., & Elofsson, A. (2007). Prediction of global and local model quality in CASP7 using Pcons and ProQ. Proteins, 69, 184–193.

    PubMed  Article  CAS  Google Scholar 

  28. Chothia, C., Lesk, A. M., Tramontano, A., Levitt, M., Smith Gill, S. J., Air, G., Sheriff, S., Padlan, E. A., Davies, D., & Tulip, W. R. (1989). Conformations of immunoglobulin hypervariable regions. Nature, 342, 877–883.

    PubMed  Article  CAS  Google Scholar 

  29. Bujnicki, J. M., Elofsson, A., Fischer, D., & Rychlewski, L. (2001). LiveBench-1: Continuous benchmarking of protein structure prediction servers. Protein Science, 10, 352–361.

    PubMed  Article  CAS  Google Scholar 

  30. DeWeese-Scott, C., & Moult, J. (2004). Molecular modeling of protein function regions. Proteins: Structure, Function, and Bioinformatics, 55, 942–961.

    Article  CAS  Google Scholar 

  31. Pizzi, E., Tramontano, A., Tomei, L., La Monica, N., Failla, C., Sardana, M., Wood, T., & De Francesco, R. (1994). Molecular model of the specificity pocket of the hepatitis C virus protease: implications for substrate recognition. Proceedings of the National Academy of Sciences of the United States of America, 91, 888–892.

    PubMed  Article  CAS  Google Scholar 

  32. Giorgetti, A., Raimondo, D., Miele, A. E., & Tramontano, A. (2005). Evaluating the usefulness of protein structure models for molecular replacement. Bioinformatics, 21, ii72–ii76.

    PubMed  Article  CAS  Google Scholar 

  33. Raimondo, D., Giorgetti, A., Giorgetti, A., Bosi, S., & Tramontano, A. (2007). Automatic procedure for using models of proteins in molecular replacement. Proteins, 66, 689–696.

    PubMed  Article  CAS  Google Scholar 

  34. Qian, B., Raman, S., Das, R., Bradley, P., McCoy, A. J., Read, R. J., & Baker, D. (2007). High-resolution structure prediction and the crystallographic phase problem. Nature, 450, 259–264.

    PubMed  Article  CAS  Google Scholar 

Download references

Acknowledgements

This work was partially supported by the BioSapiens project funded by the European Commission within its FP6 Programme, under the thematic area “Life sciences, genomics and biotechnology for health,”contract number LSHG-CT-2003-503265 and by FIRB LIBI and ITALBIONET.

Author information

Affiliations

  1. Department of Biochemical Sciences “Rossi Fanelli”, University of Rome “La Sapienza”, P. le A. Moro, 5, 00185, Rome, Italy

    Domenico Cozzetto, Alejandro Giorgetti, Domenico Raimondo & Anna Tramontano

  2. Istituto Pasteur-Fondazione Cenci Bolognetti, University of Rome “La Sapienza”, P. le A. Moro, 5, 00185, Rome, Italy

    Anna Tramontano

Authors
  1. Domenico Cozzetto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alejandro Giorgetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Domenico Raimondo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anna Tramontano
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anna Tramontano.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Cozzetto, D., Giorgetti, A., Raimondo, D. et al. The Evaluation of Protein Structure Prediction Results. Mol Biotechnol 39, 1–8 (2008). https://doi.org/10.1007/s12033-007-9023-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12033-007-9023-6

Keywords

  • Protein structure prediction
  • Accuracy of protein structure models
  • CASP
  • Structure prediction servers
  • Metapredictors