Optimization of CAMD techniques 3. Virtual screening enrichment studies: a help or hindrance in tool selection?

  • Andrew C. Good
  • Tudor I. Oprea


Over the last few years many articles have been published in an attempt to provide performance benchmarks for virtual screening tools. While this research has imparted useful insights, the myriad variables controlling said studies place significant limits on results interpretability. Here we investigate the effects of these variables, including analysis of calculation setup variation, the effect of target choice, active/decoy set selection (with particular emphasis on the effect of analogue bias) and enrichment data interpretation. In addition the optimization of the publicly available DUD benchmark sets through analogue bias removal is discussed, as is their augmentation through the addition of large diverse data sets collated using WOMBAT.


Virtual screening Enrichment Validation Analogue bias Chemotypes DUD WOMBAT 



This work was supported in part by support the New Mexico Tobacco Settlement fund (TIO). Thanks go to Andrei Leitão of UNM Biocomputing for his help in differentiating WOMBAT HIV NNRTI/NRTI compounds.


  1. 1.
    Gruneberg S, Wendt B, Klebe G (2001) Angew Chem Int Ed Engl 40:389CrossRefGoogle Scholar
  2. 2.
    Wu JH, Batist G (2001) Anticancer Drug Design 16:129Google Scholar
  3. 3.
    Paiva AM, Vanderwall DE, Blanchard JS, Kozarich JW, Williamson JM, Kelly TM (2001) Biochim Biophys Acta 1545:67Google Scholar
  4. 4.
    Perola E, Xu K, Kollmeyer TM, Kaufmann SH, Prendergast FG, Pang Y-P (2000) J Med Chem 43:401CrossRefGoogle Scholar
  5. 5.
    Evers A, Klebe G (2004) J Med Chem 47:5381CrossRefGoogle Scholar
  6. 6.
    Doman TN, McGovern SL, Witherbee BJ, Kasten TP, Kurumbail R, Stallings WC, Connolly DT, Shoichet BK (2002) J Med Chem 45:2213CrossRefGoogle Scholar
  7. 7.
    Brenk R, Naerum L, Gradler U, Gerber H-D, Garcia GA, Reuter K, Stubbs MT, Klebe G (2003) J Med Chem 46:1133CrossRefGoogle Scholar
  8. 8.
    Kitchen DB, Deconrez H, Furr JR, Bajorath J (2004) Nat Rev Drug Discov 3:935CrossRefGoogle Scholar
  9. 9.
    Alvarez JC (2004) Curr Opin Chem Biol 8:365CrossRefGoogle Scholar
  10. 10.
    Shoichet BK (2004) Nature 432:862CrossRefGoogle Scholar
  11. 11.
    Barril X, Hubbard RE, Morley SD (2004) Mini Rev Med Chem 4:779Google Scholar
  12. 12.
    Jansen JM, Martin EJ (2004) Curr Opin Chem Biol 8:359CrossRefGoogle Scholar
  13. 13.
    Krovat EM, Steindl T, Langer T (2005) Curr Comput Aided Drug Des 1:93CrossRefGoogle Scholar
  14. 14.
    Mohan V, Gibbs AC, Cummings MD, Jaeger EP, DesJarlais RL (2005) Curr Pharm Des 11:323CrossRefGoogle Scholar
  15. 15.
    Rajamani R, Good AC (2007) Curr Opin Drug Discov Devel 10:308Google Scholar
  16. 16.
    Charifsen PS, Corkery JJ, Murcko MA, Patrick Walters W (1999) J Med Chem 42:5100CrossRefGoogle Scholar
  17. 17.
    Bissantz C, Folkers G, Rognan D (2000) J Med Chem 43:4759CrossRefGoogle Scholar
  18. 18.
    Miteva MA, Lee WH, Montes MO, Villoutriex BO (2005) J Med Chem 48:6012CrossRefGoogle Scholar
  19. 19.
    Cummings MD, DesJarlais RL, Gibbs AC, Mohan V, Jaeger EP (2005) J Med Chem 48:962CrossRefGoogle Scholar
  20. 20.
    Evers A, Hessler G, Matter H, Klabunde T (2005) J Med Chem 48:5448CrossRefGoogle Scholar
  21. 21.
    Chen H, Lyne PD, Giordanetto F, Lovell T, Li J (2006) J Chem Inf Model 46:401CrossRefGoogle Scholar
  22. 22.
    Warren GL, Andrews CW, Cappelli AM, Clarke B, LaLonde J, Lambert MH, Lindvall M, Nevins N, Semus SF, Senger S, Tedesco G, Wall ID, Woolven JM, Peishoff CE, Head MS (2006) J Med Chem 49:5912CrossRefGoogle Scholar
  23. 23.
    McGaughey GB, Sheridan RP, Bayly CI, Culberson JC, Kreatsoulas C, Lindsley S, Maiorov V, Truchon J-F, Cornell WD (2007) J Chem Inf and Model 47:1504CrossRefGoogle Scholar
  24. 24.
    Huang N, Shoichet BK, Irwin JJ (2006) J Med Chem 49:6789CrossRefGoogle Scholar
  25. 25.
  26. 26.
    Olah M, Mracec M, Ostopovici L, Rad R, Bora A, Hadaruga N, Olah I, Banda M, Simon Z, Mracec M, Oprea TI (2004) In: Oprea TI (ed) WOMBAT: world of molecular bioactivity, in chemoinformatics in drug discovery. Wiley-VCH, New York, pp 223–239Google Scholar
  27. 27.
  28. 28.
  29. 29.
    LIGPREP, developed and distributed by Schrodinger Inc.: 10/07
  30. 30.
    Sadowski J, Gasteiger J (1993) J Chem Rev 7:2567CrossRefGoogle Scholar
  31. 31.
    Pearlman RS (1987) Chem Des Autom News 2:5Google Scholar
  32. 32.
    ROCS, OMEGA and the OECHEM toolkit are all developed and distributed by Openeye Scientific Software Inc: 10/07
  33. 33.
    Pipeline Pilot, developed by Scitegic: 10/07
  34. 34.
    Hawkins PCD, Skillman AG, Nicholls A (2007) J Med Chem 50:74CrossRefGoogle Scholar
  35. 35.
    Pham TA, Jain AN (2006) J Med Chem 49:5856CrossRefGoogle Scholar
  36. 36.
  37. 37.
    Steindl T, Langer T (2004) J Chem Inf Comput Sci 44:1849CrossRefGoogle Scholar
  38. 38.
    Oprea TI, Davis AM, Teague SJ, Leeson PD (2001) J Chem Inf Comput Sci 41:1308CrossRefGoogle Scholar
  39. 39.
    Ghose AK, Pritchett A, Crippen GM (1988) J Comput Chem 9:80CrossRefGoogle Scholar
  40. 40.
    Barnard JM (1993) J Chem Inf Comput Sci 33:532CrossRefGoogle Scholar
  41. 41.
    Gillet VJ, Willett P, Bradshaw J (2003) J Chem Inf Comput Sci 43:346CrossRefGoogle Scholar
  42. 42.
    Jain AN (2007) 234th ACS National Meeting, Boston, USA, Aug 19–23, COMP-147Google Scholar
  43. 43.
    Smith R, Hubbard RE, Gschwend DA, Leach AR, Good AC (2003) J Mol Graph Model 22:41CrossRefGoogle Scholar
  44. 44.
    Good AC, Hermsmeier MA, Hindle SA (2004) J Comput Aided Mol Des 18:529CrossRefGoogle Scholar
  45. 45.
    Oprea TI (2002) J Braz Chem Soc 13:811CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  1. 1.WallingfordUSA
  2. 2.Division of Biocomputing, Department of Biochemistry and Molecular Biology, MSC11 6145University of New Mexico School of MedicineAlbuquerqueUSA

Personalised recommendations