Abstract
We have developed a new module for higher-order correlated methods up to coupled-cluster singles and doubles with perturbative triples (CCSD(T)). The matrix-matrix operations through the DGEMM routine were pursued for a number of contractions. This code was then incorporated into the ABINIT-MPX program for the fragment molecular orbital (FMO) calculations. Intra-fragment processings were parallelized with OpenMP in a node-wise fashion, whereas the message passing interface (MPI) was used for the fragment-wise parallelization over nodes. Our new implementation made the FMO-based higher-order calculations applicable to realistic proteins. We have performed several benchmark tests on the Earth Simulator (ES2), a massively parallel computer. For example, the FMO-CCSD(T)/6-31G job for the HIV-1 protease (198 amino acid residues)–lopinavir complex was completed in 9.8 h with 512 processors (or 64 nodes). Another example was the influenza neuraminidase (386 residues) with oseltamivir calculated at the full fourth-order Møller–Plesset perturbation level (MP4), of which job timing was 10.3 h with 1024 processors. The applicability of the methods to commodity cluster computers was tested as well.
Similar content being viewed by others
References
Kitaura K, Ikeo E, Asada T, Nakano T, Uebayasi M (1999) Chem Phys Lett 313:701
Fedorov DG, Kitaura K (2007) J Phys Chem A 111:6904
Gordon MS, Mullin JM, Pruitt SR, Roskop LB, Slipchenko LV, Boatz JA (2009) J Phys Chem B 113:9646
Fedorov, DG, Kitaura, K (eds) (2009) The fragment molecular orbital method: practical applications to large molecular systems. CRC Press, Boca Raton
Imamura A, Aoki Y, Maekawa K (1991) J Chem Phys 95:5419
Aoki Y, Imamura A (1992) J Chem Phys 97:8432
Yang W (1991) Phys Rev Lett 66:1438
Akama T, Kobayashi M, Nakai H (2007) J Comput Chem 28:2003
He X, Merz KM Jr (2010) J Chem Theor Comp 6:405
Babu K, Gadre SR (2003) J Comput Chem 24:484
Zhang DW, Zhang JZ (2003) J Chem Phys 119:3599
Huang L, Massa L, Karle J (2005) Int J Quant Chem 103:808
Li W, Fang T, Li S (2006) J Chem Phys 124:154102
Li W, Li S, Jiang Y (2007) J Phys Chem A 111:2193
Gao J (1997) J Phys Chem B 101:657
Song L, Han J, Lin YI, Xie W, Gao J (2009) J Phys Chem A 113:11656
Day NP, Jensen HJ, Gordon SM, Webb PS (1996) J Chem Phys 105:1968
Nagata T, Fedorov DG, Kitaura K, Gordon MS (2009) J Chem Phys 131:024101
Hirata S, Valiev M, Dupuis M, Xantheas SS, Sugiki S, Sekino H (2005) Mol Phys 103:2255
Kamiya M, Hirata S, Valiev M (2008) J Chem Phys 128:074103
Dahlke EE, Truhlar DG (2007) J Chem Theory Comput 3:46
Wang B, Truhlar DG (2010) J Chem Theor Comp 6:359
Beran GJO (2009) J Chem Phys 130:164115
Söderhjelm P, Ryde U (2009) J Phys Chem A 113:617
Mayhall NJ, Raghavachari K (2011) J Chem Theory Comp 7:1336
Stoll H (1992) Chem Phys Lett 191:548
Paulus B, Fulde P, Stoll H (1995) Phys Rev B 51:10572
Seijo L, Barandiarán Z (2004) J Chem Phys 121:6698
Seijo L, Barandiarán Z, Soler JM (2007) Theor Chem Acc 118:541
Szabo A, Ostlund NS (1982) Modern quantum chemistry. MacMillan, New York
Shavitt I, Bartlett RJ (2009) Many-body methods in chemistry and physics. Cambridge Univeristy Press, Cambridge
Bartlett RJ, Musiał M (2007) Rev Mod Phys 79:291
Urban M, Noga J, Cole SJ, Bartlett RJ (1985) J Chem Phys 83:4041
Raghavachari K, Trucks GW, Pople JA, Head-Gordon M (1989) Chem Phys Lett 157:479
Fedorov DG, Olson RM, Kitaura K, Gordon MS, Koseki S (2004) J Comp Chem 25:872
Schmidt MW, Baldridge KK, Boatz JA, Elbert ST, Gordon MS, Jensen JH, Koseki S, Matsunaga N, Nguyen KA, Su SJ, Windus TL, Dupuis M, Montgomery JA (1993) J Comp Chem 14:347 GAMESS
Fedorov DG, Kitaura K (2004) J Chem Phys 121:2483
Fedorov DG, Ishimura K, Ishida K, Kitaura K, Pulay P, Nagase S (2007) J Comp Chem 28:1476
Fedorov DG, Kitaura K (2005) J Chem Phys 123:134103
Nakano T, Kaminuma T, Sato T, Fukuzawa K, Akiyama Y, Uebayasi M, Kitaura K (2002) Chem Phys Lett 351:475
Mochizuki Y, Nakano T, Koikegami S, Tanimori S, Abe Y, Nagashima U, Kitaura K (2004) Theor Chem Acc 112:442
Mochizuki Y, Koikegami S, Nakano T, Amari S, Kitaura K (2004) Chem Phys Lett 396:473
Mochizuki Y, Yamashita K, Murase T, Nakano T, Fukuzawa K, Takematsu K, Watanabe H, Tanaka S (2008) Chem Phys Lett 457:396
Mochizuki Y, Yamashita K, Fukuzawa K, Takematsu K, Watanabe H, Taguchi N, Okiyama Y, Tsuboi M, Nakano T, Tanaka S (2010) Chem Phys Lett 493:346
Ishikawa T, Kuwata K (2009) J Comp Chem 30:2594
Pedersen TB, Aquilante F, Lindh R (2009) Theor Chem Acc 124:1
Ishikawa T, Kuwata K (2009) Chem Phys Lett 474:195
Okiyama Y, Nakano T, Yamashita K, Mochizuki Y, Taguchi N, Tanaka S (2010) Chem Phys Lett 490:84
Rahalkar AP, Katouda M, Gadre SR, Nagase S (2010) J Comp Chem 31:2405
Kobayashi M, Akama T, Nakai H (2006) J Chem Phys 125:204106
Kobayashi M, Imamura Y, Nakai H (2007) J Chem Phys 127:074103
Kobayashi M, Nakai H (2009) J Chem Phys 129:044103
Makowski M, Korchowiec J, Gu FL, Aoki Y (2010) J Comp Chem 31:1733
Ohnishi Y, Hirata S (2010) J Chem Phys 133:034106
Pulay P (1983) Chem Phys Lett 100:151
Saebø S, Pulay P (1987) J Chem Phys 86:914
Saebø S, Pulay P (1993) Ann Rev Phys Chem 44:213
Hampel C, Werner HJ (1996) J Chem Phys 104:6286
Schütz M, Hetzer G, Werner HJ (1999) J Chem Phys 111:5691
Schütz M, Werner HJ (2001) J Chem Phys 114:661
Friedrich J, Hanrath M, Dolg M (2007) J Chem Phys 126:154110
Friedrich J, Dolg M (2008) J Chem Phys 129:244105
Friedrich J, Dolg M (2009) J Chem Theory Comp 5:287
Scuseria GE, Ayala PY (1999) J Chem Phys 111:8330
Subotnik JE, Head-Gordon M (2005) J Chem Phys 123:064108
Subotnik JE, Sodt A, Head-Gordon M (2008) J Chem Phys 128:034103
Li S, Ma J, Jiang Y (2002) J Comput Chem 23:237
Li W, Piecuch P, Gour JR, Li S (2009) J Chem Phys 131:114109
Li W, Piecuch P (2010) J Phys Chem A 114:8644
Ziółkowski M, Jansík B, Kjaergaard T, Jørgensen P (2010) J Chem Phys 133:014107
Scuseria GE, Janssen CL, Schaefer HF III (1988) J Chem Phys 89:7382
Kobayashi R, Rendell AP (1997) Chem Phys Lett 265:1
Pople JA, Head-Gordon M, Raghavachari K (1987) J Chem Phys 87:5968
Pople JA, Head-Gordon M, Raghavachari K (1988) Int J Quant Chem Symp 22:377
Meyer W (1976) J Chem Phys 64:2901
Pulay P, Saebø S, Meyer W (1984) J Chem Phys 81:1901
Koch H, Jensen HJA, Jørgensen P, Helgaker T, Scuseria GE, Schaefer HF III (1990) J Chem Phys 92:4924
Hampel C, Peterson KA, Werner HJ (1992) Chem Phys Lett 190:1
Scuseria GE, Schaefer HF III (1989) J Chem Phys 90:3700
Lee TJ, Rendell AP, Taylor PR (1990) J Phys Chem 94:5463
Ahlrichs R (1979) Comp Phys Comm 17:31
Neese F, Hansen A, Wennmohs F, Grimme S (2009) Acc Chem Res 42:641
Taube AG, Bartlett RJ (2009) J Chem Phys 130:144112
Rendell AP, Lee TJ, Komornicki A (1991) Chem Phys Lett 178:462
Baker DJ, Moncrieff D, Saunders VR, Wilson S (1991) Comp Phys Comm 62:25
Rendell AP, Lee TJ, Lindh R (1992) Chem Phys Lett 194:84
Moncrieff D, Saunders VR, Wilson S (1992) Comp Phys Comm 70:345
Rendell AP, Guest MF, Kendall RA (1993) J Comp Chem 1993(14):1429
Rendell AP, Lee TJ, Komornicki A, Wilson S (1993) Theor Chim Acta 84:271
Nieplocha J, Harrison RJ, Littlefield RJ (1996) J Supercomp 10:169
Watts JD (2000) Para Comp 26:857
Koch H, Sánchezde Merás A, Helgaker T, Christiansen O (1996) J Chem Phys 104:4157
Piecuch P, Landman JI (2000) Para Comp 26:913
Hirata S (2003) J Phys Chem A 107:9887
Piecuch P, Hirata S, Kowalski K, Fan PD, Windus TL (2006) Int J Quant Chem 106:79
Auer AA, Baumgartner G, Bernholdt DE, Bibireata A, Choppella V, Cociorva D, Gao X, Harrison R, Krishanmoorthy S, Krishnan S, Lu Q, Lam C, Nooijen M, Pitzer R, Ramanujam J, Sadayappan P, Sibiryakov A (2006) Mol Phys 104:211
Fletcher GD, Schmidt MW, Bode BM, Gordon MS (2000) Comp Phys Comm 128:190
Olson RM, Bentz JL, Kendall RA, Schmidt MW, Gordon MS (2007) J Chem Theory Comp 3:1312
Bentz JL, Olson RM, Gordon MS, Schmidt MW, Kendall RA (2007) Comp Phys Comm 176:589
Ford AR, Janowski T, Pulay P (2007) J Comp Chem 28:1215
Janowski T, Ford AR, Pulay P (2007) J Chem Theory Comp 3:1368
Janowski T, Pulay P (2008) J Chem Theory Comp 4:1585
Baker J, Wolinski K, Malagoli M, Kinghorn D, Wolinski P, Magyarfalvi G, Saebo S, Janowski T, Pulay P (2009) J Comp Chem 30:317
Harding ME, Metzroth T, Gauss J, Auer AA (2008) J Chem Theory Comp 4:64
Prochnow E, Harding ME, Gauss J (2010) J Chem Theory Comp 6:2339
Lotrich V, Flocke N, Ponton M, Yau AD, Perera A, Deumens E, Bartlett RJ (2008) J Chem Phys 128:194104
Tomasz Kuś, Lotrich VF, Bartlett RJ (2009) J Chem Phys 130:124122
Valiev M, Bylaska EJ, Govind N, Kowalski K, Straatsma TP, Van Dam HJJ, D. Wang, Nieplocha J, Apra E, Windus TL, de Jong WA (2010) Comp Phys Comm 181:1477
Fan PD, Valiev M, Kowalski K (2008) Chem Phys Lett 458:205
Kowalski K, Hammond JR, DeJong WA, Sadlej AJ (2008) J Chem Phys 129:226101
Aprà E, Harrison RJ, Shelton WA, Tipparaju V, Vázquez-Mayagoitia A (2009) J Phys Conf Ser 180:012027
Van Dam HJJ, Vishnu A, de Jong WA (2011) J Chem Theor Comp 7:66
Sosa CP, Scalmani G, Gomperts R, Frisch MJ (2000) Para Comp 26:843
Shellman SD, Lewis JP, Glaesemann KR, Sikorski K, Voth GA (2003) J Comp Phys 188:1
Rudberg E, Rubensson EH, Sałek P (2008) J Chem Phys 128:184106
Kurashige Y, Yanai T (2009) J Chem Phys 130:234114
Woods CJ, Brown P, Manby FR (2009) J Chem Theor Comp 5:1776
Ishimura K, Kuramoto K, Ikuta Y, Hyodo S (2010) J Chem Theor Comp 6:1075
Hohenstein EG, Sherrill CD (2010) J Chem Phys 133:014101
Almlöf J, Faegri K, Korsell K (1982) J Comp Chem 3:385
Pople JA, Binkley S, Seeger R (1976) Int J Quant Chem Symp 10:1
Taylor PR (1987) Int J Quant Chem 31:521
Saebø S, Almlöf J (1989) Chem Phys Lett 154:83
Schütz M, Lindh R, Werner HJ (1999) Mol Phys 96:719
Foresman JB, Frisch A (1996) Exploring chemistry with electronic structure methods, 2nd edn. Gaussian Inc., Pittsburgh
Szakács P, Surján P (2008) Intern J Quant Chem 108:2043
Pulay P (1980) Chem Phys Lett 73:393
Scuseria GE, Lee TJ, Schaefer HF III (1986) Chem Phys Lett 130:236
Mochizuki Y, Fukuzawa K, Kato A, Tanaka S, Kitaura K, Nakano T (2005) Chem Phys Lett 410:247
Amari S, Aizawa M, Zhang J, Fukuzawa K, Mochizuki Y, Iwasawa I, Nakata K, Chuman H, Nakano T (2006) J Chem Inf Model 46:221
Fedorov DG, Kitaura K (2007) J Comp Chem 28:222
Nakano T, Kaminuma T, Sato T, Akiyama Y, Uebayasi M, Kitaura K (2000) Chem Phys Lett 318:614
Obara S, Saika A (1986) J Chem Phys 84:3963
Nishiguchi A, Orii S, Yabe T (1985) J Comp Phys 61:519
Mochizuki Y, Matsumura M, Yokura T, Hirahara Y, Imamura T (2002) J Nucl Sci Tech 39:195
Janssen CL, Nielsen IMB (2008) Parallel computing in quantum chemistry. CRC Press, Boca Raton
Iwata T, Fukuzawa K, Nakajima K, Aida-Hyugaji S, Mochizuki Y, Watanabe H, Tanaka S (2008) Comp Bio Chem 32:198
Takematsu K, Fukuzawa K, Omagari K, Nakajima S, Nakajima K, Mochizuki Y, Nakano T, Watanabe H, Tanaka S (2009) J Phys Chem B 113:4991
Yoshioka A, Fukuzawa K, Mochizuki Y, Yamashita K, Nakano T, Okiyama Y, Nobusawa E, Nakajima K, Tanaka S (2011) J Mol Graph Modell 30:110
Pitoňák M, Neogrády P, Černý J, Grimme S, Hobza P (2009) Chem Phys Chem 10:282
Chiles RA, Dykstra CE (1981) J Chem Phys 74:4544
Handy NC, Pople JA, Head-Gordon M, Raghavachari K, Trucks GW (1989) Chem Phys Lett 164:185
Scuseria GE (1994) Chem Phys Lett 226:251
Koch H, Sánchez de Merás A, Pedersen TB (2003) J Chem Phys 21:1981
Lee TJ, Huang X, Dateo CE (2009) Mol Phys 107:1139
Sánchezde Merás AMJ, Koch H, Cuesta IG, Boman L (2010) J Chem Phys 132:204105
Neogrády P, Pitoňák M, Urban M (2005) Mol Phys 103:2141
Boys SF, Bernardi F (1970) Mol Phys 19:533
Okiyama Y, Fukuzawa K, Yamada H, Mochizuki Y, Nakano T, Tanaka S (2011) Chem Phys Lett 509:67
de Jong WA, Bylaska E, Govind N, Janssen CL, Kowalski K, Müller T, Nielsen IMB, van Dam HJJ, Veryazov V, Lindh R (2010) Phys Chem Chem Phys 6:6896
Nakano T, Mochizuki Y, Yamashita K, Watanabe C, Fukuzawa K, Segawa K, Okiyama Y, Tsukamoto T, Tanaka S (to be published)
Cai J, Rendell AP, Strazdins PE, Wong HJ (2008) Proceeding of 13th IEEE Asia-Pacific computer systems architecture conference:1
Yang R, Cai J, Rendell AP, Ganesh V (2009) International Workshop on OpenMP 2009, LNCS 5568:53
Acknowledgments
This work was supported by the CREST project operated by the Japan Science and Technology Agency (JST) and also by a Grant-in-Aid for Scientific Research on Priority Area "Molecular Theory for Real Systems" from the Ministry of Education, Culture, Sports, Science and Technology of Japan (MEXT). YM and TN are indebted for various supports by the RISS project at the Institute of Industrial Science (IIS) of the University of Tokyo. YM acknowledges the SFR-aid by Rikkyo University as well. Computing resource for all the calculations on the Earth Simulator (ES2) was supplied by the Japan Agency for Marine-Earth Science and Technology (JAMSTEC). The authors thank Dr. Yuto Komeiji for critical comments on the manuscript. Finally, YM is grateful to the late Dr. Hideki Katagiri, who passed away in December 2010, for stimulating discussions on CC theories at the early stage of this work.
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to Professor Shigeru Nagase on the occasion of his 65th birthday and published as part of the Nagase Festschrift Issue.
Rights and permissions
About this article
Cite this article
Mochizuki, Y., Yamashita, K., Nakano, T. et al. Higher-order correlated calculations based on fragment molecular orbital scheme. Theor Chem Acc 130, 515–530 (2011). https://doi.org/10.1007/s00214-011-1036-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00214-011-1036-3