Abstract
Two Bayesian techniques are described in this chapter and compared for interstate conflict prediction. The first one is the Bayesian technique that applies the Gaussian approximation approach to approximate the posterior probability for neural network weights, given the observed data and the evidence framework to train a multi-layer perceptron neural network. The second one treats the posterior probability as is, and then applies the hybrid Monte Carlo technique to train the multi-layer perceptron neural network. When these techniques are applied to model militarized interstate disputes, it is observed that training the neural network with the posterior probability as is, and applying the hybrid Monte Carlo technique gives better results than approximating the posterior probability with a Gaussian approximation method and then applying the evidence framework to train the neural network.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Akhmatskaya, E., Bou-Rabee, N., Reich, S.: A comparison of generalized hybrid Monte Carlo methods with and without Momentum Flip. J. Comput. Phys. 228, 2256–2265 (2009)
Aleksandrov, T., Desgranges, C., Delhommelle, J.: Vapor-liquid equilibria of copper using hybrid Monte Carlo Wang-Landau simulations. Fluid Phase Equilib. 287, 79–83 (2010)
Bazavov, A., Berg, B.A., Zhou, H.: Application of biased metropolis algorithms: from protons to proteins. Math. Comput. Simul. (2009). doi:doi:10.1016/j.matcom.2009.05.005
Beck, N., King, G., Zeng, L.: Improving quantitative studies of international conflict: a conjecture. Am. Politic Sci. Rev. 94, 21–35 (2000)
Bedard, M.: Optimal acceptance rates for metropolis algorithms: moving beyond 0.234. Stoch. Process Appl. 118, 2198–2222 (2008)
Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, London (1995)
Bogaerts, A.: Effects of oxygen addition to Argon glow discharges: a hybrid Monte Carlo-fluid modeling investigation. Spectro. Acta. Part B Atomic. Spectro. 64, 1266–1279 (2009)
Bryan, K., Cunningham, P., Bolshkova, N.: Application of simulated annealing to the biclustering of gene expression data. IEEE Trans. Inf. Technol. Biomed. 10, 519–525 (2006)
Casella, G., George, E.I.: Explaining the Gibbs sampler. Am. Stat. 46, 167–174 (1992)
Coles, M.D., Azzi, D., Haynes, B.P., Hewitt, A.: A Bayesian network approach to a biologically inspired motion strategy for mobile wireless sensor networks. Ad. Hoc. Nets. 7, 1217–1228 (2009)
Cosola, E., Genovese, K., Lamberti, L., Pappalettere, C.: A general framework for identification of hyper-elastic membranes with Moire techniques and multi-point simulated annealing. Int. J. Solids Struct. 45, 6074–6099 (2008)
Cretu, N., Pop, M.: Acoustic behavior design with simulated annealing. Comput. Mater. Sci. 44, 1312–1318 (2009)
Curran, J.M.: A MCMC method for resolving two person mixtures. Sci. Justice 48, 168–177 (2008)
Dafflon, B., Irving, J., Holliger, K.: Simulated-annealing-based conditional simulation for the local-scale characterization of heterogeneous aquifers. J. Appl. Geophys. 68, 60–70 (2009)
Do, H., Wheatley, R.J., Hirst, J.D.: Microscopic structure of liquid 1-1-1-2-Tetrafluoroethane (R134a) from Monte Carlo simulation. Phys. Chem. Chem. Phys. 12, 13266–13272 (2010)
Drugan, M.M., Thierens, D.: Recombination operators and selection strategies for evolutionary Markov Chain Monte Carlo algorithms. Evol. Intell. 3, 79–101 (2010)
Dunn, W.L., Shultis, J.K.: Monte Carlo methods for design and analysis of radiation detectors. Radiat. Phys. Chem. 78, 852–858 (2009)
El-Mahallawy, A.A., Yousef, H.A., El-Singaby, M.I., Madkour, A.A., Youssef, A.M.: Robust flight control system design using H∞ loop-shaping and recessive trait crossover genetic algorithm. Expert Syst. Appl. 38, 169–174 (2011)
Esat, I.I., Saud, M., Naci Engin, S.: A novel method to obtain a real-time control force strategy using genetic algorithms for dynamic systems subjected to external arbitrary excitations. J. Sound Vib. 330, 27–48 (2011)
Fefelov, V.F., Gorbunov, V.A., Myshlyavtsev, A.V., Myshlyavtseva, M.D.: The simplest self-assembled Monolayer model with different orientations of complex organic molecules – Monte Carlo and transfer-matrix techniques. Chem. Eng. J. 154, 107–114 (2009)
Gallagher, K., Charvin, K., Nielsen, S., Sambridge, M., Stephenson, J.: Markov Chain Monte Carlo (MCMC) sampling methods to determine optimal models, model resolution and model choice for earth science problems. Mar. Pet. Geol. 26, 525–535 (2009)
Gauchere, C., Campillo, F., Misson, L., Guiot, J., Boreux, J.J.: Parameterization of a process-based tree-growth model: comparison of optimization. MCMC and particle filtering algorithms. Environ. Model. Softw. 23, 1280–1288 (2008)
Gelman, A., Carlin, J.B., Stern, H.S., Rubin, D.B.: Bayesian Data Analysis. Chapman & Hall, London (1995)
Ghoufi, A., Maurin, G.: Hybrid Monte Carlo simulations combined with a phase mixture model to predict the structural transitions of a porous metal-organic framework material upon adsorption of guest molecules. J. Phys. Chem. C 114, 6496–6502 (2010)
Gillespie, J.V., Zinnes, D.A., Tahim, G.S., Schrodt, P.A., Rubison, R.M.: An optimal control model of arms race. Am. Politic Sci. Rev. 71, 226–244 (1977)
Gochman, C., Maoz, Z.: Militarized interstate disputes 1816–1976. In: Singer, D., Diehl, P. (eds.) Measuring the Correlates of War. University of Michigan Press, Ann Arbor (1990)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, Reading (1989)
Holland, J.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
Hossein-Zadeh, N.G., Ardalan, M.: Bayesian estimates of genetic parameters for metritis, retained placenta, milk fever, and clinical mastitis in holstein dairy cows via Gibbs sampling. Res. Vet. Sci. 90, 146–149 (2010a)
Hossein-Zadeh, N.G., Ardalan, M.: Estimation of genetic parameters for body weight traits and litter size of Moghani sheep, using a Bayesian approach via Gibbs sampling. J. Agric. Sci. 148, 363–370 (2010b)
Jacquier, E., Johannes, M., Polson, N.: MCMC maximum likelihood for latent state models. J Econ. 137, 615–640 (2007)
Jia, Y., Zhang, C.: Front-view vehicle detection by Markov Chain Monte Carlo method. Pattern Recognit. 42, 313–321 (2009)
Jing, L., Vadakkepat, P.: Interacting MCMC particle filter for tracking maneuvering target. Dig. Signal Process (2009). doi:10.1016/j.dsp. 2009.08.011
Jun, S.C., George, J.S., Kim, W., Pare-Blagoev, J., Plis, S., Ranken, D.M., Schmidt, D.M.: Bayesian brain source imaging based on combined MEG/EEG and fMRI using MCMC. NeuroImage 40, 1581–1594 (2008)
Kandela, B., Sheorey, U., Banerjee, A., Bellare, J.: Study of tablet-coating parameters for a pan coater through video imaging and Monte Carlo simulation. Powder Technol. 204, 103–112 (2010)
Kannan, S., Zacharias, M.: Simulated annealing coupled replica exchange molecular dynamics–an efficient conformational sampling method. J. Struct. Biol. 166, 288–294 (2009)
Kaya, M.: The effects of two new Crossover operators on genetic algorithm performance. Appl. Soft Comput. J. 11, 881–890 (2011)
Kulak, L.: Hybrid Monte-Carlo simulations of fluorescence anisotropy decay in three-component donor-mediator-acceptor systems in the presence of energy transfer. Chem. Phys. Letts. 467, 435–438 (2009)
Lagazio, M., Marwala, T.: Assessing different Bayesian neural network models for militarized interstate dispute. Soc. Sci. Comp. Rev. 2005, 1–12 (2005)
Lagazio, M., Russett, B.: A neural network analysis of MIDs, 1885–1992: are the patterns stable? In: Diehl, P. (ed.) The Scourge of War: New Extensions on an Old Problem. University of Michigan Press, Ann Arbor (2004)
Lai, Y.: Adaptive Monte Carlo methods for matrix equations with applications. J. Comput. Appl. Math. 231, 705–714 (2009)
Liesenfeld, R., Richard, J.: Improving MCMC, using efficient importance sampling. Comput. Stat. Data Anal. 53, 272–288 (2008)
Liu, X., Newsome, D., Coppens, M.: Dynamic Monte Carlo simulations of binary self-diffusion in ZSM-5. Microp. Mesop. Mater. 125, 149–159 (2009)
Lombardi, M.J.: Bayesian inference for [Alpha]-stable sistributions: a random walk MCMC approach. Comput. Stat. Data Anal. 51, 2688–2700 (2007)
MacKay, D.J.C.: A practical Bayesian framework for backpropagation networks. Neural Comp. 4, 448–472 (1992)
MacKay, D.J.C.: Bayesian methods for adaptive models. Ph.D. thesis, California Institute of Technology (1991)
Malve, O., Laine, M., Haario, H., Kirkkala, T., Sarvala, J.: Bayesian modelling of algal mass occurrences – using adaptive MCMC methods with a lake water quality model. Environ. Model. Softw. 22, 966–977 (2007)
Martin, C., Ayesa, E.: An integrated Monte Carlo methodology for the calibration of water quality models. Ecol. Model. 221, 2656–2667 (2010)
Marwala, T.: Bayesian training of neural network using genetic programming. Pattern Recognit. Lett. (2007). doi:org/10.1016/j.patrec.2007.034
Marwala, T.: Computational Intelligence for Missing Data Imputation, Estimation and Management: Knowledge Optimization Techniques. IGI Global Publications, New York (2009)
Marwala, T.: Finite Element Model Updating Using Computational Intelligence Techniques. Springer, London (2010)
Marwala, T.: Fault identification using neural networks and vibration data. Ph.D. thesis, University of Cambridge (2001)
Marwala, T., Lagazio, M., Tettey, T.: An integrated human-computer system for controlling interstate disputes. Int. J. Comp. Appl. 31, 239–246 (2009)
Mathe, P., Novak, E.: Simple Monte Carlo and the Metropolis algorithm. J. Complex. 23, 673–696 (2007)
McClarren, R.G., Urbatsch, T.J.: A modified implicit Monte Carlo method for time-dependent radiative transfer with adaptive material coupling. J. Comput. Phys. 228, 5669–5686 (2009)
Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., Teller, E.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21, 1087–1092 (1953)
Meyer, R., Cai, B., Perron, F.: Adaptive rejection metropolis sampling using lagrange interpolation polynomials of degree 2. Comput. Stat Data Anal. 52, 3408–3423 (2008)
Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs. Springer, New York (1996)
Moller, M.: A scaled conjugate gradient algorithm for fast supervised learning. Neural Nets. 6, 525–533 (1993)
Moskovkin, P., Hou, M.: Metropolis Monte Carlo predictions of free Co-Pt nanoclusters. J. Alloy Compd. 434–435, 550–554 (2007)
Naderi, B., Zandieh, M., Khaleghi, A., Balagh, G., Roshanaei, V.: An improved simulated annealing for hybrid flowshops with sequence-dependent setup and transportation times to minimize total completion time and total tardiness. Expert Syst. Appl. 36, 9625–9633 (2009)
Natesan, P., Limbers, C., Varni, J.W.: Bayesian estimation of graded response multilevel models using Gibbs sampling: formulation and illustration. Educ. Psychol. Meas. 70, 420–439 (2010)
Neal, R.M.: Probabilistic inference using Markov Chain Monte Carlo methods, University of Toronto Technical Report CRG-TR-93-1, Toronto (1993)
Oliveira, R.G., Schneck, E., Quinn, B.E., Konovalov, O.V., Brandenburg, K., Seydel, U., Gill, T., Hanna, C.B., Pink, D.A., Tanaka, M.: Physical mechanisms of bacterial survival revealed by combined grazing-incidence X-ray scattering and Monte Carlo simulation. Comptes Rendus Chimie 12, 209–217 (2009)
Onieva, E., Naranjo, J.E., Milanés, V., Alonso, J., García, R., Pérez, J.: Automatic lateral control for unmanned vehicles via genetic algorithms. Appl. Soft Comput. J. 11, 1303–1309 (2011)
Ozaki, M., Ohno, M., Terada, Y., Watanabe, S., Mizuno, T., Takahashi, T., Kokubun, M., Tsujimoto, M., Yamasaki, N.Y., Odaka, H., Takei, Y., Yuasa, T., Furuzawa, A., Mori, H., Matsumoto, H., Okajima, T., Kilbourne, C.A., Tajima, H., Ishisaki, Y.: The Monte Carlo simulation framework of the ASTRO-H X-Ray observatory. In: Proc of SPIE – The Intl Soc for Optical Eng:7732, Art No 773239 (2010)
Ozgan, E., Saruhan, H.: Modeling of Asphalt concrete via simulated annealing. Adv. Eng. Softw. 41, 680–683 (2010)
Padilla Cabal, F., Lopez-Pino, N., Luis Bernal-Castillo, J., Martinez-Palenzuela, Y., Aguilar-Mena, J., D’Alessandro, K., Arbelo, Y., Corrales, Y., Diaz, O.: Monte Carlo based geometrical model for efficiency calculation of an N-type HPGe detector. Appl. Radiat. Isotopes 68, 2403–2408 (2010)
Paydar, M.M., Mahdavi, I., Sharafuddin, I., Solimanpur, M.: Applying simulated annealing for designing cellular manufacturing systems using MDmTSP. Comp. Ind. Eng. 59, 929–936 (2010)
Pedamallu, C.S., Ozdamar, L.: Investigating a hybrid simulated annealing and local search algorithm for constrained optimization. Eur. J. Oper. Res. 185, 1230–1245 (2008)
Qian, G., Li, N., Huggins, R.: Using capture-recapture data and hybrid Monte Carlo sampling to estimate an animal population affected by an environmental catastrophe. Comput. Stat. Data Anal. 55, 655–666 (2011)
Rahmani, S., Mousavi, S.M., Kamali, M.J.: Modeling of road-traffic noise with the use of genetic algorithm. Appl. Soft Comput. J. 11, 1008–1013 (2011)
Rahmati, M., Modarress, H.: Nitrogen adsorption on nanoporous zeolites studied by Grand Canonical Monte Carlo simulation. J. Mol. Struct. THEOCHEM 901, 110–116 (2009)
Ratick, S., Schwarz, G.: Monte Carlo simulation. In: Kitchin, R., Thrift, N. (eds.) International Encyclopedia of Human Geography. Elsevier, Oxford (2009)
Rei, W., Gendreau, M., Soriano, P.: A hybrid Monte Carlo local branching algorithm for the single vehicle routing problem with stochastic demands. Trans. Sci. 44, 136–146 (2010)
Robert, C.P., Casella, G.: Monte Carlo Statistical Methods. Springer, London (2004)
Rodina, A., Bliznakova, K., Pallikarakis, N.: End stage renal disease patients’ projections using Markov Chain Monte Carlo simulation. In: Proceedings of IFMBE, pp. 796–799 (2010)
Roskilly, S.J., Colbourn, E.A., Alli, O., Williams, D., Paul, K.A., Welfare, E.H., Trusty, P.A.: Investigating the effect of shape on particle segregation using a Monte Carlo simulation. Powder Technol. 203, 211–222 (2010)
Russett, B., Oneal, J.R., Berbaum, M.: Causes of peace: democracy, interdependence, and international organizations, 1885–1992. Int. Stud. Q. 47, 371–393 (2003)
Sacco, W.F., Lapa, C.M.F., Pereira, C.M.N.A., Filho, H.A.: A Metropolis algorithm applied to a nuclear power plant auxiliary feedwater system surveillance tests policy optimization. Prog. Nucl. Energy 50, 15–21 (2008)
Suzuki, K., Tachikawa, M., Shiga, M.: Efficient Ab Initio path integral hybrid Monte Carlo based on the fourth-order Trotter expansion: application to fluoride ion-water cluster. J. Chem. Phys. 132, 1–7, Art No 144108 (2010)
Tan, X., Xi, W., Baras, J.S.: Decentralized coordination of autonomous Swarms using parallel Gibbs sampling. Automatica 46, 2068–2076 (2010)
Thompson, W.R., Tucker, R.M.: A tale of two democratic peace critiques. J. Conflict Res. 41, 428–454 (1997)
Tiana, G., Sutto, L., Broglia, R.A.: Use of the Metropolis algorithm to simulate the dynamics of protein chains. Phys. A Stat. Mech. Appl. 380, 241–249 (2007)
Torabzadeh, E., Zandieh, M.: Cloud theory-based simulated annealing approach for scheduling in the two-stage assembly flowshop. Adv. Eng. Softw. 41, 1238–1243 (2010)
Wang, H., Harrison, K.W.: Adaptive Bayesian contaminant source characterization in water distribution systems via a parallel implementation of Markov Chain Monte Carlo (MCMC). In: Proceedings of the World Environmental and Water Resources Congress, pp. 4323–4329 (2010)
Wang, J., Huda, A., Lunyak, V.V., Jordan, I.K.: A Gibbs sampling strategy applied to the mapping of ambiguous short-sequence tags. Bioinformatics 26, 2501–2508 (2010b)
Wang, X.Y., Wong, A., Ho, P.-H.: Spectrum sensing in cognitive radio using a Markov-Chain Monte-Carlo scheme. IEEE Commun. Lett. 14, 830–832 (2010c)
Wei-Zhong, A., Xi-Gang, Y.: A simulated annealing-based approach to the optimal synthesis of heat-integrated distillation sequences. Comput. Chem. Eng. 33, 199–212 (2009)
Xia, J., Liu, L., Xue, J., Wang, Y., Wu, L.: Modeling of radiation-induced bystander effect using Monte Carlo methods. Nucl. Instrum. Methods Phys. Res. Sect. B Beam Interact Mater. Atoms 267, 1015–1018 (2009)
Yu, H., van Engelen, R.: Arc refractor methods for adaptive importance sampling on large Bayesian networks under evidential reasoning. Int. J. Approx. Reason. 51, 800–819 (2010)
Zeng, L.: Prediction and classification with neural network models. Sociol. Methods Res. 27, 499–524 (1999)
Zhang, L., Bartel, T., Lusk, M.T.: Parallelized hybrid Monte Carlo simulation of stress-induced texture evolution. Comput. Mater. Sci. 48, 419–425 (2010)
Zhao, H., Zheng, C.: Correcting the multi-Monte Carlo method for particle coagulation. Powder Technol. 193, 120–123 (2009)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Marwala, T., Lagazio, M. (2011). Bayesian Approaches to Modeling Interstate Conflict. In: Militarized Conflict Modeling Using Computational Intelligence. Advanced Information and Knowledge Processing. Springer, London. https://doi.org/10.1007/978-0-85729-790-7_4
Download citation
DOI: https://doi.org/10.1007/978-0-85729-790-7_4
Published:
Publisher Name: Springer, London
Print ISBN: 978-0-85729-789-1
Online ISBN: 978-0-85729-790-7
eBook Packages: Computer ScienceComputer Science (R0)