Abstract
We argue here that, in recent years, the world’s financial markets have become a globally interconnected complex adaptive ultra-large-scale socio-technical system-of-systems, and that this has important consequences for how the financial markets should be engineered and managed in future. Major failures in the financial markets can now occur at super-human speeds, as was witnessed in the “Flash Crash” of May 6th 2010. Events such as the Flash Crash may become more commonplace in future, unless lessons are learned from other fields where complex adaptive socio-technical systems-of-systems have to be engineered for high-integrity, safety-critical applications. In this document we review the literature on failures in risky technology and high-integrity approaches to safety-critical SoS engineering. We conclude with an argument that, in the specific case of the global financial markets, there is an urgent need to develop major national strategic modeling and predictive simulation capabilities, comparable to national-scale meteorological monitoring and modeling capabilities. The intent here is not to predict the price-movements of particular financial instruments or asset classes, but rather to provide test-rigs for principled evaluation of systemic risk, estimating probability density functions over spaces of possible outcomes, and thereby identifying potentially high-consequence failure modes in the simulations, before they occur in real life, by which time it is typically too late.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abbot, M., Fisher, M.: The Art of Scalability: Scalable Web Architecture, Processes, and Organizations for the Modern Enterprise. Addison-Wesley (2009)
Alexander, R., Kazakov, D., Kelly, T.: System of Systems Hazard Analysis Using Simulation and Machine Learning. In: Górski, J. (ed.) SAFECOMP 2006. LNCS, vol. 4166, pp. 1–14. Springer, Heidelberg (2006)
Alexander, R.: Using Simulation for Systems of Systems Hazard Analysis. PhD Thesis, Department of Computer Science, University of York, UK (2007)
Anderson, P., Arrow, K., Pines, D. (eds.): The Economy as an Evolving Complex System. Addison-Wesley (1989)
Angel, J.: Opening Remarks at SEC Roundtable on Shortselling (May 5, 2009a), http://www.sec.gov/comments/4-581/4581-2.pdf
Angel, J.: Letter to the Securities and Exchange Commission (June 19, 2009b), http://www.sec.gov/comments/s7-08-09/s70809-3758.pdf
Angel, J.: Letter to the Securities and Exchange Commission (September 21, 2009c), http://www.sec.gov/comments/s7-08-09/s70809-4658.pdf
Angel, J., Harris, L., Spratt, C.: Trading in the 21st Century (2010) (unpublished manuscript), http://www.sec.gov/comments/s7-02-10/s70210-54.pdf
Angel, J.: Letter to the Securities and Exchange Commission (April 30, 2010a), http://www.sec.gov/comments/s7-02-10/s70210-172.pdf
Angel, J.: Testimony to the US Senate (December 8, 2010b), http://msb.georgetown.edu/story/1242666871500.html
Apostolakis, G.: How Useful is Quantitative Risk Analysis? Risk Analysis 24(3), 515–520 (2004)
Arthur, B.: The Nature of Technology: What it is and how it evolves. Allen Lane (2009)
Arthur, B., Morrison, V., Durlauf, S., Lane, D. (eds.): The Economy as an Evolving Complex System II. Addison Wesley (1997)
Axelrod, R., Cohen, M.: Harnessing Complexity: Organizational Implications of a Scientific Frontier. Free Press (2000)
Bar-Yam, Y.: Making Things Work: Solving Complex Problems in a Complex World. Knowledge Press (2005)
Baxter, G., Sommerville, I.: Socio-technical Systems: From design methods to systems engineering. Interacting with Computers 23(1), 4–17 (2010)
Benveniste, A., Fabre, E., Haar, S.: Markov Nets: Probabilistic Models for Distributed and Concurrent Systems. IEEE Transactions on Automatic Control 48(11), 1936–1950 (2003)
Beinhocker, E.: The Origin of Wealth: Evolution, Complexity, and the Radical Remaking of Economics. Harvard Business School Press (2007)
Blas, J.: High-speed trading blamed for sugar rises. The Financial Times (February 8, 2011), http://www.ft.com/cms/s/0/05ba0b60-33d8-11e0-b1ed-00144feabdc0.html#axzz1JIx0tWXK
Blumberg, B.: Old Tricks, New Dogs: Ethology and Interactive Creatures. Ph.D. Thesis, MIT Media Lab. (1996)
Blume, L., Durlaf, S.: The Economy as an Evolving Complex System, III. Addison-Wesley (2005)
Bonen, Z.: Evolutionary Behavior of Complex Socio-Technical Systems. Working Paper #1056-79. Alfred P. Sloan School of Management, MIT (1979)
Bonisch, P., Di Giammarino, P.J.: Achieving Supervisory Control of Systemic Risk. Report jointly produced by UK Financial Services Knowledge Transfer Network, JWG, and Paradigm Risk (October 2010), http://www.jwg-it.eu/library.php?typeId=11
Bootle, R.: The Trouble with Markets: Saving Capitalism from Itself. Nicholas Brealey Publishing (2009)
Braha, D., Minai, A., Bar-Yam, Y.: Complex Engineered Systems: Science Meets Technology. Springer (2006)
Bullock, S.: Prospects for Large-Scale Financial Systems Simulation. Driver Review DR14, Foresight Project on the Future of Computer Trading in the Financial Markets. UK Government Office for Science (2011), http://www.bis.gov.uk/assets/foresight/docs/computer-trading/11-1233-dr14-prospects-for-large-scale-financial-systems-simulation.pdf
Byde, A.: Applying Evolutionary Game Theory to Auction Mechanism Design. In: Proceedings of the 2003 ACM Conference on E-Commerce, pp. 192–193 (2003)
Calinescu, R., Kwiatkowska, M.: Software Engineering Techniques for the Development of Systems of Systems. In: Choppy, C., Sokolsky, O. (eds.) Monterey Workshop 2008. LNCS, vol. 6028, pp. 59–82. Springer, Heidelberg (2010)
Calinescu, R., Kikuchi, S., Kwiatkowska, M.: Formal Methods for the Development and Verification of Autonomic IT Systems. In: Cong-Vinh, P. (ed.) Formal and Practical Aspects of Autonomic Computing and Networking: Specification, Development and Verification. IGI Global (2010) (to appear)
Cartlidge, J., Bullock, S.: Combating Coevolutionary Disengagement by Reducing Parasite Virulence. Evolutionary Computation 12(2), 193–222 (2004)
CFTC & SEC. Preliminary Findings Regarding the Market Events of May 6, 2010. Report of the staffs of the CFTC and SEC to the Joint Advisory Committee on Emerging Regulatory issues (May 18, 2010a), http://www.sec.gov/sec-cftc-prelimreport.pdf
CFTC & SEC. Findings Regarding the Market Events of May 6, 2010. Report of the staffs of the CFTC and SEC to the Joint Advisory Committee on Emerging Regulatory issues (September 30, 2010b), http://www.sec.gov/news/studies/2010/marketevents-report.pdf
CFTC & SEC. Recommendations Regarding Regulatory Responses to the Market Events of May 6, 2010. Summary Report of the Joint CFTC and SEC Advisory Committee on Emerging Regulatory issues (February 18, 2011)
Challet, D., Marsili, M., Zhang, Y. (eds.): Minority Games: Interacting agents in financial markets. OUP (2004)
Chilton, B.: Stopping Stammering: Overcoming Obstacles in Financial Regulatory Reform. In: Speech of Commissioner Bart Chilton to the Goldman Sachs Global Commodity Conference, London (2011), http://www.cftc.gov/pressroom/speechestestimony/opachilton-43.html
Cliff, D., Keen, J., Kwiatkowska, M., McDermid, J., Sommerville, I.: Large Scale Complex IT Systems (LSCITS) Research Programme. Research proposal to the UK Engineering and Physical Sciences Research Council (2006), http://lscits.cs.bris.ac.uk/docs/LSCITSproposalRP1.pdf (submitted December 2006, commenced April 2007)
Cliff, D.: Minimal-intelligence agents for bargaining behaviors in market- based environments. Technical Report HPL-97-91, Hewlett Packard Labs (1997)
Cliff, D., Bruten, J.: Animat Market-Trading Interactions as Collective Social Adaptive Behavior. Adaptive Behavior 7(3&4), 385–414 (1999)
Cliff, D.: Explorations in evolutionary design of online auction market mechanisms. Journal of Electronic Commerce Research and Applications 2(2), 162–175 (2003)
Cliff, D., Miller, G.: Visualising Coevolution with CIAO plots. Artificial Life 12(2), 199–202 (2006)
Cliff, D.: ZIP60: Further Explorations in the Evolutionary Design of Trader Agents and Online Auction-Market Mechanisms. IEEE Transactions on Evolutionary Computation 13(1), 3–18 (2009)
Cliff, D.: Networked Governance in the Financial Markets. Foresight strategic briefing paper, for UK Government Office of Science & Technology, Department of Business, Innovation, and Skills (2010), http://www.cs.bris.ac.uk/home/dc/Foresight_NetGov_v2a.pdf
Cliff, D., Brown, D., Treleaven, P.: Technology Trends in the Financial Markets: A 2020 Vision. Driver Review DR3, Foresight Project on the Future of Computer Trading in the Financial Markets. UK Government Office for Science (2011), http://www.bis.gov.uk/assets/foresight/docs/computer-trading/11-1222-dr3-technology-trends-in-financial-markets.pdf
Clymer, J.: Simulation-Based Engineering of Complex Systems, 2nd edn. Wiley-Blackwell (2009)
Colander, D., Föllmer, H., Haas, A., Goldberg, M., Juselius, K., Kirman, A., Lux, T., Sloth, B.: The Financial Crisis and the Systemic Failure of Academic Economics. Kiel Working Paper 1489, Kiel Institute for the World Economy (2009)
Collingridge, D.: The Management of Scale: Big Organizations, Big Decisions, Big Mistakes. Routeledge (1992)
Darley, V., Outkin, A.: A NASDAQ Market Simulation: Insights on a Major Market from the Science of Complex Adaptive Systems. World Scientific (2007)
Das, R., Hanson, J., Kephart, J., Tesauro, G.: Agent-Human Interactions in the Continuous Double Auction. In: Proceedings IJCAI 2001 (2001)
De Laurentis, D., Dickerson, C., DiMario, M., Gartz, P., Jamshidi, M., Nahavandi, S., Sage, A., Sloane, E., Walker, D.: A Case for an International Consortium on System-of-Systems Engineering. IEEE Systems Journal 1(1), 68–73 (2007)
De Laurentis, D., Han, E.: System-of-Systems Simulation for Analyzing the Evolution of Air Transportation. In: Proceedings of the 25th International Congress of the Aeronautical Sciences, pp. 1–10 (2006)
Demos, T.: US panel on flash crash urges rule changes. The Financial Times (February 18, 2011a), http://www.ft.com/cms/s/0/417134ea-3b84-11e0-9970-00144feabdc0.html#axzz1EOx4E4Gg
Demos, T.: Quick View: Blown away by the flash crash report. The Financial Times (February 19, 2011b), http://www.ft.com/cms/s/0/bf6017b0-3baa-11e0-a96d-00144feabdc0.html#axzz1EOx4E4Gg
Demos, T.: Plans to avert ‘flash crash” draw opposition. The Financial Times (March 22, 2011c), http://www.ft.com/cms/s/0/3a3e52a0-54a9-11e0-b1ed-00144feab49a.html#axzz1Ht6fUrUu
Despotou, G.: Managing the Evolution of Dependability Cases for Systems of Systems. PhD Thesis, Department of Computer Science, University of York, UK (2007)
Dewar, J., Bankes, S., Hodges, J., Lucas, T., Saunders-Newton, D., Vye, P.: Credible Uses of the Distributed Interactive Simulation (DIS) System. Technical Report MR-607-A, RAND (1996)
Dezfuli, H., et al.: Bayesian Inference for NASA Probabilistic Risk and Reliability Analysis. NASA SP-2009-569 (2009), http://www.hq.nasa.gov/office/codeq/doctree/SP2009569.pdf
Dorner, D.: The logic of failure. Philosophical Transactions of the Royal Society of London, Series B 327(1241), 463–473 (1990)
Dorner, D.: The Logic of Failure: Recognizing and Avoiding Error in Complex Situations. Perseus (1997)
Easley, D., Lopez de Prado, M., O’Hara, M.: The Microstructure of the Flash Crash: Flow Toxicity, Liquidity Crashes and the Probability of Informed Trading. The Journal of Portfolio Management 37(2), 118–128 (2011)
Economist. Agents of Change. The Economist 396(8692), 76 (2010) (Note that The Economist has a standard policy of not showing author bylines for articles written by regular staff journalists)
Eder, K., Flach, P.A., Hsueh, H.-W.: Towards Automating Simulation-Based Design Verification Using ILP. In: Muggleton, S., Otero, R., Tamaddoni-Nezhad, A. (eds.) ILP 2006. LNCS (LNAI), vol. 4455, pp. 154–168. Springer, Heidelberg (2007)
Epstein, J., Axtell, R.: Growing Artificial Societies: Social Science from the Bottom Up. MIT Press (1996)
Epstein, J.: Generative Social Science: Studies in Agent-Based Computational Modelling. Princeton University Press (2007)
Farmer, D., Foley, D.: The economy needs agent-based modeling. Nature 460, 685–686 (2009)
Farmer, D., Skouras, S.: An ecological perspective on the future of computer trading. Driver Review DR6, Foresight Project on the Future of Computer Trading in the Financial Markets. UK Government Office for Science (2011), http://www.bis.gov.uk/assets/foresight/docs/computer-trading/11-1225-dr6-ecological-perspective-on-future-of-computer-trading.pdf
Flinders, K.: The Evolution of Stock Market Technology. Computer Weekly (November 2, 2007), http://www.computerweekly.com/Articles/2007/11/02/227883/The-evolution-of-stock-market-technology.htm
Funes, P., Pollack, J.: Computer Evolution of Buildable Objects. In: Bentley, P. (ed.) Evolutionary Design by Computers, ch. 17. Morgan Kauffman (1999)
Galas, M., Brown, D., Treleaven, P.: ATRADE Platform: Algorithmic Trading & Risk Analytics Development Environment. Unpublished manuscript, Department of Computer Science, University College London (2010), http://fc.cs.ucl.ac.uk/mscfc/virtual-trading-floor
Gjerstad, S., Dickhaut, J.: Price Formation in Double Auctions. Games and Economic Behavior 22, 1–29 (1998)
Grant, J.: Quick View: US looks at European-style circuit breakers. The Financial Times (May 19, 2010), http://cachef.ft.com/cms/s/0/139ddd44-6325-11df-99a5-00144feab49a.html#axzz1Ij5j9zds
Goldberg, D.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley (1987)
Gorton, G.: Slapped by the Invisible Hand: The Panic of 2007. OUP (2010)
Goth, G.: Ultralarge Systems: Redefining Software Engineering? IEEE Software 25(3), 91 (2008)
Gray, J.: On eScience: A Transformed Scientific Method. In: Hey, T., Tansley, S., Tolle, K. (eds.) The Fourth Paradigm: Data-Intensive Scientific Discovery, pp. xvii–xxxi. Microsoft Press (2009)
Haccou, P., Meelis, E.: Statistical Analysis of Behavioral Data: An Approach Based on Time-Structured Models. Oxford University Press (1994)
Haldane, A.: Rethinking the Financial Network. Text of a speech given at the Financial Student Association, Amsterdam (April 2009), http://www.bankofengland.co.uk/publications/speeches/2009/speech386.pdf
Haldane, A., May, R.: Systemic risk in banking ecosystems. Nature 469, 351–355 (2011)
Hall-May, M.: Ensuring Safety of Systems of Systems. PhD Thesis, Department of Computer Science, University of York, UK (2007)
Harford, T.: What we can learn from a nuclear reactor? The Financial Times (January 14, 2011), http://www.ft.com/cms/s/2/cea7b256-1def-11e0-badd-00144feab49a.html#axzz1DN62IXnB
Harman, D., Bar-Yam, Y.: Technical Report on SEC Uptick Repeal Pilot. NECSI Technical Report 2008-11, New England Complex Systems Initiative (2008)
Hillis, D.: Co-evolving parasites improve simulated evolution as an optimization procedure. Physica D 42, 228–234 (1990)
Hodgson, G.: Economics and Evolution: Bringing life back into economics. Polity Press (1993)
Hollnagel, E., Woods, D., Leveson, N. (eds.): Resilience Engineering: Concepts and Precepts. Ashcroft (2006)
Hopkins, R., Jenkins, K.: Eating the IT Elephant: Moving from Greenfield Development to Brownfield. IBM Press (2008)
Horswill, I.: Very Fast Action Selection for Parameterized Behaviors. In: Proceedings of the Fifth International Conference on Foundations of Digital Games (FDG 2009), Orlando (2009)
Hsueh, H., Eder, K.: Test Directive Generation for Functional Coverage Closure Using Inductive Logic Programming. In: Proc. IEEE International High Level Design Validation and Test Workshop (HLDVT), pp. 11–18 (2006)
Hubbard, D.: The Failure of Risk Management. Why It’s Broken and How to Fix It. John Wiley (2009)
Institute for International Finance. Interim Report of the IIF Committee on Market Best Practices (April 2008), http://www.iif.com/download.php?id=SDzcEc8juCI=://
Ivanov, Y.: State Discovery for Autonomous Learning. Ph.D. Thesis, MIT Media Lab. (2002)
Johnson, C.: Lessons from the Evacuation of the World Trade Center, September 11, 2001, for the Future Development of Computer Simulations. Cognition, Technology, & Work 7, 214–240 (2005)
Johnson, C.: Using Evacuation Simulations to Ensure the Safety and Security of the 2012 Olympic Venues. Safety Science 46(2), 302–322 (2008)
Johnson, C., Nilsen-Nygaard, L.: Extending the Use of Evacuation Simulators to Support Counter-Terrorism: Using Models of Human Behaviour to Coordinate Emergency Responses to Improvised Explosive Devices. In: Simmons, R., Mohan, D., Mullane, M. (eds.) Proceedings of the 26th International Conference on Systems Safety (2008)
Johnson, C.: The Application of Computational Models for the Simulation of Large-Scale Evacuations Following Infrastructure Failures and Terrorist Incidents. In: Proceedings of NATO Research Workshop on Computational Models of Risk to Infrastructure, May 9-13. NATO (2006)
Johnson, N., Jefferies, P., Hui, P. (eds.): Financial Market Complexity. OUP (2003)
Johnson, N.: Proposing Policy by Analogy is Risky. Nature 469, 302 (2011)
Kearns, M., Ortiz, L.: The Penn-Lehman Automated Trading Project. IEEE Intelligent Systems, 22–31 (November/December 2003)
Kewley, R., Tolk, A.: A Systems Engineering Process for Development of Federated Simulations. In: SpringSim 2009: Proceedings of the 2009 Spring Simulation Multiconference. Society for Computer Simulation International (2009)
Kindleberger, C.: Manias, Panics, and Crises: A History of Financial Crises. John Wiley (2001)
LeBaron, B.: Agent Based Computational Finance: Suggested Readings and Early Research. Journal of Economic Dynamics and Control 24, 679–702 (2000)
LeBaron, B., Arthur, B., Palmer, R.: The Time Series Properties of an Artificial Stock Market. Journal of Economic Dynamics and Control 23, 1487–1516 (1999)
Levy, M., Levy, H., Solomon, S.: Microscopic Simulation of the Financial Markets: From Investor Behavior to Market Phenomena. Academic Press (2000)
Lewis, M.: The Big Short: Inside the Doomsday Machine. Allen Lane (2010)
Lorenz, E.: Deterministic Nonperiodic Flow. Journal of Atmospheric Science 20, 130–141 (1963)
Lorenz, K.: On Aggression. Routledge Classics (1966/2002)
MacKenzie, D.: An Engine, Not a Camera: How Financial Models Shape Markets. MIT Press (2008a)
MacKenzie, D.: Material Markets: How Economic Agents are Constructed. Oxford University Press (2008b)
MacKenzie, D., et al. (eds.): Do Economists Make Markets? On the Performativity of Economics. Princeton University Press (2008)
Maier, M.: Architecting Principles for Systems of Systems. Systems Engineering 1(4), 267–284 (1998)
May, R., Levin, S., Sugihara, G.: Ecology for Bankers. Nature 451, 893–895 (2008)
Meerman, M., et al.: Money and Speed: Inside the Black Box. Documentary produced by VPRO (Dutch public broadcaster) (2011), available as an iPad application http://itunes.apple.com/us/app/money-speed-inside-black-box/id424796908?mt=8&ls=1
Metcalfe, M.: Strategic knowledge sharing: a small-worlds perspective. In: Hart, D., Gregor, S. (eds.) Information System Foundations: Constructing and Criticizing, Australian National University Press (2005)
Mitchell, M.: Complexity: A Guided Tour. OUP (2009)
Mullane, R.: Riding Rockets: The Outrageous Tales of a Space-Shuttle Astronaut. Simon & Schuster (2006)
Nelson, R., Winter, S.: An Evolutionary Theory of Economic Change. Harvard University Press (1982)
Northrop, L., et al.: Ultra-Large-Scale Systems: The Software Challenge of the Future. Technical Report. Carnegie Mellon University Software Engineering Institute (2006)
Ormerod, P.: Butterfly Economics: A New General Theory of Economic and Social Behaviour. Faber (1998)
Ormerod, P.: Why Most Things Fail: Evolution, Extinction, & Economics. Faber (2006)
Palmer, R., Arthur, B., Holland, J., LeBaron, B., Tayler, P.: Artificial economic life: a simple model of a stockmarket. Physica D: Nonlinear Phenomena 75(1-3), 264–274 (1994)
Parry, G.: The Characterization of Uncertainty in Probabilistic Risk Assessments of Complex Systems. Reliability Engineering and System Safety 54, 119–126 (1996)
Parisi, C., Sahin, F., Jamshidi, M.: A discrete event XML based system of systems simulation for robust threat detection and integration. In: Proc. 2008 IEEE International Conference on System of Systems Engineering (2008)
Perrow, C.: Normal Accidents: Living with High-Risk Technologies. Basic Books, New York (1984)
Phelps, S., McBurney, P., Parsons, S., Sklar, E.: Co-evolutionary Auction Mechanism Design: A Preliminary Report. In: Padget, J., Shehory, O., Parkes, D., Sadeh, N., Walsh, W.E. (eds.) AMEC 2002. LNCS (LNAI), vol. 2531, pp. 123–142. Springer, Heidelberg (2002)
Phelps, S., McBurney, P., Parsons, S.: Evolutionary Mechanism Design: A Review. Autonomous Agents and Multi-Agent Systems 21(2), 237–264 (2010)
Polack, F., Andrews, P., Sampson, A.: The Engineering of Concurrent Simulations of Complex Systems. In: Proc. 2009 IEEE Congress on Evolutionary Computation, pp. 217–224 (2009)
Polack, F., Andrews, P., Ghetiu, T., Read, M., Stepney, S., Timmis, J., Sampson, A.: Reflections on the Simulation of Complex Systems for Science. In: Proc. International Conference on Engineering of Complex Computer Systems (ICECCS 2010), pp. 276–285. IEEE Press (2010)
Polacek, G., Verma, D.: Requirements Engineering for Complex Systems: Principles vs. Rules. In: Proceedings of the Seventh Annual Conference on Systems Engineering Research, CSER 2009 (2009)
Reason, J.: The Human Contribution: Unsafe Acts, Accidents, and Heroic Recoveries. Ashgate (2008)
Rittel, H., Webber, M.: Dilemmas in a General Theory of Planning. Policy Sciences 4, 155–169 (1973)
Roberts, K.: Some Characteristics of One Type of High Reliability Organization. Organization Science 1(2), 160–176 (1990)
Rooksby, J., Rouncefield, M., Sommerville, I.: Testing in the Wild: The Social and Organisational Dimensions of Real-World Practice. Journal of Computer Supported Cooperative Work 18(5-6), 559–580 (2009)
Salmon, F.: Algorithmic trading and market-structure tail risks. Reuters (January 13, 2011), http://blogs.reuters.com/felix-salmon/2011/01/13/algorithmic-trading-and-market-structure-tail-risks/
Schelling, T.: Dynamic Models of Segregation. Journal of Mathematical Sociology 1, 143–186 (1971)
Sheard, S., Mostashari, A.: Principles of Complex Systems for Systems Engineering. Systems Engineering 12(4), 295–311 (2008)
Sillitto, H.: Design Principles for Ultra-Large-Scale Systems (2010) (unpublished draft manuscript)
Sims, K.: Evolving 3D Morphology and Behavior by Competition. In: Brooks, R., Maes, P. (eds.) Artificial Life IV Proceedings, pp. 28–39. MIT Press (1994)
Sloan, S.: Simulating Terrorism. University of Oklahoma Press (1981)
Slovik, P.: Trust, Emotion, Sex, Politics, and Science: Surveying the Risk-Assessment Battlefield. Risk Analysis 19(4), 689–701 (1999)
Smith, L.: Accountability and Error in Ensemble Forecasting (1995) (manuscript), http://people.maths.ox.ac.uk/lenny/ecmwf96.pdf
Smith, L.: What might we learn from climate forecasts? Proceedings of the National Academy of Sciences of the United States of America 99, 2487–2492 (2002)
Stamatelatos, M., et al.: Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners. V1.1 (2002a), www.hq.nasa.gov/office/codeq/doctree/praguide.pdf
Stamatelatos, M., et al.: Fault Tree Handbook with Aerospace Applications. Version 1.1. (2002b), http://www.hq.nasa.gov/office/codeq/doctree/fthb.pdf
Sommerville, I., Cliff, D., Calinescu, R., Keen, J., Kelly, T., Kwiatkowska, M., McDermid, J., Paige, R.: Large-Scale Complex IT Systems. Communications of the ACM (July 2012)
Sornette, D.: Why Stock Markets Crash: Critical Events in Complex Financial Systems. Princeton University Press (2002)
Steiner, C.: Did We Dodge Another Flash Crash on September 1? (2010) Forbes blog, http://blogs.forbes.com/christophersteiner/2010/09/02/did-we-just-dodge-another-flash-crash-yesterday/
Stephens, C., Waelbroeck, H.: Algorithm Switching: Co-Adaptation in the Market Ecology. Journal of Trading, 1–15 (Summer 2009)
Stuermer, P., Bucci, A., Branke, J., Funes, P., Popovici, E.: Analysis of coevolution for worst-case optimization. In: Proceedings GECCO 2009, the 11th Annual Conference on Genetic and Evolutionary Computation (2009)
Taleb, N.: The Black Swan: The Impact of the Highly Improbable. Allen Lane (2007)
Tesfatsion, L., Judd, K. (eds.): The Handbook of Computational Economics. Agent-Based Computational Economics, vol. 2. North-Holland (2006)
Tett, G.: Fool’s Gold: How Unrestrained Greed Corrupted a Dream, Shattered Global Markets, and Unleashed a Catastrophe. Little, Brown (2009)
Tomlinson, B., Blumberg, B.: Social Synthetic Characters. Computer Graphics 26(2) (2002)
Tuinenga, P.: SPICE: A Guide to Circuit Simulation and Analysis Using PSpice. Prentice Hall (1988)
Turkle, S.: Simulation and its Discontents. MIT Press (2009)
Valerdi, R., Axelband, E., Baehren, T., Boehm, B., Dorenbos, D., Jackson, S., Madni, A., Nadler, G., Robitaille, P., Settles, S.: A research agenda for systems of systems architecting. International Journal of System of Systems Engineering 1(1&2), 171–188 (2008)
Vaughan, D.: The Challenger Launch Decision: Risky Technology, Culture and Deviance at NASA. University of Chicago Press (1997)
Vaughan, D.: On Slippery Slopes, Repeating Negative Patterns, and Learning from Mistakes. In: Starbuck, W., Farjoun, M. (eds.) Organization at the Limit: Lessons from the Columbia Disaster, pp. 262–275. Wiley Blackwell (2005)
Vaughan, D.: NASA Revisited: Theory, Analogy and Public Sociology. American Journal of Sociology 112(2), 353–393 (2006)
Vytelingum, K., Cliff, D., Jennings, N.: Strategic bidding in continuous double auctions. Artificial Intelligence 172(13), 1700–1729 (2008)
Waldrop, M.: Complexity: The Emerging Science at the Edge of Order and Chaos. Simon & Schuster (1992)
Walsh, W., Das, R., Tesauro, G., Kephart, J.: Analyzing Complex Strategic Interactions in Multi-Agent Games. In: Proceedings of AAAI 2002 Game Theoretic and Decision Theoretic Agents Workshop, Edmonton, Canada (2002)
Weick, K., Sutcliffe, K.: Managing the Unexpected. Jossey Bass (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cliff, D., Northrop, L. (2012). The Global Financial Markets: An Ultra-Large-Scale Systems Perspective. In: Calinescu, R., Garlan, D. (eds) Large-Scale Complex IT Systems. Development, Operation and Management. Monterey Workshop 2012. Lecture Notes in Computer Science, vol 7539. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34059-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-34059-8_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34058-1
Online ISBN: 978-3-642-34059-8
eBook Packages: Computer ScienceComputer Science (R0)