Monitoring Financial Stability in a Complex World

  • Mark D. FloodEmail author
  • Allan I. Mendelowitz
  • William Nichols


We offer a tour d’horizon of the data-management issues facing macroprudential supervisors. Traditional financial oversight has been very firm-centric, with strong respect for the boundaries of the firm. Even in this firm-oriented context, financial information has been expanding much faster than traditional technologies can track. As we broaden to a macroprudential perspective, the problem becomes both quantitatively and qualitatively different. Supervisors should prepare for new ways of thinking and larger volumes of data.


Cash Flow Hedge Fund Generally Accept Accounting Principle Financial Account Standard Board International Account Standard Board 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


The authors are grateful to Dick Berner, John Bottega, Con Crowley, Mark Flannery, Joe Langsam, Adam LaVier, Irina Leonova, Jim Rhyne, Jonathan Sokobin, Vicki Lemieux, and participants in the 2011 Records and Information Management for Financial Analysis and Risk Management Workshop at the University of British Columbia, participants at the 2012 Workshop on Privacy and Confidentiality Issues for Financial Data at Penn State University, and discussions of the Open Financial Data Group for numerous helpful comments. Any remaining errors pertain to the authors alone.


  1. Adrian T, Shin HS (2010) Liquidity and leverage. J Financ Intermed 19:418–437CrossRefGoogle Scholar
  2. Agarwal S, Hauswald R (2010) Distance and private information in lending. Rev Financ Stud 23:2757–2788CrossRefGoogle Scholar
  3. Antonelli C (2009) The economics of innovation: from the classical legacies to the economics of complexity. Econ Innov New Technol 18:611–646. doi: 10.1080/10438590802564543 CrossRefGoogle Scholar
  4. Arora S, Barak B, Brunnermeier M, Ge R (2011) Computational complexity and information asymmetry in financial products. Commun ACM 54:101–107CrossRefGoogle Scholar
  5. Bank for International Settlements (BIS) (2010) Triennial and semiannual surveys: positions in global over-the-counter (OTC) derivatives markets at end—June 2010. Press release.
  6. Benston GJ (2006) Fair-value accounting: a cautionary tale from Enron. J Account Public Pol 25:465–484CrossRefGoogle Scholar
  7. Berger AN, Miller NH, Petersen MA, Rajan RG, Stein JC (2005) Does function follow organizational form? Evidence from the lending practices of large and small banks. J Financ Econ 76:237–269. doi: 10.1016/j.jfineco.2004.06.003 CrossRefGoogle Scholar
  8. Berthold J, Filinski A, Henglein F, Larsen KF, Steffensen M, Vinter B (2011) Functional high performance financial IT: the Hiperfit Research Center in Copenhagen—project paper. In: Peña-Marí R, Page R (eds) Trends in functional programming (TFP’11)—12th international symposium, Madrid, Spain. Revised selected papers. Springer, Berlin 16–18 May 2011Google Scholar
  9. Bisias D, Flood M, Lo A, Valavanis S (2011) A survey of systemic risk analytics. Working paper, number 0001, Office of Financial ResearchGoogle Scholar
  10. Blundell-Wignall A, Atkinson P (2010) Thinking beyond basel III: necessary solutions for capital and liquidity. OECD J Financ Mark Trends 1:1–23CrossRefGoogle Scholar
  11. Bookstaber R (2007) A demon of our own design: markets, hedge funds, and the perils of financial innovation. Wiley, New YorkGoogle Scholar
  12. Boyd J, Gertler M (1994) Are banks dead? Or are the reports greatly exaggerated? Fed Reserve Bank Minneapolis Q Rev 18:2–23.
  13. Bradley H, Fawls R, Litan RE, Sommers F (2011) Canaries in the coal mine: how the rise in settlement ‘fails’ creates systemic risk for financial firms and investors. Technical report, Ewing Marion Kauffman Foundation.
  14. Brammertz W, Akkizidis I, Breymann W, Entin R, Rustmann M (2009) Unified financial analysis: the missing links of finance. Wiley, New YorkGoogle Scholar
  15. Brewer E (2000) Towards robust distributed systems. In: Proceedings of the 19th annual ACM symposium on principles of distributed computing (PODC’00)Google Scholar
  16. Brunnermeier MK, Eisenbach TM, Sannikov Y (2011) Macroeconomics with financial frictions: a survey. Working paper, Princeton UniversityGoogle Scholar
  17. Castura J, Litzenberger R, Gorelick R, Dwivedi Y (2010) Market Efficiency and microstructure evolution in U.S. equity markets: a high-frequency perspective. Working Paper, RGM Advisors, LLC.
  18. U.S. Census Bureau (2011) Total midyear population for the world: 1950–2050. International Data Base (IDB). Accessed 26 July 2011
  19. Choo CW (2006) The knowing organization: how organizations use information to construct meaning, create knowledge, and make decisions. Oxford University Press, OxfordGoogle Scholar
  20. Ciulla T, Bloom D, Ages J (2010) Automating the OTC derivative collateral management function. J Secur Oper Custody 3:103–110Google Scholar
  21. Coase RH (1937) The nature of the firm. Econ New Ser 4:386–405CrossRefGoogle Scholar
  22. Committee on Payment and Settlement Systems (CPSS) (2008) The interdependencies of payment and settlement systems. Technical report, Bank for International Settlements.
  23. Committee on Payment and Settlement Systems (CPSS) (2011) Principles for financial market infrastructures. Consultative report, Bank for International Settlements.
  24. Committee on Payment and Settlement Systems (CPSS), Technical Committee of the International Organization of Securities Commissions (IOSCO) (2001) Recommendations for securities settlement systems. Consultative Report, CPSS-IOSCO Joint Task Force on Securities Settlement Systems.
  25. Commodity Futures Trading Commission and Securities and Exchange Commission (CFTC-SEC) (2010a) Preliminary findings regarding the market events of May 6, 2010. Report of the Staffs of the CFTC and SEC to the Joint Advisory Committee on Emerging Regulatory Issues.
  26. Commodity Futures Trading Commission and Securities and Exchange Commission (CFTC-SEC) (2010b) Findings regarding the market events of May 6, 2010. Report of the Staffs of the CFTC and SEC to the Joint Advisory Committee on Emerging Regulatory Issues, Sept 2010.
  27. U.S. Congress (2010) Dodd-Frank wall street reform and consumer protection act, bill summary and status 111th congress (2009–2010), H.R.4173. Enrolled Bill.
  28. Copeland A, Martin A, Walker M (2010) The tri-party repo market before the 2010 reforms. Federal Reserve Bank of New York Staff Reports, number 477.
  29. Cordell L, Huang Y, Williams M (2011) Collateral damage: sizing and assessing the subprime CDO crisis. Working Paper, number 11-30, Federal Reserve Bank of Philadelphia, Philadelphia, Pennsylvania.
  30. Counterparty Risk Management Policy Group (CRMPG) (2005) Toward greater financial stability: a private sector perspective. Report of the Counterparty Risk Management Policy Group II.
  31. Danielsson J, Shin HS (2003) Endogenous risk. In: Field P (ed) Modern risk management: a history. Risk Books, LondonGoogle Scholar
  32. Data Documentation Initiative (DDI) (2009) Data Documentation Initiative (DDI) technical specification part I: overview, version 3.1. Technical report.
  33. Dell’Ariccia G, Igan D, Laeven L (2008) Credit booms and lending standards: evidence from the subprime mortgage market. IMF Working Paper, WP/08/106.
  34. DeMarzo PM (2005) The pooling and tranching of securities: a model of informed intermediation. Rev Financ Stud 18:1–35CrossRefGoogle Scholar
  35. Deryugina M (2009) Standardization of securities regulation: rehypothecation and securities commingling in the United States and the United Kingdom. Rev Bank Financ Law 29:253–288Google Scholar
  36. Diestel R (2006) Graph theory, 3rd edn. Springer, BerlinGoogle Scholar
  37. Duffie D (2011) Systemic risk exposures: a 10-by-10-by-10 approach. Working paper, Stanford University.
  38. Dungey D (2007a) Tanta: mortgage servicing for UberNerds. Calculated risk. Accessed 27 July 2011
  39. Dungey D (2007b) Foreclosure sales and REO for UberNerds. Calculated risk. Accessed 27 July 2011
  40. Engle RF, Weidman S (2010) Technical capabilities necessary for regulation of systemic financial risk: summary of a workshop. National Research Council of the National Academies, National Academies Press, Washington, DC Google Scholar
  41. Enterprise Data Management Council (EDMC) (2011) Enterprise Data Management Council semantics repository. Accessed 29 July 2011
  42. European Central Bank (ECB) (2010a) Financial networks and financial stability. Financ Stab Rev 17:155–160.
  43. European Central Bank (ECB) (2010b) New quantitative measures of systemic risk. Financ Stab Rev 17:147–153. Google Scholar
  44. Federal Deposit Insurance Corporation (FDIC) (2011) Statement of Martin J. Gruenberg, Acting Chairman, Federal Deposit Insurance Corporation on enhanced oversight after the financial crisis: wall street reform at one year before the committee on banking, Housing and Urban Affairs, United States Senate; 538 Dirksen Senate Office Building, 21 July 2011.
  45. Federal Reserve Bank of St. Louis (2011a) Delinquency rate on single-family residential mortgages, booked in domestic offices, all commercial banks (DRSFRMACBS). FRED economic data. Accessed 28 July 2011
  46. Federal Reserve Bank of St. Louis (2011b) Charge-off rate on single family residential mortgages, booked in domestic offices, all commercial banks (CORSFRMACBS). FRED economic data. Accessed 28 July 2011
  47. Feldman R, Lueck M (2007) Are banks really dying this time? An update of Boyd and Gertler. The Region—The Federal Reserve Bank of Minneapolis 6-51Google Scholar
  48. Financial Accounting Standards Board (FASB) (2008) Preliminary views: conceptual framework for financial reporting: the reporting entity. Financial Accounting Series No. 1580-100. Financial Accounting Standards Board, Norwalk, Connecticut.
  49. Financial Products Markup Language (FpML) (2011) What is FpML®? Accessed 29 July 2011
  50. FIX Protocol (FIX) (2011) What is FIX? Accessed 29 July 2011
  51. Flannery MJ, Kwan SH, Nimalendran M (2004) Market evidence on the opaqueness of banking firms’ assets. J Financ Econ 71:419–460. doi: 10.1016/S0304-405X(03)00185-5 CrossRefGoogle Scholar
  52. Flannery MJ, Kwan SH, Nimalendran M (2010) The 2007–09 financial crisis and bank opaqueness. Working paper 2010-27, Federal Reserve Bank of San Francisco.
  53. Fleming M, Garbade K (2005) Explaining settlement fails. Curr Issues Econ Financ Fed Reserve Bank N Y 11:1–7Google Scholar
  54. Flood M (2009) Embracing change: financial informatics and risk analytics. Quant Financ 9:243–256CrossRefGoogle Scholar
  55. Flood M, Kyle ASP, Raschid L (2010) Knowledge Representation And Information Management For Financial Risk Management. Report of a workshop, Arlington, VA, National Science Foundation and Pew Charitable Trusts.
  56. Fuerber C, Hepp M, Wischnewski M (2011) The data quality constraints library: Primer, Draft 2010-11-24. Accessed 26 Novemb 2011
  57. Gaspar JM, Massa M, Matos P (2006) Favoritism in mutual fund families? Evidence on strategic cross-fund subsidization. J Financ 61:73–104CrossRefGoogle Scholar
  58. Ghoting A, Parthasarathy S, Otey ME (2008) Fast mining of distance-based outliers in high-dimensional datasets. Data Min Knowl Disc 16:349–364. doi: 10.1007/s10618-008-0093-2.
  59. Gilbert S, Lynch N (2002) Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News 33:51–59.
  60. Gooch A, Klein K (1997) A review of case law affecting swaps and derivative instruments: United States case law. In: Schwartz R, Smith C (eds) Derivatives handbook: risk management and control. Wiley, New YorkGoogle Scholar
  61. Gorton GB, Metrick A (2009) Haircuts. Working paper 15273, National Bureau of Economic Research, Cambridge, Massachusetts.
  62. Gottfredson M, Aspinall K (2005) Innovation versus complexity: what is too much of a good thing? Harvard Bus Rev 83:62–70Google Scholar
  63. Haldane AG (2009) Rethinking the financial network. Speech delivered at the financial student association, Amsterdam. Bank of England, London.
  64. Han J, Kamber M, Pei J (2011) Data mining: concepts and techniques, 3rd edn. Morgan Kaufmann, WalthamGoogle Scholar
  65. Hansen C, Johnson C, Pascucci V, Silva C (2009) Visualization for data-intensive science. In: Hey T, Tansley S, Tolle K (eds) The fourth paradigm: data-intensive scientific discovery. Microsoft Research, RedmondGoogle Scholar
  66. Hartman-Glaser B (2011) Reputation vs. signaling in a security issuance game. Working paper, University of California at Berkeley.
  67. Hendershott T, Jones C, Menkveld A (2011) Does algorithmic trading improve liquidity? J Financ 66:1–33CrossRefGoogle Scholar
  68. Hilbert M, López P (2011a) The world’s technological capacity to store, communicate, and compute information. Int J Commun (forthcoming).
  69. Hilbert M, López P (2011b) How to measure the world’s technological capacity to communicate, store and compute information? Science 332:60–65CrossRefGoogle Scholar
  70. Hildreth PM, Kimble C (2002) The duality of knowledge. Inf Res 8:8-1Google Scholar
  71. Holland P (2011) The one hundred billion dollar problem in small claims court: robo-signing and lack of proof in debt buyer cases. J Bus Tech Law 6:101–129Google Scholar
  72. Holmström B, Roberts J (1998) The boundaries of the firm revisited. J Econ Perspect 12:73–94CrossRefGoogle Scholar
  73. Hunt J, Stanton R, Wallace N (2011) The end of mortgage securitization? Electronic registration as a threat to bankruptcy remoteness. Working paper, University of California at Berkeley.
  74. Ingersoll J, Spiegel M, Goetzmann W, Welch I (2007) Portfolio performance manipulation and manipulation-proof performance measures. Rev Financ Stud 20:1503–1546CrossRefGoogle Scholar
  75. Intel (2010) Extreme speed, extreme throughput. Marketing brochure.
  76. International Accounting Standards Board (IASB) (2011) IFRS 13 fair value measurement. Guidance document.
  77. International Monetary Fund (IMF) (2001) The macroeconomic statistical treatment of reverse transactions. In: Fourteenth meeting of the IMF committee on balance of payments statistics Tokyo, Japan, BOPCOM-01-16. International Monetary Fund Statistics Department, Washington, DC. 24–26 Oct 2001
  78. International Monetary Fund (IMF) (2009) Assessing the systemic implications of financial linkages. In: Global financial stability report: responding to the financial crisis and measuring systemic risks. International Monetary Fund, Washington, DCGoogle Scholar
  79. International Organization for Standardization (ISO20022) (2011) ISO 20022 universal financial industry message scheme. Accessed 29 July 2011
  80. International Organization of Securities Commissions (IOSCO) (2008) Report on the subprime crisis: final report. Technical report.
  81. Johnson C, Ross R, Ahern S, Ahrens J, Bethel W, Ma KL, Papka M, Rosendale JV, Shen HW, Thomas J (2007) Visualization and knowledge discovery: report from the DOE/ASCR workshop on visual analysis and data exploration at extreme scale. Technical report.
  82. Judge K (2011) Fragmentation notes: A study in financial innovation, complexity and systemic risk. Working paper 406 Columbia Law School, Center for Law & Economic Studies
  83. Kashyap A, Berner R, Goodhart C (2011) The macroprudential toolkit. IMF Econ Rev 59:145–161CrossRefGoogle Scholar
  84. Kaufman GG, Mote LR (1994) Is banking a declining industry: a historical perspective. Econ Persp Fed Reserve Bank Chicago 18:2–21Google Scholar
  85. Kaufman T, Neiman R, Silvers D, McWatters JM, Troske K (2010) Examining the consequences of mortgage irregularities for financial stability and foreclosure mitigation. Congressional oversight panel November oversight report. U.S. Government Printing Office, Washington, DCGoogle Scholar
  86. Khandani A, Lo AW (2011) What happened to the quants in August 2007? Evidence from factors and transactions data. J Financ Mark 14:1–46CrossRefGoogle Scholar
  87. Koh H, Magee CL (2006) A functional approach for studying technological progress: application to information technology? Technol Forecast Soc Chang 73:1061–1083CrossRefGoogle Scholar
  88. Leedom DK (2001) Sensemaking symposium final report to the command and control research program, Office of the Assistant Secretary of Defense for Command, Control, Communications and Intelligence, U.S. Department of Defense.
  89. Lemieux V, Fisher B, Dang T (2012) The visual analysis of financial data. In: Brose M, Flood M, Krishna D, Nichols W (eds) Handbook of financial data and risk information, vol 2: implementation, forthcoming. Cambridge University Press, CambridgeGoogle Scholar
  90. Liberti J, Mian A (2012) Estimating the effect of hierarchies on information use. Rev Financ Stud 22:4057–4090CrossRefGoogle Scholar
  91. Lo AK (2011a) Andrew Lo discusses systemic risk. Presentation video, UMD/CMU/NYU/UCB conference on systemic risk and data issues, Washington, DC. 5 Oct 2011
  92. Lo AK (2011b) In the valley of the shadow of hedge funds. Presentation slides, UMD/CMU/NYU/UCB conference on systemic risk and data issues, Washington, DC. 5 Oct 2011
  93. Madnick S, Zhu H (2006) Improving data quality through effective use of data semantics. Data Knowl Eng 59:460–475CrossRefGoogle Scholar
  94. Markham J (2002) A financial history of the United States, vol 2: from J.P. Morgan to the institutional investor (1900–1970). M.E. Sharpe, ArmonkGoogle Scholar
  95. Moussa A (2011) Contagion and systemic risk in financial networks. PhD thesis, Columbia University.
  96. Mutnikas Y, Zerbs M (2011) Optimal granularity: a supervisory deep dive on counterparty credit risk. Think November: 32–37Google Scholar
  97. Nagy B, Doyne Farmer J, Trancik JE, Gonzales JP (2011) Superexponential long-term trends in information technology. Technol Forecast Soc 73:1061–1083Google Scholar
  98. Noll F (2009) Lincoln’s greenback mill: civil war financing and the start of the bureau of engraving and printing, 1861–1863. Fed Hist J 1:25–31Google Scholar
  99. Office of Financial Research (OFR) (2011) Office of Financial Research issues statement on progress to date and next steps forward in the global initiative to establish a legal entity identifier (LEI). Press release.
  100. Pandis I, Johnson R, Hardavellas N, Ailamaki A (2010) Data-oriented transaction execution. Proc VLDB Endow 3:928–939Google Scholar
  101. Perrow C (1999) Normal accidents: living with high-risk technologies. Princeton University Press, PrincetonGoogle Scholar
  102. Petersen MA, Rajan RG (2002) Does distance still matter? The information revolution in small business lending. J Financ 57:2533–2570CrossRefGoogle Scholar
  103. Philippon T (2008) Why has the financial sector grown so much? The role of corporate finance. NBER Working paper, number 13405, National Bureau of Economic Research.
  104. Pozsar Z, Singh M (2011) The non-bank-bank nexus and the shadow banking system. IMF working paper, number WP/11/289.
  105. Pozsar Z, Adrian T, Ashcraft A, Boesky H (2010) Shadow banking. Staff report number 458, Federal Reserve Bank of New York, New York.
  106. Securities and Exchange Commission (SEC) (1972) Thirty-eighth annual report of the securities and exchange commission for the fiscal year ended June 30th. U.S Government Printing Office, Washington, DC.
  107. U.S. Senate (2010) The national institute of finance act of 2010, bill summary and status 111th congress (2009–2010), S.3005. Introduced 4 Feb 2010.
  108. Senior Managements of: Bank of America NA, Barclays Capital, Bear, Stearns & Co, Citigroup, Credit Suisse First Boston, Deutsche Bank AG, Goldman, Sachs & Co, HSBC Group, JP Morgan Chase, Lehman Brothers, Merrill Lynch & Co, Morgan Stanley, UBS AG, Wachovia Bank NA (Senior Managements) (2005) Letter to Mr. Timothy Geithner, President, Federal Reserve Bank of New York. Federal Reserve Bank of New York, New YorkGoogle Scholar
  109. Shleifer A, Vishny R (2011) Fire sales in finance and macroeconomics. J Econ Perspect 25:29–48CrossRefGoogle Scholar
  110. Singh M, Aitken J (2010) The (sizable) role of rehypothecation in the shadow banking system. IMF working paper, number WP/10/172.
  111. Srivastava UH (2006) Efficient query processing for modern data management. Doctoral thesis, Stanford University.
  112. Stonebraker M, Madden S, Abadi DJ, Harizopoulos S, Hachem N, Helland P (2007) The end of an architectural era (it’s time for a complete rewrite). In: VLDB ‘07: proceedings of the 33rd international conference on very large data bases. VLDB Endowment, ViennaGoogle Scholar
  113. Taub L (2008) Borrowed securities: implications for measuring cross-border portfolio investment. In: IFC bulletin number 28, IFC’s contribution to the 56th ISI session, Lisbon, 2007. Bank for International Settlements, BaselGoogle Scholar
  114. Thaler RH (1988) Anomalies: the winner’s curse. J Econ Perspect 2:191–202Google Scholar
  115. Treasury Market Practices Group (TMPG) (2011) Understanding settlement fails in agency mortgage-backed securities. Technical report, Federal Reserve Bank of New York.
  116. Trimbath S (2008) Trade settlement failures in U.S. bond markets. Working paper, number STP2007_01 (v.2), STP Advisory Services.
  117. Tufano P (2003) Financial innovation. In: Constantinides G, Harris M, Stulz R (eds) Handbook of the economics of finance, vol 1a: corporate finance. Elsevier, AmsterdamGoogle Scholar
  118. Vogels W (2009) Eventually consistent. Commun ACM 52:40–44CrossRefGoogle Scholar
  119. Wagner M, Moore A, Aryel R (2006) Handbook of biosurveillance. Academic Press, WalthamGoogle Scholar
  120. Wallace N (2011) Private-label residential mortgage securitization: recording innovations and bankruptcy remoteness. Presentation slides, University of California at Berkeley.
  121. Wikipedia (2011) Transistor count. Accessed 22 July 2011
  122. Williamson OE (1991) Comparative economic organization: the analysis of discrete structural alternatives. Admin Sci Quart 36:269–296CrossRefGoogle Scholar
  123. Yahoo Finance (2011) S&P 500 INDEX, RTH (^GSPC). Accessed 22 July 2011

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Mark D. Flood
    • 1
    Email author
  • Allan I. Mendelowitz
    • 2
  • William Nichols
    • 1
  1. 1.U.S. Department of the TreasuryOffice of Financial ResearchCambridgeUSA
  2. 2.Committee to Establish the National Institute of FinanceWashingtonUSA

Personalised recommendations