Skip to main content

Adaptive Filtering, Nonlinear State-Space Models, and Applications in Finance and Econometrics

  • Chapter
  • First Online:
State-Space Models

Part of the book series: Statistics and Econometrics for Finance ((SEFF,volume 1))

Abstract

Sequential Monte Carlo methods, also known as particle filters, have far-reaching and powerful applications in modern time series analysis problems involving state-space models. In this chapter we describe important application areas in finance and economics, including frailty models for portfolio default probabilities, stochastic volatility models with contemporaneous price and volatility jumps, and hidden Markov models for high-frequency transaction data. We review particle filters for estimating the latent states under the assumption that the parameters are known and their modifications without such an assumption. We also describe a new adaptive particle filter that uses a computationally efficient Markov Chain Monte Carlo estimate of the posterior distribution of the state-space model parameters in conjunction with sequential state estimation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aït-Sahalia, Y.; Mykland, P. A., and Zhang, L. How often to sample a continuous-time process in the presence of market microstructure noise. Review of Financial Studies, 18, 351–416 (2005)

    Article  Google Scholar 

  2. Andrieu, C., Doucet, A., Holenstein, R.: Particle Markov Chain Monte Carlo methods. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72(3), 269–342 (2010)

    Google Scholar 

  3. Barndorff-Nielsen, O., Hansen, P., Lunde, A., Shephard, N.: Designing realized kernels to measure the ex-post variation of equity prices in the presence of noise. Econometrica 76, 1481–1536 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  4. Brogaard, J.: High frequency trading and its impact on market quality. Working Paper, Kellogg School of Management, Northwestern University (2010)

    Google Scholar 

  5. Bukkapatanam, V., Chan, H., Lai, T.: Adaptive particle filters in nonlinear state-space models and their econometric applications. Working Paper, Department of Statistics, Stanford University (2012)

    Google Scholar 

  6. Bukkapatanam, V., Lai, T.: State-space models of dynamic market microstructure and estimation with high-frequency transactions data. Working Paper, Department of Statistics, Stanford University (2012)

    Google Scholar 

  7. Carlin, B.P., Polson, N.G., Stoffer, D.: A Monte Carlo approach to nonnormal and nonlinear state-space modeling. Journal of the American Statistical Association 87, 493–500 (1992)

    Article  Google Scholar 

  8. Carter, C.K., Kohn, R.: On Gibbs sampling for state space models. Biometrika 81, 541–553 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  9. Carvalho, C., Johannes, M., Lopes, H., Polson, N.: Particle learning and smoothing. Statistical Science pp. 88–106 (2010)

    Google Scholar 

  10. Carvalho, C., Lopes, H.: Simulation-based sequential analysis of Markov switching stochastic volatility models. Computational Statistics and Data Analysis 51, 4526–4542 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  11. Chan, H., Lai, T.: A general theory of particle filters in hidden Markov models and some applications. Annals of Statistics (2013). To appear

    Google Scholar 

  12. Chan, H., Lai, T.: A new approach to Markov Chain Monte Carlo with applications to adaptive particle filters. Working Paper, Department of Statistics, Stanford University (2012)

    Google Scholar 

  13. Creal, D.: A survey of sequential Monte Carlo methods for economics and finance. Econometric Reviews 31(3), 245–296 (2012)

    Article  Google Scholar 

  14. DaSilva, C., Migon, H., Correira, L.: Bayesian beta dynamic model and applications. Working paper, Department of Statistics, Federal University of Rio de Janeiro (2009)

    Google Scholar 

  15. Duffie, D., Eckner, A., Horel, G., Saita, L.: Frailty correlated default. Journal of Finance 64(5), 2089–2123 (2009)

    Article  Google Scholar 

  16. Duffie, D., Pan, J., Singleton, K.: Transform analysis and asset pricing for affine jump diffusions. Econometrica 68, 1343–1376 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  17. Duffie, D., Saita, L., Wang, K.: Multi-period corporate default prediction with stochastic covariates. Journal of Financial Economics 83, 635–665 (2007)

    Article  Google Scholar 

  18. Eraker, B., Johannes, M., Polson, N.: The impact of jumps in volatility and returns. Journal of Finance 58, 1269–1300 (2003)

    Article  Google Scholar 

  19. Fearnhead, P.: Markov Chain Monte Carlo, sufficient statistics, and particle filters. Journal of Computational and Graphical Statistics 11(4), 848–862 (2002)

    Article  MathSciNet  Google Scholar 

  20. Fernández-Villaverde, J., Rubio-Ramírez, J.: Estimating dynamic equilibrium economies: linear versus nonlinear likelihood. Journal of Applied Econometrics 20(7), 891–910 (2005)

    Article  MathSciNet  Google Scholar 

  21. Fernández-Villaverde, J., Rubio-Ramírez, J.: Estimating macroeconomic models: A likelihood approach. Review of Economic Studies 74(4), 1059–1087 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  22. Flury, T., Shephard, N.: Bayesian interference based only in simulated likelihood: Particle filter analysis of dynamic economic models. Econometric Theory 27(Special Issue 05), 933–956 (2011)

    Google Scholar 

  23. Gordon, N., Salmond, D., Smith, A.: Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEEE Proceedings F, Radar and Signal Processing 140(2), 107–113 (1993)

    Article  Google Scholar 

  24. Hansen, P., Lunde, A.: Realized variance and market microstructure noise. Journal of Business and Economic Statistics 24(2) (2006)

    Google Scholar 

  25. Hu, X., Kuipers, D., Zeng, Y.: Econometric analysis via filtering for ultra-high frequency data. Working Paper, Department of Mathematics and Statistics, University of Missouri at Kansas City (2010)

    Google Scholar 

  26. Jacod, J., Todorov, V.: Testing for common arrivals of jumps for discretely observed multidimensional processes. Annals of Statistics 37, 1792–1838 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  27. Jasra, A., Stephens, D., Doucet, A., Tsagaris, T.: Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo. Working paper, Institute for Statistical Mathematics, Tokyo, Japan (2008)

    Google Scholar 

  28. Johannes, M., Polson, N.: MCMC methods for continuous-time financial econometrics. In: Handbook of Financial Econometrics, vol. 2, pp. 1–66. North Holland (2009)

    Google Scholar 

  29. Li, H.: Sequential Bayesian analysis of time-changed infinite activity derivatives pricing models. Working paper, ESSEC Business School, Paris/Singapore (2009)

    Google Scholar 

  30. Li, H., Wells, M., Yu, C.: A Bayesian analysis of return dynamics with Lévy jumps. Review of Financial Studies 21, 2345–2378 (2008)

    Article  Google Scholar 

  31. Liu, J., West, M.: Combined parameter and state estimation in simulation-based filtering. In: Sequential Monte Carlo Methods in Practice. Springer (2001)

    Google Scholar 

  32. Liu, J.S.: Monte Carlo Strategies in Scientific Computing. Springer (2001)

    Google Scholar 

  33. Pitt, M., Shephard, N.: Filtering via simulation: Auxiliary particle filters. Journal of the American Statistical Association 94(446), 590–599 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  34. Pitt, M., Silva, R., Giordani, P., Kohn, R.: On some properties of Markov Chain Monte Carlo simulation methods based on the particle filter. Journal of Econometrics 171(2), 134 – 151 (2012)

    Article  MathSciNet  Google Scholar 

  35. Polson, N., Stroud, J., Müller, P.: Practical filtering with sequential parameter learning. Journal of the Royal Statistical Society, Series B 70, 413–428 (2008)

    Article  MATH  Google Scholar 

  36. Raggi, D., Bordignon, S.: Sequential Monte Carlo methods for stochastic volatility models with jumps. Working paper, Department of Economics, University of Bologna (2006)

    Google Scholar 

  37. Ross, S.: Simulation. Elsevier, Burlington, MA. (2006)

    MATH  Google Scholar 

  38. Storvik, G.: Particle filters for state-space models with the presence of unknown static parameters. Signal Processing, IEEE Transactions on 50(2), 281 –289 (2002)

    Article  Google Scholar 

  39. Todorov, V., Tauchen, G.: Activity signature functions for high-frequency data analysis. Journal of Econometrics 54, 125–138 (2010)

    Article  MathSciNet  Google Scholar 

  40. Todorov, V., Tauchen, G.: Volatility jumps. Journal of Business and Economic Statistics 29, 356–371 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  41. of USA, S..E.C.: Concept release on equity market structure. Release No. 34-61358; File No. S7-02-10, SEC. 17 CFR PART 242 (2010)

    Google Scholar 

  42. Wei, G.C.G., Tanner, M.A.: A Monte Carlo implementation of the EM algorithm and the poor man’s data augmentation algorithms. Journal of the American Statistical Association 85(411), pp. 699–704 (1990)

    Article  Google Scholar 

  43. Zeng, Y.: A partially observed model for micromovement of asset prices with Bayes estimation via filtering. Mathematical Finance 13(3), 411–444 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  44. Zeng, Y.: Estimating stochastic volatility via filtering for the micromovement of asset prices. Automatic Control, IEEE Transactions on 49(3), 338 – 348 (2004)

    Article  Google Scholar 

  45. Zhang, L., Mykland, P., Aït-Sahalia, Y.: A tale of two time scales: Determining integrated volatility with noisy high-frequency data. Journal of the American Statistical Association 100, 1394–1411 (2005)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tze Leung Lai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Lai, T.L., Bukkapatanam, V. (2013). Adaptive Filtering, Nonlinear State-Space Models, and Applications in Finance and Econometrics. In: Zeng, Y., Wu, S. (eds) State-Space Models. Statistics and Econometrics for Finance, vol 1. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7789-1_1

Download citation

Publish with us

Policies and ethics