Skip to main content

Markov Chain Modeling and On-Board Identification for Automotive Vehicles

  • Chapter
Identification for Automotive Systems

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 418))

Abstract

The paper considers issues and algorithmic approaches related to modeling and identification of Markov Chain type models for vehicle applications. The use of Markov Chain models in these applications is stimulated by their ability to reflect aggregate vehicle operating conditions and induce “best on average” control policies based on application of stochastic dynamic programming and stochastic Model Predictive Control. A novel fuzzy encoding approach of continuous signals is proposed in which a signal value is simultaneously associated with multiple cells, and it is shown to enhance identification and prediction accuracy of Markov Chain type models. A computationally simple identification algorithm, suitable for on-board applications, is proposed to learn Markov Chain transition probabilities in real-time. Examples of real-time learning models of vehicle speed and road grade are reported to illustrate the overall identification approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fraser, A.M.: Hidden Markov Models and Dynamical Systems. SIAM, Philadelphia (2008)

    Book  MATH  Google Scholar 

  2. Chistyakov, V.P.: A Course in Probability Theory, Nauka, Moscow (1987)

    Google Scholar 

  3. Dynkin, E.B., Yushkevich, A.A.: Markov Processes: Theorems and Problems. Plenum, New York (1969)

    Google Scholar 

  4. Filev, D., Georgieva, O.: An extended version of the Gustafson-Kessel algorithm for evolving data stream clustering. In: Angelov, P., Filev, D., Kasabov, N. (eds.) Evolving Intelligent Systems, John Wiley and Sons, New York (2009)

    Google Scholar 

  5. Filev, D., Kolmanovsky, I.: Markov chain modeling approaches for on board applications. In: Proc. of American Control Conference, Baltimore, MD (2010)

    Google Scholar 

  6. Filev, D., Kolmanovsky, I.: A generalized Markov chain modeling approach for on-board applications. In: Proc. of International Journal Conference on Neural Networks, Barcelona, Spain (2010)

    Google Scholar 

  7. Johannesson, L., Ashbogard, M., Egardt, B.: Assessing the potential of predictive control for hybrid vehicle powertrains using stochastic dynamic programming. IEEE Trans. on Intelligent Transportation Systems 8(1) (2007)

    Google Scholar 

  8. Kolmanovsky, I., Filev, D.: Terrain and traffic optimized vehicle speed control. In: Proc. of 6th IFAC Symposium Advances in Automotive Control, Munich, Germany (2010)

    Google Scholar 

  9. Klir, G.: A principle of uncertainty and information invariance. Int. J. of General Systems 17(2), 249–275 (1990)

    Article  MATH  Google Scholar 

  10. Kolmanovsky, I., Filev, D.: Stochastic optimal control of systems with soft constraints and opportunities for automotive applications. In: Proc. of IEEE Multi-conference on Systems and Control, St., Petersburg, Russia (2009)

    Google Scholar 

  11. Kolmanovsky, I., Sivergina, I., Lygoe, B.: Optimization of powertrain operation policy for feasibility assessment and calibration: Stochastic dynamic programming approach. In: Proc. of American Control Conference, Anchorage, Alaska (2002)

    Google Scholar 

  12. Kosko, B.: Fuzzy Engineering. Prentice-Hall, Upper Saddle River (1996)

    Google Scholar 

  13. O’Leary, D., Stewart, G., Vandergraft, G.: Estimating the largest eigenvalue of a positive definite matrix. Mathematics of Computation 33, 1289–1292 (1979)

    MathSciNet  MATH  Google Scholar 

  14. Lin, C., Peng, H., Grizzle, J.: A stochastic control strategy for hybrid electric vehicles. In: Proc. of American Control Conference, Baltimore, MD, pp. 4710–4715 (2004)

    Google Scholar 

  15. Malikopoulos, A.A., Papalambros, P.Y., Assanis, D.N.: Online self-learning identification and stochastic control for autonomous internal combustion engines. ASME J. Dyn. Sys., Meas., Control 132(2) (2010)

    Google Scholar 

  16. Pedrycz, W., Skowron, A., Kreinovich, V.: Handbook of Granular Computing. John Wiley and Sons, Chichester (2008)

    Book  Google Scholar 

  17. Ripaccioli, G., Bernardini, D., Di Cairano, S., Bemporad, A., Kolmanovsky, I.: A stochastic Model Predictive Control approach for a series hybrid electric vehicle power management. In: Proc. of American Control Conference, Baltimore, MD (2010)

    Google Scholar 

  18. Yager, R., Filev, D.: Essentials of Fuzzy Modeling and Control. John Wiley and Sons, New York (1994)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer London

About this chapter

Cite this chapter

Filev, D.P., Kolmanovsky, I. (2012). Markov Chain Modeling and On-Board Identification for Automotive Vehicles. In: Alberer, D., Hjalmarsson, H., del Re, L. (eds) Identification for Automotive Systems. Lecture Notes in Control and Information Sciences, vol 418. Springer, London. https://doi.org/10.1007/978-1-4471-2221-0_7

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2221-0_7

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2220-3

  • Online ISBN: 978-1-4471-2221-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics