Fuzzy Dynamic Programming: Basic Aspects

  • Janusz Kacprzyk
  • Augustine O. Esogbue
Part of the The International Series on Asian Studies in Computer and Information Science book series (ASIS, volume 6)


A brief account of basic aspects of fuzzy dynamic programming, which is an effective tool for dealing with fuzzy multistage decision making and optimization problems, is presented. We discuss cases of a deterministic, stochastic, and fuzzy state transitions, and of the fixed and specified, implicitly given, fuzzy, and infinite times termination time. We briefly show some more relevant applications.


Multistage decision making under fuzziness multistage optimization under fuzziness fuzzy dynamic programming fuzzy set fuzzy system 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Baldwin, J.F.; Pilsworth, B.W.} Dynamic programming for fuzzy systems with fuzzy environment. J. Math. Anal. and Appls., 1982, 85, 1–23.MathSciNetzbMATHCrossRefGoogle Scholar
  2. Bellman, R.E. Dynamic Programming. Princeton Univ. Press, Princeton, NJ, 1957.zbMATHGoogle Scholar
  3. Bellman, R.E.; Zadeh, L.A. Decision-making in a fuzzy environment. Management Sci., 1970, 17, 141–164.MathSciNetCrossRefGoogle Scholar
  4. Chang, S.S.L. Fuzzy dynamic programming and the decision making process. Proc. 3rd Princeton Conf. on Inf. Sci. and Syst. (Princeton, NJ, USA), 1969b, 200–203.Google Scholar
  5. Esogbue, A.O. Dynamic programming, fuzzy sets and the modelling of R&D management control systems. IEEE Transactions on Systems, Man, and Cybernetics, 1983, SMC-13: 18–30.MathSciNetzbMATHCrossRefGoogle Scholar
  6. Esogbue, A.O. Some novel applications of fuzzy dynamic programming. Proceedings of IEEE Systems, Man, and Cybernetics Conference, Bombay, India, 1984.Google Scholar
  7. Esogbue, A.O. A fuzzy dynamic programming model of intra-operative anesthesia administration. In J. Kacprzyk, R.R. Yager (Eds.): Management Decision Support Systems using Fuzzy Sets and Possibility Theory. Verlag TÜV Rheinland, Cologne, 1985, 155–161.Google Scholar
  8. Esogbue, A.O. Optimal clustering of fuzzy data via fuzzy dynamic programming. Fuzzy Sets and Systems, 1986, 18: 283–298.MathSciNetzbMATHCrossRefGoogle Scholar
  9. Esogbue, A.O. Dynamic Programming for Optimal Water Resources Systems Analysis. Prentice-Hall, Englewood Cliffs, NJ, 1986.Google Scholar
  10. Esogbue, A.O. Computational and data acquisition issues in fuzzy dynamic programming. Proceedings of ORSA/TIMS Conference, Anaheim, CA, 1991a.Google Scholar
  11. Esogbue, A.O. Computational aspects and applications of a branch and bound algorithm for fuzzy multistage decision processes. Computers and Mathematics with Applications, 1991b, 21: 117–127.MathSciNetzbMATHCrossRefGoogle Scholar
  12. Esogbue, A.O.; Kacprzyk, J. Fuzzy dynamic programming, In R. Slowiński (Ed.): Fuzzy Sets in Decision Analysis, Operations Research and Statistics, Kluwer, Boston, 1998, 281–307.Google Scholar
  13. Esogbue, A.O.; Elder, R.C. Measurement and valuation of a fuzzy mathematical model for medical diagnosis. Fuzzy Sets and Systems, 1983, 10: 223–242.zbMATHCrossRefGoogle Scholar
  14. Esogbue, A.O.; Bellman, R.E. A fuzzy dynamic programming algorithm for clustering non-quantitative data arising in water pollution control planning. Proceedings of Third International Conference on Mathematical Modelling, Los Angeles, CA, 1983.Google Scholar
  15. Esogbue, A.O.; Bellman, R.E. Fuzzy dynamic programming and its extensions. TIMS/Studies in the Management Sciences, 1984, 20:147–167.MathSciNetGoogle Scholar
  16. Esogbue, A.O.; Ramesh, V. Dynamic programming and fuzzy allocation processes. Technical Memo No. 202, Dept. of Operations Research, Case Western University, Cleveland, OH, 1970.Google Scholar
  17. Esogbue, A.O.; Ahipo, Z.M. Fuzzy sets in water resources planning. In R.R. Yager (Eds.): Recent Developments in Fuzzy Sets and Possibility Theory, Pergamon Press, New Fork, 1982a, 450–465.Google Scholar
  18. Esogbue, A.O.; Ahipo, Z.M. A fuzzy sets model for measuring the effectiveness of public participation in water resources planning. Water resources Bulletin, 1982b, 18: 451–456.CrossRefGoogle Scholar
  19. Esogbue, A.O.; Fedrizzi, M.; Kacprzyk, J. Fuzzy dynamic programming with stochastic systems. In J. Kacprzyk and M. Fedrizzi (Eds.): Combining Fuzzy Imprecision with Probabilistic Uncertainty in Decision Making. Springer-Verlag, Berlin/New York, 1988, 266–285.CrossRefGoogle Scholar
  20. Esogbue, A.O.; Theologidu, M.; Guo, K. On the application of fuzzy sets theory to the optimal flood control problem arising in water resources systems. Fuzzy Sets and Systems, 1992, 48:155–172.CrossRefGoogle Scholar
  21. Fung, L.W.; Fu, K.S. Characterization of a class of fuzzy optimal control problems. In M.M. Gupta, G.N. Saridis, Gaines B.R. (Eds.): Fuzzy Automata and Decision Processes. North-Holland, Amsterdam, 1977, 205–220.Google Scholar
  22. Huang, C.J.; Lin, C.E.; Huang, C.L. Fuzzy approach for generator maintenance scheduling. Electric Power Systems Research, 1992, 24, 31–38.CrossRefGoogle Scholar
  23. Hussein, M.L.; Abo-Sinna, M.A. 1993 Decomposition of multiobjective programming problems by hybrid fuzzy dynamic programming. Fuzzy Sets and Systems, 1993, 60, 25–32.MathSciNetzbMATHCrossRefGoogle Scholar
  24. Kacprzyk, J.; Straszak, A. Determination of stable trajectories for integrated regional development using fuzzy decision models. IEEE Transactions on Systems, Man and Cybernetics, 1984, SMC-14: [pp310-313}.Google Scholar
  25. Kacprzyk, J.; Straszak, A. Application of fuzzy decision-making models for determining optimal policies in’ stable’ integrated regional development. In P.P. Wang and S.K. Chang (Eds.): Fuzzy Sets Theory and Applications to Policy Analysis and Information Systems, Plenum Press, New York, 1981, 321–328.Google Scholar
  26. Kacprzyk, J.; Straszak, A. A fuzzy approach to the stability of integrated regional development. In G.E. Lasker (Ed.): Applied Systems and Cybernetics, Vol. 6, Pergamon Press, New York, 1982a, 2997–3004.Google Scholar
  27. Kacprzyk, J.; Straszak, A. Determination of’ stable’ regional development trajectories via a fuzzy decision-making model. In R.R. Yager (Ed.): Recent Developments in Fuzzy Sets and Possibility Theory, Pergamon Press, New York, 1982b, 531–541.Google Scholar
  28. Kacprzyk, J. A branch-and-bound algorithm for the multistage control of a nonfuzzy system in a fuzzy environment. Control and Cybern., 1978a, 7, 51–64.MathSciNetzbMATHGoogle Scholar
  29. Kacprzyk, J. Control of a nonfuzzy system in a fuzzy environment with fuzzy termination time. Systems Sci., 1977, 3, 325–341.MathSciNetGoogle Scholar
  30. Kacprzyk, J. Control of a stochastic system in a fuzzy environment with fuzzy termination time. Systems Sci., 1978b, 291–300.Google Scholar
  31. Kacprzyk, J. Decision making in a fuzzy environment with fuzzy termination time. Fuzzy Sets and Syst., 1978c, 1, 169–179.MathSciNetzbMATHCrossRefGoogle Scholar
  32. Kacprzyk, J. A branch-and-bound algorithm for the multistage control of a fuzzy system in a fuzzy environment}. Kybernetes, 1979, 8, 139–147.zbMATHCrossRefGoogle Scholar
  33. Kacprzyk, J. A generalization of fuzzy multistage decision making and control via linguistic quantifiers. Int. J. of Control, 1983a, 38, 1249–1270.MathSciNetzbMATHCrossRefGoogle Scholar
  34. Kacprzyk, J. Multistage Decision-Making under Fuzziness. Verlag TÜV Rheinland, Cologne, 1983b.zbMATHGoogle Scholar
  35. Kacprzyk, J. Interpolate reasoning in optimal fuzzy control. Proc. of Second IEEE International Conference on Fuzzy Systems (FUZZ-IEEE’93), 1993, Vol. II, 1259–1263.CrossRefGoogle Scholar
  36. Kacprzyk, J. Fuzzy dynamic programming — basic issues, In M. Delgado, J. Kacprzyk, J.-L. Verdegay and M.A. Vila (Eds.): Fuzzy Optimization: Recent Advances, Physica-Verlag, Heidelberg, 1994a, 321–331.Google Scholar
  37. Kacprzyk, J. Multistage Fuzzy Control: A Prescriptive Mode-Based Approach. Wiley, Chichester (in press), 1996.Google Scholar
  38. Kacprzyk, J.; Esogbue, A.O. Fuzzy dynamic programming: main developments and applications. Fuzzy Sets and Systems (in press), 1996.Google Scholar
  39. Kacprzyk, J.; Staniewski, P. A new approach to the control of stochastic systems in a fuzzy environment, Arch. Automat. i Telemech., 1980, XXV, 443–444.MathSciNetGoogle Scholar
  40. Kacprzyk, J.; Staniewski, P. Long-term inventory policy-making through fuzzy decision-making models. Fuzzy Sets and Syst., 1982, 8, 117–132.zbMATHCrossRefGoogle Scholar
  41. Kacprzyk, J.; Staniewski, P. Control of a deterministic system in a fuzzy environment over an infinite planning horizon, Fuzzy Sets and Syst., 1983, 10, 291–298.MathSciNetzbMATHCrossRefGoogle Scholar
  42. Kacprzyk, J.; Safteruk, K.; Staniewski, P. On the control of stochastic systems in a fuzzy environment over infinite horizon, Systems Sci., 1981, 7, 121–131.MathSciNetzbMATHGoogle Scholar
  43. Klein, CM. A model for the transportation of hazardous waste. Decision Sciences, 1991. 22, 1091–1108CrossRefGoogle Scholar
  44. Komolov, S.V. et al. On the problem of optimal control of a finite automaton with fuzzy constraints and fuzzy goal (in Russian), Kybernetika (Kiev), 1979, 6, 30–34.MathSciNetGoogle Scholar
  45. Kraslawski, A.; Górak, A,; Vogelpohl, A. Fuzzy dynamic programming in the synthesis of distillation column systems. Computers and Chemical Engineering, 1989, 13, 611–618.CrossRefGoogle Scholar
  46. Narshima, Sastry V.; Tiwari, R.N.; Sastry, K.S. Dynamic programming approach to multiple objective control problems having deterministic or fuzzy goals. Fuzzy Sets and Systems, 1993, 57, 195–202.MathSciNetCrossRefGoogle Scholar
  47. Stein, W.E. Optimal stopping in a fuzzy environment, Fuzzy Sets and Syst., 1980, 3, 252–259.CrossRefGoogle Scholar
  48. Sugianto, L.F.; Mielczarski, W. A fuzzy logic approach to optimize inventory. In G.F. Forsyth and M. Ali (Eds.): Proceedings of Eighth International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, Gordon and Breach, 1995a, Australia, 419–424.Google Scholar
  49. Sugianto, L.F.; Mielczarski, W. Control of power station inventory by optimal allocation process with fuzzy logic approach. Proceedings of Control’95 Conference, 1995b, Australia, Vol. 2, 529–533.Google Scholar
  50. Yuan, Y.; Wu, Z. Algorithm of fuzzy dynamic programming in AGV scheduling. Proceedings of the International Conference on Computer Integrated Manufacturing — ICCIM’91, 1991, 405–408.Google Scholar
  51. Zadeh, L.A. Probability measures of fuzzy events, J. of Math. Anal. and Appls., 1968, 23, 421–427.MathSciNetzbMATHCrossRefGoogle Scholar
  52. Zimmermann, H.-J. Fuzzy Sets, Decision Making, and Expert Systems. Kluwer, Dordrecht, 1987.Google Scholar

Copyright information

© Springer Science+Business Media New York 1999

Authors and Affiliations

  • Janusz Kacprzyk
    • 1
  • Augustine O. Esogbue
    • 2
  1. 1.Polish Academy of SciencesSystems Research InstituteWarsawPoland
  2. 2.Georgia Institute of TechnologySchool of Industrial and Systems EngineeringAtlantaUSA

Personalised recommendations