Skip to main content
View expanded cover

Profiles in Operations Research pp 415–445Cite as

Richard E. Bellman

  • 1520 Accesses

Part of the International Series in Operations Research & Management Science book series (ISOR,volume 147)

Abstract

The post-WorldWar II (WWII) development of operations research (OR) owes much to two organizations: Princeton University and the RAND Corporation. Richard (Dick) Bellman’s formative years were spent at both—associations that shaped his research interests and led him to areas of applications that included well-known OR problems. His interest in mathematics developed early; he trained as a mathematician and always regarded himself as one. The Princeton mathematics department offered him an excellent graduate program, his first teaching opportunity, and, especially, a research environment that introduced him to key areas of his future research program. The exceptional group of scientists at RAND exposed him to game theory, optimization theory, and many classical applied problems in OR. Dick’s invention and development of dynamic programming (DP) in the early 1950s marked the beginning of a new era in the analysis and optimization of large-scale systems. His research established him as a towering figure among the contributors to modern optimization, control theory, and systems analysis. Dick was among the first to realize the transformative impact of computers, not just in terms of the computational power required for obtaining numerical solutions, but in the very nature of how decision problems would be approached and solved. He was noted for his prolific output—he published over 600 research papers and over 40 books.

Keywords

  • Dynamic Programming
  • Operation Research
  • Optimal Policy
  • Short Path Problem
  • Borderline Personality Disorder

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-1-4419-6281-2_23
  • Chapter length: 31 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   89.00
Price excludes VAT (USA)
  • ISBN: 978-1-4419-6281-2
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   119.00
Price excludes VAT (USA)
Hardcover Book
USD   199.99
Price excludes VAT (USA)
Learn about institutional subscriptions

References

  • Adomian, G, Esogbue A (1984) The contributions of Richard Ernest Bellman (1920–1984) to operations research and management science. OR/MS Today 11(4):6–7

    Google Scholar 

  • Adomian G, Lee E (1986) The research contributions of Richard Bellman. Comput Math Appl 12A(6):633–651

    Google Scholar 

  • Beckenbach E, Bellman R (1961) Introduction to inequalities. Random House, New York, NY

    Google Scholar 

  • Beckenbach E, Bellman R (1965) Inequalities. Springer, New York, NY

    Google Scholar 

  • Bellman K (2009) Personal communication

    Google Scholar 

  • Bellman K, Landauer C (2000) Towards an integration science: the influence of Richard Bellman on our research. J Math Anal Appl 249(1):3–31

    CrossRef  Google Scholar 

  • Bellman N, Bellman E, Bellman K (1986) Richard Ernest Bellman. In: Roth R (ed) The Bellman continuum. World Scientific, Singapore, pp 3–11

    Google Scholar 

  • Bellman R (1943a) The stability of solutions of linear differential equations. Duke Math J 10(4):643–647

    CrossRef  Google Scholar 

  • Bellman R (1943b) An integral inequality. Duke Math J 10(3):547–550

    CrossRef  Google Scholar 

  • Bellman R (1944) Almost-orthogonal series. Bull Am Math Soc 50 (1):517–519

    CrossRef  Google Scholar 

  • Bellman R (1947a) The boundedness of solutions of linear differential equations. Duke Math J 14 (1):83–97

    CrossRef  Google Scholar 

  • Bellman R (1947b) On the boundedness of solutions of nonlinear differential and difference solutions. Trans Am Math Soc 62(3):357–386

    CrossRef  Google Scholar 

  • Bellman R (1949) On the existence and boundedness of solutions of nonlinear differential-difference solutions. Ann Math Series 2 50(2):347–355

    CrossRef  Google Scholar 

  • Bellman R (1950) Generalized Eisenstein series and non-analytic automorphic functions. Proc Natl Acad Sci 36(6):356–359

    CrossRef  Google Scholar 

  • Bellman R (1951) On the functional equations of the Dirichlet series derived from Seigel modular forms. Proc Natl Acad Sci 37(2):84–87

    CrossRef  Google Scholar 

  • Bellman R (1952) On the theory of dynamic programming. Proc Natl Acad Sci 38(8):716–719

    CrossRef  Google Scholar 

  • Bellman R (1953a) Some functional equations in the theory of dynamic programming. Proc Natl Acad Sci 39(10):1077–1082

    CrossRef  Google Scholar 

  • Bellman R (1953b) Stability theory of differential equations. McGraw-Hill, New York, NY

    Google Scholar 

  • Bellman R (1954a) Some problems in the theory of dynamic programming. Econometrica 22 (1):37–48

    CrossRef  Google Scholar 

  • Bellman R (1954b) Some applications of the theory of dynamic programming: a review. J Oper Res Soc Am 2(3):275–288

    Google Scholar 

  • Bellman R (1954c) Dynamic programming and a new formalism in the calculus of variations. Proc Natl Acad Sci 40(4):231–235

    CrossRef  Google Scholar 

  • Bellman R (1955a) Bottleneck problems, functional equations and dynamic programming. Econometrica 23(1):73–87

    CrossRef  Google Scholar 

  • Bellman R (1955b) Equipment replacement policy. J SIAM 3(3):133–136

    Google Scholar 

  • Bellman R (1956a) A variational problem with constraints in dynamic programming. J SIAM 4(1):48–61

    Google Scholar 

  • Bellman R (1956b) On the theory of dynamic programming—a warehousing problem. Manage Sci 2(3):272–275

    CrossRef  Google Scholar 

  • Bellman R (1956c) Mathematical aspects of scheduling theory. J SIAM 4(3):168–205

    Google Scholar 

  • Bellman R (1956d) Dynamic programming and Lagrange multipliers. Proc Natl Acad Sci 42(10):767–769

    CrossRef  Google Scholar 

  • Bellman R (1957a) Functional equations in the theory of dynamic programming-VI: a direct convergence proof. Ann Math 65(2):215–223

    CrossRef  Google Scholar 

  • Bellman R (1957b) Dynamic programming and the numerical solution of variational problems. Oper Res 5(2):277–288

    Google Scholar 

  • Bellman R (1957c) On a dynamic programming approach to the caterer problem. Manage Sci 3(3):270–278

    CrossRef  Google Scholar 

  • Bellman R (1957d) On the computational solution of linear programming problems involving almost-block-diagonal matrices. Manage Sci 3(4):403–406

    CrossRef  Google Scholar 

  • Bellman R (1957e) A Markovian decision process. J Math Mechan 6(4):679–684

    Google Scholar 

  • Bellman R (1957f) Dynamic programming. Princeton University Press, Princeton, NJ. Dover Publications reprint 2003

    Google Scholar 

  • Bellman R (1958a) On a routing problem. Q Appl Math 16(1):87–90

    Google Scholar 

  • Bellman R (1958b) On ‘heuristic problem solving,’ by Simon and Newell. Oper Res 6(3):448–449

    CrossRef  Google Scholar 

  • Bellman R (1961) Adaptive control processes: a guided tour. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Bellman R (1962) Invariant imbedding and random walk. Proc Am Math Soc 13(2):251–254

    CrossRef  Google Scholar 

  • Bellman R (ed) (1963) Mathematical optimization techniques. University of California Press, Berkeley, CA

    Google Scholar 

  • Bellman R (ed) (1964) Stochastic processes in mathematical physics and engineering. American Mathematical Society, Providence, RI

    Google Scholar 

  • Bellman R (1965) An application of dynamic programming to location-allocation problems. SIAM Rev 7(1):126–128

    CrossRef  Google Scholar 

  • Bellman R (1966) Dynamic programming. Science 153(3731):34–37

    CrossRef  Google Scholar 

  • Bellman R (1967) Introduction to the mathematical theory of control processes. Volume 1: linear equations and quadratic criteria. Academic, New York, NY

    Google Scholar 

  • Bellman R (1968) Some vistas of modern mathematics: dynamic programming, invariant imbedding, and the mathematical biosciences. University of Kentucky Press, Lexington, KY

    Google Scholar 

  • Bellman R (1970) Introduction to matrix analysis, 2nd edn. McGraw-Hill, New York, NY

    Google Scholar 

  • Bellman R (1971) Introduction to the mathematical theory of control processes. Volume 2: nonlinear processes. Academic, New York, NY

    Google Scholar 

  • Bellman R (1978) An introduction to artificial intelligence—can computers think? Boyd and Fraser, San Francisco, CA

    Google Scholar 

  • Bellman R (1980) Analytic number theory—an introduction. Addison-Wesley, Reading, MA

    Google Scholar 

  • Bellman R (1983) Mathematics in medicine. World Scientific, Singapore

    Google Scholar 

  • Bellman R (1984) Eye of the Hurricane: an autobiography. World Scientific, Singapore

    Google Scholar 

  • Bellman R, Blackwell D (1949) Some two-person games involving bluffing. Proc Natl Acad Sci 35(10):600–605

    CrossRef  Google Scholar 

  • Bellman R, Blackwell D (1951) Red dog, blackjack, and poker. Sci Am (January):44–47

    Google Scholar 

  • Bellman R, Brock P (1960) On the concept of a problem and problem-solving. Am Math Mon 67(2):119–134

    CrossRef  Google Scholar 

  • Bellman R, Clark C, Malcolm D, Craft C, Ricciardi F (1957) On the construction of a multi-person, multi-stage business game. Oper Res 5(4):469–503

    CrossRef  Google Scholar 

  • Bellman R, Cooke K (1959) Stability theory and adjoint operators for linear differential-difference equations. Trans Am Math Soc 92(3):470–500

    CrossRef  Google Scholar 

  • Bellman R, Cooke K (1963) Differential-difference equations. Academic Press, New York

    Google Scholar 

  • Bellman R, Cooke K (1968) Modern elementary differential equations. Addison-Wesley, Reading, MA

    Google Scholar 

  • Bellman R, Cooke K, Lockett J (1970) Algorithms, graphs, and computer. Academic, New York, NY

    Google Scholar 

  • Bellman R, Danskin J (1954) A survey of the mathematical theory of time-lag, retarded control, and hereditary processes. Report R-256, RAND Corporation, Santa Monica, CA

    Google Scholar 

  • Bellman R, Dreyfus S (1958a) On a tactical air-warfare model of Mengel. Oper Res 6(1):65–78

    CrossRef  Google Scholar 

  • Bellman R, Dreyfus S (1958b) Dynamic programming and the reliability of multicomponent devices. Oper Res 6(2):200–206

    CrossRef  Google Scholar 

  • Bellman R, Dreyfus S (1962) Applied dynamic programming. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Bellman R, Esogbue A, Nabeshima I (1982) Mathematical aspects of scheduling and applications. Pergamon Press, Oxford, England

    Google Scholar 

  • Bellman R, Glicksberg I, Gross O (1954) Some problems in the theory of dynamic programming—a smoothing problem. J SIAM 2(2):82–89

    Google Scholar 

  • Bellman R, Glicksberg I, Gross O (1956a) Some nonclassical problems in the calculus of variations. Proc Am Math Soc 7(1):87–94

    CrossRef  Google Scholar 

  • Bellman R, Glicksberg I, Gross O (1956b) On the bang-bang control problem. Q Appl Math 14(1):11–18

    Google Scholar 

  • Bellman R, Glicksberg I, Gross O (1958) Some aspects of the mathematical theory of control processes. Report R-313, RAND Corporation, Santa Monica, CA

    Google Scholar 

  • Bellman R, Gross O (1954) Some combinatorial problems arising in the theory of multistage processes. J SIAM 2(3):175–183

    Google Scholar 

  • Bellman R, Harris T (1951) Recurrence times for the Ehrenfest model. Pacific J Math 1(2):179–193

    Google Scholar 

  • Bellman R, Harris T (1952) On age-dependent binary branching processes. Ann Math 55(2):280–295

    CrossRef  Google Scholar 

  • Bellman R, Jacquez J, Kalaba R (1960a) Some mathematical aspects of chemotherapy, 1: one-organ models. Bull Math Biophy 22(2)181–198

    CrossRef  Google Scholar 

  • Bellman R, Jacquez J, Kalaba R (1960b) Some mathematical aspects of chemotherapy, 2: the distribution of a drug in the body. Bull Math Biophy 22(3):309–322

    CrossRef  Google Scholar 

  • Bellman R, Kalaba R (1959) Functional equations, wave propagation, and invariant imbedding. J Math Mechan 8(5):683–704

    Google Scholar 

  • Bellman R, Kalaba R (1960) On k-th best policies. J SIAM 8(4):582–588

    Google Scholar 

  • Bellman R, Kalaba R (1962) Mathematical programming and the maximum transform. J SIAM 10(3):550–567

    Google Scholar 

  • Bellman R, Kalaba R (eds) (1964) Selected papers on mathematical trends in control theory. Dover, New York, NY

    Google Scholar 

  • Bellman R, Kalaba R (1965) Dynamic programming and modern control theory. Academic, New York, NY

    Google Scholar 

  • Bellman R, Kalaba R, Wing G (1960) Invariant imbedding and the reduction of two-point boundary value problems to initial value problems. Proc Natl Acad Sci 46(12):1646–1649

    CrossRef  Google Scholar 

  • Bellman R, Shapiro H (1952) On the normal order of arithmetic functions. Proc Natl Acad Sci 38(10):884–886

    CrossRef  Google Scholar 

  • Bellman R, Smith C (1973) Simulation in human systems: decision-making in psychotherapy. Wiley-Interscience, New York, NY

    Google Scholar 

  • Bellman R, Strauss E (1949) Continued fractions, algebraic functions, and the Pade table. Proc Natl Acad Sci 35(8):472–476

    CrossRef  Google Scholar 

  • Bellman R, Wing G (1975) An introduction to invariant imbedding. Wiley, New York, NY

    Google Scholar 

  • Bellman R, Zadeh L (1970) Decision-making in a fuzzy environment. Manage Sci 17(4):141–164

    CrossRef  Google Scholar 

  • Cairns W (1939) The William Lowell Putnam Competition. Am Math Mon 46(5):307–308

    Google Scholar 

  • Chandrasekhar S (1960) Radiative transfer. Dover, New York, NY

    Google Scholar 

  • Danskin J (1959) Review of dynamic programming by Richard Bellman. Oper Res 7(4):536–540

    Google Scholar 

  • Dreyfus S (2002) Richard Bellman on the birth of dynamic programming. Oper Res 50(1):48–51

    CrossRef  Google Scholar 

  • Dreyfus S (2003) IFORS’ operational research hall of fame: Richard Ernest Bellman. Int Trans Oper Res 10(5):543–545

    CrossRef  Google Scholar 

  • Dreyfus S (2008) Personal communication

    Google Scholar 

  • Esogbue A, Bellman R (1984) Fuzzy dynamic programming and its extensions. In: Zimmermann H, Zadeh L, Gaines B (eds) Fuzzy sets and decision analysis (TIMS Studies in the Management Sciences: Volume 20). North-Holland, Amsterdam, pp 147–167

    Google Scholar 

  • Golomb S (1989) Richard E. Bellman. National academy of engineering memorial tributes, vol 3. The National Academies Press, Washington, DC, pp 22–29

    Google Scholar 

  • Gruenberger F (1968) The history of the JOHNNIAC. RM-5654-PR. The RAND Corporation, Santa Monica, CA

    Google Scholar 

  • Jacquez J (1985) Richard Bellman. Math Biosci 77(1):1–4

    CrossRef  Google Scholar 

  • Kagiwada H, Kalaba R (1986) The work of Richard Bellman-I: Optimization. Comput Math Appl 12A(6):785–790

    CrossRef  Google Scholar 

  • Kahn H (1962) On thermonuclear war. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Kuhn H (2002) Being at the right place at the right time. Oper Res 50(1):132–134

    CrossRef  Google Scholar 

  • Kushner H (2004) Remarks of Harold J. Kushner upon receiving the 2004 Bellman Heritage award. http:///www.a2c2.org/awards/bellman/index.php. Accessed 30 Jul 2009

  • Larson R (1979) Editorial: Richard Bellman wins the IEEE Medal of Honor. IEEE Trans Automat Control AC-24(3):385–386

    CrossRef  Google Scholar 

  • Lew A (1986) Richard Bellman’s contributions to computer science. J Math Anal Appl 119(1–2):90–96

    CrossRef  Google Scholar 

  • Leondes CT (1980) An appreciation of Professor Richard Bellman. J Optim Theor Appl 32(4):399–406

    CrossRef  Google Scholar 

  • Panossian H (1986) Richard Bellman and stochastic control systems. Comput Math Appl 12A(6):825–829

    CrossRef  Google Scholar 

  • Roth R (ed) (1986) The Bellman continuum. World Scientific, Singapore

    Google Scholar 

  • Simon H, Newell A (1958) Heuristic problem solving: the next advance in operations research. Oper Res 6(1):1–10

    CrossRef  Google Scholar 

  • Schultze A (1925) Elementary and intermediate algebra. Macmillan, New York, NY

    Google Scholar 

  • Titchmarsh E (1932) Theory of functions. Oxford University Press, Oxford, England

    Google Scholar 

  • Ulam S (1976) Adventures of a mathematician. Charles Scribner’s Sons, New York, NY

    Google Scholar 

  • Whittaker E, Watson G (1927) A course of modern analysis. Cambridge University Press, Cambridge, England

    Google Scholar 

Download references

Acknowledgments

I am indebted to Dr. Kirstie Bellman for her valuable input, her responses to our queries, and the pictures of Dick Bellman used in this profile. I am grateful to Professor Stuart Dreyfus for reviewing an early version of this profile and for supplying his reminiscences.

Author information

Authors and Affiliations

  1. School of Management, University at Buffalo, State University of New York, Buffalo, NY, USA

    Arjang A. Assad

Authors
  1. Arjang A. Assad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arjang A. Assad .

Editor information

Editors and Affiliations

  1. , School of Management, University at Buffalo, State University, Jacobs Management Center 160, Buffalo, 14260-4000, New York, USA

    Arjang A. Assad

  2. Robert H. Smith School of Business, University of Maryland, Van Munching Hall, College Park, 20742-1915, Maryland, USA

    Saul I. Gass

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Assad, A.A. (2011). Richard E. Bellman. In: Assad, A., Gass, S. (eds) Profiles in Operations Research. International Series in Operations Research & Management Science, vol 147. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-6281-2_23

Download citation