Table of Contents

New Introduction by Eric V. Denardo, Yale University 1. A Multi-stage Allocation Process 2. A Stochastic Multistage Decision Process 3. The Structure of Dynamic Programming Processes 4. Existence and Uniqueness Theorems 5. The Optimal Inventory Equation 6. Bottleneck Problems in Multistage Production Processes 7. Bottleneck Problems: Examples 8. A Continuous Stochastic Decision Process 9. A New Formalism in the Calculus of Variations 10. Multistage Games 11. Markovian Decision Processes Indexes.

About the Author

The Dawn of Dynamic Programming Richard E. Bellman (1920-1984) is best known for the invention of dynamic programming in the 1950s. During his amazingly prolific career, based primarily at The University of Southern California, he published 39 books (several of which were reprinted by Dover, including Dynamic Programming, 42809-5, 2003) and 619 papers. Despite battling the crippling effects of a brain injury, he still published 100 papers during the last eleven years of his life. He was a frequent informal advisor to Dover during the 1960s and 1970s. Professor Bellman was awarded the IEEE Medal of Honor in 1979 "for contributions to decision processes and control system theory, particularly the creation and application of dynamic programming." The IEEE citation continued: "Richard Bellman is a towering figure among the contributors to modern control theory and systems analysis. His invention of dynamic programming marked the beginning of a new era in the analysis and optimization of large-scale systems and opened a way for the application of sophisticated computer-oriented techniques in a wide variety of problem areas ranging from the design of guidance systems for space vehicles to pest control and network optimization." In the Author's Own Words: "There are many questions that are difficult to answer, but hardly worth asking. The well-trained mathematician does not measure the value of a problem solely by its intractability. The challenge is there, but even very small boys do not accept all dares." "Scientific developments can always be made logical and rational with sufficient hindsight. It is amazing, however, how clouded the crystal ball looks beforehand. We all wear such intellectual blinders and make such inexplicable blunders that it is amazing that any progress is made at all." - Richard Bellman

Reviews

"Will definitely be of greatest benefit to the engineer or economist who wants an idea of how to attack various applied problems.