One. Finite Alternatives -- § 1. Introduction -- § 2. Geometric Interpretation -- § 3. Principle of Optimality -- § 4. Value Functions for Infinite Horizons: Value Iteration -- § 5. Policy Iteration -- § 6. Stability Properties -- § 7. Problems without Discount and with Infinite Horizon -- § 8. Automobile Replacement -- § 9. Linear Programming and Dynamic Programming -- References and Selected Reading to Part One -- Two. Risk -- § 10. Basic Concepts -- § 11. The Value Function -- § 12. The Principle of Optimality -- § 13. Policy Iteration -- § 14. Stability Properties -- § 15. Solution by Linear Programming -- § 16. Machine Care -- § 17. Inventory Control -- § 18. Uncertainty: Adaptive Programming -- § 19. Exponential Weighting -- References and Selected Reading to Part Two -- Three. Continuous Decision Variable -- § 20. An Allocation Problem -- § 21. General Theory -- § 22. Linear Inhomogeneous Problems -- § 23. A Turnpike Theorem -- § 24. Sequential Programming -- § 25. Risk -- § 26. Quadratic Criterion Function -- References and Selected Reading to Part Three -- Four. Decision Processes in Continuous Time -- § 27. Discrete Action -- § 28. Variable Level -- § 29. Risk of Termination -- § 30. Discontinuous Processes—Repetitive Decisions -- § 31. Continuous Time Inventory Control -- § 32. Continuous Action—Steady State Problems -- § 33. The Principle of Optimality in Differential Equation Form -- § 34. Dynamic Programming and the Calculus of Variations -- § 35. Variation under Constraints: The Maximum Principle -- References and Selected Reading to Part Four -- Author Index.
