This paper is concerned with hierarchical control of stochastic manufacturing systems with machines whose capacity states are governed by a Markov process dependent on the rates of production. The objective is to choose production rates that minimize the total inventory/shortage and production...

This paper explores sufficient conditions for a continuous stationary Markov optimal policy and a concave value function in stochastic dynamic programming problems. Also, the paper addresses conditions needed for the differentiability of the value function. The paper uses conditions such as...