This paper studies multiproduct inventory models with stochastic demands and a warehousing constraint. Finite horizon as well as stationary and nonstationary discounted-cost infinite-horizon problems are addressed. Existence of optimal feedback policies is established under fairly general...

We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

The paper is concerned with the reduction of a class of stochastic optimal control problems to simpler problems by using decomposition and aggregation. Decomposition is shown to provide a good approximation when the system dynamics involve nearly decomposable matrices or variables with strong...

In this paper, we identify a new class of stochastic Iinear convex optimal control problems, whose solution can be obtained by solving appropriate equivalent deterministic optimal control problems. The term 'linear convex' is meant to imply that the dynamics is linear and the cost function is...

This paper presents an extension of earlier research on heirarchical control of stochastic manufacturing systems with linear production costs. A new method is introduced to construct asymptotically optimal open-loop and feedback controls for manufacturing systems in which the rates of machine...

We consider a finite-horizon control model with additive input. There are two convex functions which describe the running cost and the terminal cost within the system. The cost of input is proportional to the input and can take both positive and negative values. It is shown that there exists a...

This paper is concerned with an asymptotic analysis of hierarchical production and setup scheduling in a stochastic manufacturing system consisting of a single failure-prone machine and facing constant demands for a number of products. At any given time the system can only produce one type of...

In this paper, we treat an optimal control problem of a stochastic two-machine flowshop with machines subject to random breakdown and repair. While the problem is difficult to solve, it can be approximated by a deterministic problem when the rates of machine failure and repair become large....