We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

We develop a general filtering framework for the problem of estimating the state of a system whose dynamics is governed by a discrete-time Markov process. We describe applications to inventory control systems with partial observations. We introduce conditional distributions and unnormalized...

We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

Information delays exist in an inventory system when it takes time to collect, process, validate, and transmit inventory/demand data. A general framework is developed in this paper to describe information flows in an inventory system with information delays. We characterize the suffcient...

The paper is concerned with the reduction of a class of stochastic optimal control problems to simpler problems by using decomposition and aggregation. Decomposition is shown to provide a good approximation when the system dynamics involve nearly decomposable matrices or variables with strong...

In this paper, we identify a new class of stochastic Iinear convex optimal control problems, whose solution can be obtained by solving appropriate equivalent deterministic optimal control problems. The term 'linear convex' is meant to imply that the dynamics is linear and the cost function is...

This paper presents an extension of earlier research on heirarchical control of stochastic manufacturing systems with linear production costs. A new method is introduced to construct asymptotically optimal open-loop and feedback controls for manufacturing systems in which the rates of machine...

We consider a finite-horizon control model with additive input. There are two convex functions which describe the running cost and the terminal cost within the system. The cost of input is proportional to the input and can take both positive and negative values. It is shown that there exists a...