Information delays exist in an inventory system when it takes time to collect, process, validate, and transmit inventory/demand data. A general framework is developed in this paper to describe information flows in an inventory system with information delays. We characterize the suffcient...

Uncertainties involved in decision making often impose challenges to our ability of modeling and analyzing the reality. The purpose of this paper is to demonstrate how one can go beyond the conventional optimization thinking, via taking a stochastic viewpoint, to push the boundaries of the...

We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

The paper is concerned with the reduction of a class of stochastic optimal control problems to simpler problems by using decomposition and aggregation. Decomposition is shown to provide a good approximation when the system dynamics involve nearly decomposable matrices or variables with strong...