Computing the solution to a stochastic optimal control problem is difficult. A method of approximating a solution to a given stochatic optimal problem was developed in [1]. This paper describes a suite of Matlab functions implementing this method of approximating a solution to a given continuous...

We analyze a W-configuration assemble-to-order system with random lead times, random arrival of demand, and lost sales, in continuous time. Specifically, we assume exponentially distributed production and demand inter-arrival times. We formulate the problem as an infinite-horizon Markov decision...

We consider two control problems on a finite horizon; one stochastic and the other deterministic. In both problems the running cost and the terminal cost are the same. The controllable input in both problems is of an additive nature with cost proportional to the input (which can be both positive...