Computing the solution to a stochastic optimal control problem is difficult. A method of approximating a solution to a given stochastic optimal control problem using Markov chains was developed in [1]. This paper describes a suite of MATLAB functions implementing this method of approximating a...

Computing a numerical solution to a periodic optimal control problem is difficult. A method of approximating a solution to a given (stochastic) optimal control problem using Markov chains was developed in [3]. This paper describes an attempt at applying this method to a periodic optimal control...

This paper describes a suite of MATLAB routines devised to provide an approximately optimal solution to an infinite-horizon stochastic optimal control problem. The suite is an updated version of that described in [Kra01b]. Its routines implement a policy improvement algorithm to optimise a...

In this report, we outline a method for approximating a Markovian (or feedback-Nash) equilibrium of a dynamic game, possibly subject to coupled-constraints. We treat such a game as a "multiple" optimal control problem. A method for approximating a solution to a given optimal control problem via...