Internet growth has allowed unprecedented widespread access to cultural creation including music and films, to knowledge, and to a wide range of consumer information. At the same time, it has become a huge source of business opportunities. Along with great benefits that this access to the...

Internet growth has allowed unprecedented widespread access to cultural creation including music and films, to knowledge, and to a wide range of consumer information. At the same time, it has become a huge source of business opportunities. Along with great benefits that this access to the...

We study a dynamic optimal routing problem, where a controller has to decide to which of two queues should arriving customers (representing packets, messages, call etc...) be sent. The service rate in each queue may depend on the state of the system, may change in time and is unknown to the...

We consider the problem of the perturbation of a class of linear-quadratic differential games with piecewise deterministic dynamics, where the changes from one structure (for the dynamics) to another are governed by a finite-state Markov process. Player 1 controls the continuous dynamics,...

We consider a zero-sum stochastic game with side constraints for both players with a special structure. There are two independent controlled Markov chains, one for each player. The transition probabilities of the chain associated with a player as well as the related side constraints depend only...

In this paper we consider a singularly perturbed Markov decision process with finitely many states and actions and the limiting expected average reward criterion. We make no assumptions about the underlying ergodic structure. We present algorithms for the computation of a uniformly optimal...