In this paper we consider a singularly perturbed Markov decision process with finitely many states and actions and the limiting expected average reward criterion. We make no assumptions about the underlying ergodic structure. We present algorithms for the computation of a uniformly optimal...

In this paper we extend standard dynamic programming results for the risk sensitive optimal control of discrete time Markov chains to a new class of models. The state space is only finite, but now the assumptions about the Markov transition matrix are much less restrictive. Our results are then...

The paper extends the Bierman-Hausman credit granting model by incorporating economic factors, which may vary randomly over time. Sufficient conditions are found for the optimality of simple credit policies. The monotonicity results are based on nonstandard orderings induced by the probability...

The paper extends the Bierman-Hausman credit granting model by incorporating economic factors, which may vary randomly over time. Sufficient conditions are found for the optimality of simple credit policies. The monotonicity results are based on nonstandard orderings induced by the probability...

We consider the problem of control for continuous time stochastic hybrid systems in finite time horizon. The systems considered are nonlinear: the state evolution is a nonlinear function of both the control and the state. The control parameters change at discrete times according to an underlying...

We consider the problem of control for continuous time stochastic hybrid systems in finite time horizon. The systems considered are nonlinear: the state evolution is a nonlinear function of both the control and the state. The control parameters change at discrete times according to an underlying...

We address an assembly problem, motivated by flat panel display manufacturing, where the quality (or performance) of the final product depends upon characteristics of the components to be assembled, which are not constant from component to component. We analyze the tradeoff between the increase...