For sequential decision processes with countable state spaces, we prove compactness of the set of strategic measures corresponding to nonrandomized policies. For the Borel state case, this set may not be compact (Piunovskiy, Optimal control of random sequences in problems with constraints....

We consider a production model with two facilities sharing a resource during a time horizon consisting of a number of time periods. Cumulative production levels at the ends of consecutive periods are linked with constraints of a general form. This allows us to give different interpretations...

We study a Merton type optimization problem under a reallocation constraint. Under this restriction, the stock holdings can not be liquidated faster than a certain rate. This is a common restriction in certain type of investment firms. Our main objective is to study the large time optimal growth...

We study the efficient frontier problem of maximizing the expected utility of terminal wealth and minimizing the conditional VaR of the utility loss. We establish the existence of the optimal solution with the convex duality analysis. We find the optimal value of the constrained problem with the...

In this paper we apply a new framework for the study of monotonicity in queueing systems to stochastic scheduling models. This allows us a unified treatment of many different models, among which are multiple and single server models (with and without feedback), discrete and continuous time...

In this paper we consider a firm that employs heterogeneous workers to meet demand for its product or service. Workers differ in their skills, speed, and/or quality, and they randomly leave, or turn over. Each period the firm must decide how many workers of each type to hire or fire in order to...

The problem of a firm willing to optimally promote and sell a single product on the market is here undertaken. The awareness of such product is modeled by means of a Nerlove–Arrow goodwill as a state variable, differentiated jointly by means of time and of age of the segments in which the...

Demand and procurement planning for consumer electronics products must cope with short life cycles, limited replenishment opportunities and a willingness to pay that is influenced by past prices and decreases over time. We therefore propose the use of an integrated pricing and inventory control...

Fluid models are used to study functionals of the underlying random processes. Instead of analysing the trajectories, we investigate algebraic equations of the dynamic programming type which turn out to be discrete analogs of the corresponding differential equations. This analysis makes it...

We consider the problem of optimally allocating the seats on a single flight leg to the demands from multiple fare classes that arrive sequentially. It is well-known that the optimal policy for this problem is characterized by a set of protection levels. In this paper, we develop a new...