In this paper, we consider deterministic (both fluid and discrete) polling systems with N queues with infinite buffers and we show how to compute the best polling sequence (minimizing the average total workload). With two queues, the best polling sequence is always periodic when the system is...

In this paper, we consider deterministic (both fluid and discrete) polling systems with <I>N</I> queues with infinite buffers and we show how to compute the best polling sequence (minimizing the average total workload). With two queues, the best polling sequence is always periodic when the system is...</i>

In this paper we study Markov Decision Process (MDP) problems with the restriction that at decision epochs only a finite number of given Markovian decision rules may be applied. The elements of the finite set of allowed decision rules should be mixed to improve the performance. The set of...

A version of the classical secretary problem is studied, in which one is interested in selecting one of the <I>b</I> best out of a group of <I>n</I> differently ranked persons who are presented one by one in a random order. It is assumed that <I>b</I> is bigger than or equal to 1 is a preassigned number. It is...</i></i></i>

This discussion paper resulted in a publication in <A href="http://journals.cambridge.org/action/displayAbstract?fromPage=online&aid=8239378&fulltextType=RA&fileId=S026996481000032X">'Probability in the Engineering and Informational Sciences'</A>, 25(2), 157-69.<p>A version of the classical secretary problem is studied, in which one is interested in selecting one of the <I>b</I> best out of a group of <I>n</I> differently ranked persons who are...</i></i></p></a>

In this paper we study Markov Decision Process (MDP) problems with the restriction that at decision epochs only a finite number of given Markovian decision rules may be applied. The elements of the finite set of allowed decision rules should be mixed to improve the performance. The set of...

This paper considers a general class of stochastic dynamic choice models with discrete and continuous decision variables. This class contains a variety of models that are useful for modeling intertemporal household decisions under risk. Our examples are drawn from the field of development...

The Cross Entropy method is a well-known adaptive importance sampling method for rare-event probability estimation, which requires estimating an optimal importance sampling density within a parametric class. In this article we estimate an optimal importance sampling density within a wider...

In this paper we describe a Sequential Importance Sampling (SIS) procedure for counting the number of vertex covers in general graphs. The performance of SIS depends heavily on how close the SIS proposal distribution is to a uniform one over a suitably restricted set. The proposed algorithm...

In linear-quadratic control (LQC) problems with singular control cost matrix and/or singular transition matrix, we derive a reduction of the dimension of the Riccati matrix, simplifying iteration and solution. Employing a novel transformation, we show that, under a certain rank condition, the...