We consider a two-station network with two types of jobs: type 0 jobs require service at station 1 only and type 1 jobs require service both at station 1 and 2 in sequence. Each station has a single server. The problem is to schedule the server at station 1 between the two types of jobs in order...

We consider a stochastic control problem over an infinite horizon where the state process is influenced by an unobservable environment process. In particular, the Hidden-Markov-model and the Bayesian model are included. This model under partial information is transformed into an equivalent one...

We consider optimal control problems for systems described by stochastic differential equations with delay. We state conditions for certain classes of such systems under which the stochastic control problems become finite-dimensional. These conditions are illustrated with three applications....

We propose an optimal schedule for multiple classes of arrivals in a queueing system consisting of queues in tandem. The arrival process for each class is Poisson with different rates, and the service times are constant. A theoretical result is presented by Linear Programming of sample-path...

We consider zero-sum Markov games with incomplete information. Here, the second player is never informed about the current state of the underlying Markov chain. The existence of a value and of optimal strategies for both players is shown. In particular, we present finite algorithms for computing...

We study the minimization of a spectral risk measure of the total discounted cost generated by a Markov Decision Process (MDP) over a finite or infinite planning horizon. The MDP is assumed to have Borel state and action spaces and the cost function may be unbounded above. The optimization...

We consider a dynamic mean-risk problem, where the risk constraint is given by the Average Value–at–Risk. As financial market we choose a discrete-time binomial model which allows for explicit solutions. Problems where the risk constraint on the final wealth is replaced by intermediate risk...

We consider the classical Cramér-Lundberg model with dynamic proportional reinsurance and solve the problem of finding the optimal reinsurance strategy which minimizes the expected quadratic distance of the risk reserve to a given benchmark. This result is extended to a mean-variance problem....

In this paper we investigate dependence properties and comparison results for multidimensional Lévy processes. In particular we address the questions, whether or not dependence properties and orderings of the copulas of the distributions of a Lévy process can be characterized by corresponding...

We investigate the problem of minimizing the Average-Value-at-Risk (AVaR <Subscript> τ </Subscript>) of the discounted cost over a finite and an infinite horizon which is generated by a Markov Decision Process (MDP). We show that this problem can be reduced to an ordinary MDP with extended state space and give...</subscript>