This research examines state clustering in Markov Decision processes, specifically addressing the problem referred to as Markov Decision process with restricted observations. The general problem is a special case of a Partially Observable Markov Decision process where the state space is...

In this thesis, three procurement policies (Backup Policy, Blend Policy, and Partial Order Policy) are considered and evaluated using a Discrete Time Markov Decision Process. The following factors were analyzed: retailer's demand distribution, holding cost, purchasing cost and supplier's...

In this paper we study Markov Decision Process (MDP) problems with the restriction that at decision epochs only a finite number of given Markovian decision rules may be applied. The elements of the finite set of allowed decision rules should be mixed to improve the performance. The set of...

In this paper methods of mixing decision rules are investigated and applied to the so-called multiple job type assignment problem with specialized servers which is modeled as continuous time Markov decision process. Performance optimization is difficult for this assignment problem, but...

A recurrent problem in manpower control is how to attain the desired structural configuration in an optimal way, since it is possible to reach a desired structural configuration using different control inputs. The major aim of this paper is to develop a Markov Decision Process for optimal...

The standard Value Iteration (VI) algorithm, referred to as Value Iteration Pre-Jacobi (PJ-VI) algorithm, is the simplest Value Iteration scheme, and the well-known algorithm for solving Markov Decision Processes (MDPs). In the literature, several versions of VI algorithm were developed in order...

This paper develops a theoretical framework that formalizes a guerrilla movement's observed oil pipeline attack decision. The movement's decision is modeled as an infinite horizon Markov Decision Process, where each period it chooses to attack or not attack the pipeline. For extortionary...

This article is motivated by the case of a company manufacturing industrial equipment that faces two types of demand: on the one hand there are the so-called regular orders for installations or refurbishing of existing facilities, these orders have a relatively long lead time; on the other hand...

The aim of the paper is to show that Lyapunov-like ergodicity conditions on Markov decision processes with Borel state space and possibly unbounded cost provide the approximation of an average cost optimal policy by solvingn-stage optimization problems (n=1, 2, ...). The used approach ensures...

In this paper, we consider a supply chain with one manufacturer, one retailer, and some online customers. In addition to supplying the retailer, manufacturers may selectively take orders from individuals online. Through the Markov Decision Process, we explore the optimal production and...