Purpose – The purpose of this paper is to evaluate the reliability of individual software components in terms of the probability that each software component performs its intended functionality successfully. The overall software system reliability is evaluated. Design/methodology/approach –...

Purpose – The purpose of this paper is to model the occurrences of successive failure types and times to failure of the two repairable machine systems. Design/methodology/approach – Historical data on failure types and time to failures of the given machine systems (4 nos) were gainfully...

Purpose – The paper aims to propose a novel strategic approach, named a Scorecard‐Markov model, combining an evaluation scorecard and a hidden Markov model (HMM) for new product idea screening (NPIS) decisions. Design/methodology/approach – A scorecard is constructed to evaluate new...

Gradient-based approaches to direct policy search in reinforcement learning have received much recent attention as a means to solve problems of partial observability and to avoid some of the problems associated with policy degradation in value-function methods. In this paper we introduce GPOMDP,...

In this paper, we assume that the log return of the underlying asset follows a semi-Markov process, then from the knowledge of the kernel we derive an explicit expression for the value of the option and for the bare risk in the case of the European call (put) option and, by means of a recursive...

In a Markovian setting, we introduce a class of pricing measures and forward measures. Using multiplicative perturbation theory of Markovian semigroups, we study the relationship between the pricing semigroup and the forward semigroup, and obtain the forward semigroup pricing method....

Monte Carlo estimators of sensitivity indices and the marginal density of the price dynamics are derived for the Hobson-Rogers stochastic volatility model. Our approach is based mainly upon the Kolmogorov backward equation by making full use of the Markovian property of the dynamics given the...

In this paper, the authors explore a dynamical version of the Aoki and Yoshikawa model (AYM) for an economy driven by demand. They show that when an appropriate Markovian dynamics is taken into account, the AYM has different equilibrium distributions depending on the form of transition...