Strategies for constructing a Markov decision chain approximating a continuous-time finite-horizon optimal control problem are investigated. Some simple, analytically soluble, examples are treated and low computational complexity is reported. Extensions to the method and implementation are...

We solve an infinite time-horizon bounded-variation stochastic control problem with regime switching between N states. This is motivated by the problem of a government that wants to control the country's debt-to-GDP (gross domestic product) ratio. In our formulation, the debt-to-GDP ratio...

We consider the optimal strategy of R&D expenditure adopted by a firm that engages in R&D to develop an innovative product to be launched in the market. The firm faces with technological uncertainty associated with the success of the R&D effort and market uncertainty of the stochastic revenue...

We propose a tractable dynamic framework for the joint determination of optimal consumption, portfolio choice, and healthcare irreversible investment. Our model is based on a Merton's portfolio and consumption problem, where, in addition, the agent can choose the time at which undertaking a...

Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has hindered their proliferation. Semi-analytical approaches make...

We consider a real options model for the optimal irreversible investment problem of a profit maximizing company. The company has the opportunity to invest into a production plant capable of producing two products, of which the prices follow two independent geometric Brownian motions. After...

We consider the problem of a government that wants to manage the country's debt-to- GDP (gross domestic product) ratio. The latter evolves stochastically in continuous time, and its drift is given by the interest rate on government debt, net of the growth rate of GDP. We further allow the...