Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has hindered their proliferation. Semi-analytical approaches make...

The speed with which an organization takes action against unplanned failure and scrapping of its capital equipment is used as a measure of organizational nimbleness. Operational decisions at the plant level are studied in the setting of the optimal control model of Kamien and Schwarz for...

We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

We study a class of discounted autonomous infinite horizon optimal control problems where the state dynamics may undergo discontinuous changes when the state crosses from one region of the state space to another. Assuming the state and control space are one-dimensional, we provide structural...

We consider the problem of determining a sequence of payments among a set of entities that clear (if possible) the liabilities among them. We formulate this as an optimal control problem, which is convex when the objective function is, and therefore readily solved. For this optimal control...

We use a conventional dynamic economic model to integrate individual optimization, equilibrium interactions, and policy analysis into the canonical epidemiological model. Our tractable framework allows us to represent both equilibrium and optimal allocations as a set of differential equations...

We propose a continuous-time version of the adaptive robust methodology introduced in Bielecki et al. (2019). An agent solves a stochastic control problem where the underlying uncertainty follows a jump-diffusion process and the agent does not know the drift parameters of the process. The agent...

We consider a standard Brownian motion whose drift can be increased or decreased in a possibly singular manner. The objective is to minimize an expected functional involving the time-integral of a running cost and the proportional costs of adjusting the drift. The resulting two-dimensional...