We propose an asymptotically optimal heuristic, which we termed the Randomized Assignment Control (RAC) for restless multi-armed bandit problems with discrete-time and fi nite states. It is based on a linear programming relaxation to the original stochastic control formulation. In contrast to...

Patient care in many healthcare systems consists of two phases of service: assessment (or triage) and treatment. It is sometimes the case that these phases are carried out by the same medical providers. We consider the question of how to prioritize the work by the medical providers to balance...