This paper studies the discrete time Markov decision processes (MDP) with expected discounted total reward, where the state space is countable, the action space is measurable, the reward function is extended real-valued, and the discount rate may be any real number. Two conditions (GC) and (C)...

This paper studies the discrete time Markov decision processes (MDP) with expected discounted total reward, where the state space is countable, the action space is measurable, the reward function is extended real-valued, and the discount rate may be any real number. Two conditions (GC) and (C)...

We study an optimal inventory control and allocation for a seller who uses sequential Internet auctions to sell replenishment products. This problem is faced not only by retailers/distributors in the retail industry but also by manufacturers who use sequential Internet auctions to sell products...