The value of an adaptive environment is determined by the decision rules used to modify it. These rules are central to the effective use of such an environment, as well as forming the basis for its design. In this paper, standard replacement models are extended to provide rules for decision makers in different contexts, and applied to provide insights into the design and use of adaptive environmental systems.