In this paper, we apply the idea of $k$-local contraction of \cite{zec, zet} to study discounted stochastic dynamic programming models with unbounded returns. Our main results concern the existence of a unique solution to the Bellman equation and are applied to the theory of stochastic optimal...

This paper treats of stochastic games. We focus on nonzero-sum games and provide a detailed survey of selected recent results. In Section 1, we consider stochastic Markov games. A correlation of strategies of the players, involving ``public signals'', is described, and a correlated equilibrium...

This paper generalizes the classical discounted utility model introduced by Samuelson by replacing a constant discount rate with a function. The existence of recursive utilities and their constructions are based on Matkowski's extension of the Banach Contraction Principle. The derived utilities...

In this paper we study a Markov decision process with a non-linear discount function. Our approach is in spirit of the von Neumann-Morgenstern concept and is based on the notion of expectation. First, we define a utility on the space of trajectories of the process in the finite and infinite time...

In this paper, we apply the idea of $k$-local contraction of \cite{zec, zet} to study discounted stochastic dynamic programming models with unbounded returns. Our main results concern the existence of a unique solution to the Bellman equation and are applied to the theory of stochastic optimal...

This paper treats of stochastic games. We focus on nonzero-sum games and provide a detailed survey of selected recent results. In Section 1, we consider stochastic Markov games. A correlation of strategies of the players, involving ``public signals'', is described, and a correlated equilibrium...

This paper generalizes the classical discounted utility model introduced by Samuelson by replacing a constant discount rate with a function. The existence of recursive utilities and their constructions are based on Matkowski's extension of the Banach Contraction Principle. The derived utilities...

In this paper we study a Markov decision process with a non-linear discount function. Our approach is in spirit of the von Neumann-Morgenstern concept and is based on the notion of expectation. First, we define a utility on the space of trajectories of the process in the finite and infinite time...

To maintain stability yet retain the flexibility to adapt to changing circumstances, social systems must strike a balance between the maintenance of a shared reality and the survival of minority opinion. A computational model is presented that investigates the interplay of two basic,...

Computer simulations, one of the most powerful tools of science, have many uses. This paper concentrates on the benefits to the social science researcher. Based on our, somewhat paradoxical experiences we had when working with computer simulations, we argue that the main benefit for the...