Evolution of Strategies in Repeated Games with Discounting

In repeated games there is in general a large set of equilibria. We also know that in the repeated prisoners dilemma there is a profusion of neutrally stable strategies, but no strategy that is evolutionarily stable. This paper investigates whether and how neutrally stable strategies can be upset in a process of mutation and selection. While neutral stability excludes that mutants have a selective advantage themselves, it does not rule out the possibility that mutants that are neutral can enter a population and create a selective advantage for a second mutant. This will be called an indirect invasion and the central results show that, for high enough continuation probability, there is no strategy that is robust against indirect invasions. Such stepping stone paths out of equilibrium generally exist both in the direction of more and in the direction of less cooperation.