We introduce a stochastic game in which transition probabilitiesdepend on the history of the play, i.e., the players’past action choices.To solve this new type of game under the limiting average reward crite-rion, we determine the set of jointly-convergent pure-strategy rewardswhich can be...