As self-learning pricing algorithms become popular, there are growing concerns among academics and regulators that … algorithms could learn to collude tacitly on non-competitive prices and thereby harm competition. I study popular reinforcement … learning algorithms and show that they develop collusive behavior in a simulated market environment. To derive a counterfactual …