We consider stochastic dynamics for the Matching Pennies game, that behave, in expectation, like best-response dynamics (the continuous fictitious play). We prove convergence to the unique equilibrium by extending the result of Benaim and Weibull [2003] on deterministic approximations for stochastic dynamics to the case of discontinuous dynamics - such as the best-reply dynamics.