The False Strategy theorem tells us that the optimal outcome of an unknown number of historical simulations is right-unbounded — with enough trials, there is no Sharpe ratio sufficiently enough to reject the hypothesis that a strategy is false. Given the ease with which one can use a computer...

We introduce two online backtest overfitting tools: BODT simulates the overfitting of seasonal strategies (typical of technical analysis), and TMST simulates the overfitting of econometric strategies (typical of academic journals). We show that econometric methods lend themselves to extreme...