We develop a martingale-based decomposition for a general class of quadratic forms of Markov chains, which resembles the well-known Hoeffding decomposition of U-statistics of i.i.d. data up to a reminder term. To illustrate the applicability of our results, we discuss how this decomposition may...