I derive the finite-sample bias of the conditional Gaussian maximum likelihood estimator in ARMA models when the error follows some unknown non-normal distribution. The general procedure relies on writing down the score function and its higher order derivative matrices in terms of quadratic...