I derive the finite-sample bias of the conditional Gaussian maximum likelihood estimator in ARMA models when the error follows some unknown nonnormal distribution. The general procedure relies on writing down the score function and its higher-order derivative matrices in terms of quadratic forms...