Many definitions in matrix algebra are not standardized. This notediscusses some of thepitfalls associated with undesirable orwrong definitions, anddealswith central conceptslikesymmetry, orthogonality, square root, Hermitian and quadratic forms, and matrix derivatives.