We consider a permutation method for testing whether observations given in their natural pairing exhibit an unusual level of similarity in situations where any two observations may be similar at some unknown baseline level. Under a null hypothesis where there is no distinguished pairing of the observations, a normal approximation, with explicit bounds and rates, is presented for determining approximate critical test levels.