Methodological issues in assessing training effectiveness

The basic aim of any training intervention is to effect some form of change. In assessing change that occurs after a period of training, researchers may tap one or all of three conceptually different kinds of change: alpha, beta and gamma. In alpha change, the participant′s report of change is unbiased between time one and time two (the pre – and post‐ratings) because it is based on an instrument that has been continuously calibrated. Beta change refers to an apparent change where the measuring instrument has been recalibrated by the participant during the measurement intervals, that is, individual perceptions of the response scale have changed. Gamma change refers to a situation where the participant redefines or reconceptualizes some other relevant information. Although pre‐test, post‐test evaluation designs continue to be used, the problems of beta and gamma change are apparent in the majority of experimental interventions looking at individual change using self‐report pretest and post‐test ratings. Discusses alternative ways of avoiding the problems which might result from beta and/or gamma change.