We present a novel, off-line approach for evaluating incident detection algorithms. Previous evaluations have focused on determining the detection rate versus false alarm rate curve -- a process which we argue is inherently fraught with difficulties. Instead, we propose a cost-benefit analysis...