The false discovery rate (FDR, Benjamini and Hochberg 1995) is a powerful approach to multiple testing. However, the original approach developed by Benjamini and Hochberg (1995) applies only to independent tests. Yekutieli (2008) showed that a modification of the Benjamini-Hochberg (BH) approach...

Standard tests designed to identify mutual funds with non-zero alphas are problematic, in that they do not adequately account for the presence of lucky funds. Lucky funds have significant estimated alphas, while their true alphas are equal to zero. To address this issue, this paper quantifies...

This paper considers the problem of testing s null hypotheses simultaneously while controlling the false discovery rate (FDR). Benjamini and Hochberg (1995) provide a method for controlling the FDR based on p-values for each of the null hypotheses under the assumption that the p-values are...

It is common in econometric applications that several hypothesis tests are carried out at the same time. The problem then becomes how to decide which hypotheses to reject, accounting for the multitude of tests. The classical approach is to control the familywise error rate (FWE), that is, the...

Standard tests designed to identify mutual funds with non-zero alphas are problematic, in that they do not adequately account for the presence of lucky funds. Lucky funds have significant estimated alphas, while their true alphas are equal to zero. To address this issue, this paper quantifies...

A fundamental task in the analysis of data sets with many variables is screening for associations. This can be cast as a multiple testing task, where the objective is achieving high detection power while controlling type I error. We consider m hypothesis tests represented by pairs...

Microarrays enable to measure the expression levels of tens of thousands of genes simultaneously. One important statistical question in such experiments is which of the several thousand genes are differentially expressed. Answering this question requires methods that can deal with multiple...

Cawley et al. (2004) have recently mapped the locations of binding sites for three transcription factors along human chromosomes 21 and 22 using ChIP-Chip experiments. ChIP-Chip experiments are a new approach to the genome-wide identification of transcription factor binding sites and consist of...

The accompanying articles by Dudoit et al. (2003b) and van der Laan et al. (2003) provide single-step and step-down resampling-based multiple testing procedures that asymptotically control the family-wise error rate (FWER) for general null hypotheses and test statistics. The proposed procedures...

A brief review is given of procedures for the collective analysis of a large number of significance tests. A simple procedure previously supplied for isolating 'real' effects on the basis of a large number of significance tests is generalized to deal with two-sided tests and is also related more...