Discovering findings that replicate from a primary study of high dimension to a follow-up study

Marina Bogomolov, Ruth Heller

Research output: Contribution to journalArticlepeer-review

20 Scopus citations

Abstract

We consider the problem of identifying whether findings replicate from one study of high dimension to another, when the primary study guides the selection of hypotheses to be examined in the follow-up study as well as when there is no division of roles into the primary and the follow-up study. We show that existing meta-analysis methods are not appropriate for this problem, and suggest novel methods instead. We prove that our multiple testing procedures control for appropriate error rates. The suggested family-wise error rate controlling procedure is valid for arbitrary dependence among the test statistics within each study. A more powerful procedure is suggested for false discovery rate (FDR) control.We prove that this procedure controls the FDR if the test statistics are independent within the primary study, and independent or have positive dependence in the follow-up study. For arbitrary dependence within the primary study, and either arbitrary dependence or positive dependence in the follow-up study, simple conservative modifications of the procedure control the FDR. We demonstrate the usefulness of these procedures via simulations and real data examples. Supplementary materials for this article are available online.

Original languageEnglish
Pages (from-to)1480-1492
Number of pages13
JournalJournal of the American Statistical Association
Volume108
Issue number504
DOIs
StatePublished - 2013

Funding

FundersFunder number
Seventh Framework Programme294519
Israel Science Foundation

    Keywords

    • False discovery rate
    • Genome-wide association studies
    • Meta-analysis
    • Multiple comparisons
    • Replicability analysis

    Fingerprint

    Dive into the research topics of 'Discovering findings that replicate from a primary study of high dimension to a follow-up study'. Together they form a unique fingerprint.

    Cite this