TY - JOUR
T1 - False discovery rates for spatial signals
AU - Benjamini, Yoav
AU - Heller, Ruth
N1 - Funding Information:
Yoav Benjamini is Professor, Department of Statistics and Operations Research, Tel Aviv University, Tel Aviv 29978, Israel (E-mail: [email protected]. ac.il). Ruth Heller is Mark O. Winkelman Distinguished Scholar in Residence Department of Statistics, University of Pennsylvania (E-mail: ruheller@ wharton.upenn.edu). The research was done as part of Ruth Heller’s PhD thesis while being at Tel Aviv University. The authors thank Nava Rubin for engaging in useful discussions of the fMRI example that motivated this study and for supplying the fMRI data, and Felix Abramovich for valuable comments. This study was supported by a grant from the Adams Super Center for Brain Studies, Tel Aviv University.
PY - 2007/12
Y1 - 2007/12
N2 - The problem of multiple testing for the presence of signal in spatial data can involve numerous locations. Traditionally, each location is tested separately for signal presence, but then the findings are reported in terms of clusters of nearby locations. This is an indication that the units of interest for testing are clusters rather than individual locations. The investigator may know a priori these more natural units or an approximation to them. We suggest testing these cluster units rather than individual locations, thus increasing the signal-to-noise ratio within the unit tested as well as reducing the number of hypothesis tests conducted. Because the signal may be absent from part of each cluster, we define a cluster as containing a signal if the signal is present somewhere within the cluster. We suggest controlling the false discovery rate (FDR) on clusters (i.e., the expected proportion of clusters rejected erroneously out of all clusters rejected) or its extension to general weights (WFDR). We introduce a powerful two-stage testing procedure and show that it controls the WFDR. Once the cluster discoveries have been made, we suggest "cleaning" locations in which the signal is absent. For this purpose, we develop a hierarchical testing procedure that first tests clusters, then tests locations within rejected clusters. We show formally that this procedure controls the desired location error rate asymptotically, and conjecture that this is also so for realistic settings by extensive simulations. We discuss an application to functional neuroimaging that motivated this research and demonstrate the advantages of the proposed methodology on an example.
AB - The problem of multiple testing for the presence of signal in spatial data can involve numerous locations. Traditionally, each location is tested separately for signal presence, but then the findings are reported in terms of clusters of nearby locations. This is an indication that the units of interest for testing are clusters rather than individual locations. The investigator may know a priori these more natural units or an approximation to them. We suggest testing these cluster units rather than individual locations, thus increasing the signal-to-noise ratio within the unit tested as well as reducing the number of hypothesis tests conducted. Because the signal may be absent from part of each cluster, we define a cluster as containing a signal if the signal is present somewhere within the cluster. We suggest controlling the false discovery rate (FDR) on clusters (i.e., the expected proportion of clusters rejected erroneously out of all clusters rejected) or its extension to general weights (WFDR). We introduce a powerful two-stage testing procedure and show that it controls the WFDR. Once the cluster discoveries have been made, we suggest "cleaning" locations in which the signal is absent. For this purpose, we develop a hierarchical testing procedure that first tests clusters, then tests locations within rejected clusters. We show formally that this procedure controls the desired location error rate asymptotically, and conjecture that this is also so for realistic settings by extensive simulations. We discuss an application to functional neuroimaging that motivated this research and demonstrate the advantages of the proposed methodology on an example.
KW - Functional magnetic resonance imaging
KW - Hierarchical testing
KW - Multiple testing
KW - Signal detection
KW - Weighted testing procedures
UR - http://www.scopus.com/inward/record.url?scp=38349022394&partnerID=8YFLogxK
U2 - 10.1198/016214507000000941
DO - 10.1198/016214507000000941
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:38349022394
SN - 0162-1459
VL - 102
SP - 1272
EP - 1281
JO - Journal of the American Statistical Association
JF - Journal of the American Statistical Association
IS - 480
ER -