Empirical bayes estimates for a two-way cross-classified model

Lawrence D. Brown, Gourab Mukherjee, Asaf Weinstein

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

We develop an empirical Bayes procedure for estimating the cell means in an unbalanced, two-way additive model with fixed effects. We employ a hierarchical model, which reflects exchangeability of the effects within treatment and within block but not necessarily between them, as suggested before by Lindley and Smith [J. R. Stat. Soc., B 34 (1972) 1–41]. The hyperparameters of this hierarchical model, instead of considered fixed, are to be substituted with data-dependent values in such a way that the point risk of the empirical Bayes estimator is small. Our method chooses the hyperparameters by minimizing an unbiased risk estimate and is shown to be asymptotically optimal for the estimation problem defined above, under suitable conditions. The usual empirical Best Linear Unbiased Predictor (BLUP) is shown to be substantially different from the proposed method in the unbalanced case and, therefore, performs suboptimally. Our estimator is implemented through a computationally tractable algorithm that is scalable to work under large designs. The case of missing cell observations is treated as well.

Original languageAmerican English
Pages (from-to)1693-1720
Number of pages28
JournalAnnals of Statistics
Volume46
Issue number4
DOIs
StatePublished - Aug 2018
Externally publishedYes

Bibliographical note

Funding Information:
Received May 2016; revised February 2017. 1Supported in part by grant NSF DMS-15-12084. 2Supported in part by the Zumberge individual award from the University of Southern California’s James H. Zumberge faculty research and innovation fund. MSC2010 subject classifications. Primary 62C12; secondary 62C25, 62F10, 62J07. Key words and phrases. Shrinkage estimation, empirical Bayes, two-way ANOVA, oracle optimality, Stein’s unbiased risk estimate (SURE), empirical BLUP.

Funding Information:
1Supported in part by grant NSF DMS-15-12084. 2Supported in part by the Zumberge individual award from the University of Southern California’s James H. Zumberge faculty research and innovation fund. We thank Tony Cai, Samuel Kou and Art Owen for helpful discussions. We would also like to thank the Associate Editor and three referees for constructive suggestions to shorten and improve the paper.

Publisher Copyright:
© Institute of Mathematical Statistics, 2018

Keywords

  • Empirical BLUP
  • Empirical Bayes
  • Oracle optimality
  • Shrinkage estimation
  • Stein’s unbiased risk estimate (SURE)
  • Two-way ANOVA

Fingerprint

Dive into the research topics of 'Empirical bayes estimates for a two-way cross-classified model'. Together they form a unique fingerprint.

Cite this