Volume 60, Issue 2

Triple‐goal estimates in two‐stage hierarchical models

Wei Shen

Eli Lilly and Company, Indianapolis, USA,

Search for more papers by this author
Thomas A. Louis

University of Minnesota, Minneapolis, USA

Search for more papers by this author
First published: 06 January 2002
Citations: 49
Thomas A. Louis Division of Biostatistics, School of Public Health, University of Minnesota, 420 Delaware Street, Box 303, Minneapolis, MN 55455, USA. E-mail address: tom@biostat.umn.edu

Abstract

The beauty of the Bayesian approach is its ability to structure complicated models, inferential goals and analyses. To take full advantage of it, methods should be linked to an inferential goal via a loss function. For example, in the two‐stage, compound sampling model the posterior means are optimal under squared error loss. However, they can perform poorly in estimating the histogram of the parameters or in ranking them. ‘Triple‐goal’ estimates are motivated by the desire to have a set of estimates that produce good ranks, a good parameter histogram and good co‐ordinate‐specific estimates. No set of estimates can simultaneously optimize these three goals and we seek a set that strikes an effective trade‐off. We evaluate and compare three candidate approaches: the posterior means, the constrained Bayes estimates of Louis and Ghosh, and a new approach that optimizes estimation of the histogram and the ranks. Mathematical and simulation‐based analyses support the superiority of the new approach and document its excellent performance for the three inferential goals.

Number of times cited according to CrossRef: 49

  • Randomized Experiments in Education, with Implications for Multilevel Causal Inference, Annual Review of Statistics and Its Application, 10.1146/annurev-statistics-031219-041205, 7, 1, (177-208), (2020).
  • A joint confidence region for an overall ranking of populations, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/rssc.12402, 69, 3, (589-606), (2020).
  • Performance assessment as an application of causal inference, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/rssa.12529, 183, 4, (1363-1385), (2019).
  • An empirical Bayesian ranking method, with applications to high throughput biology, Bioinformatics, 10.1093/bioinformatics/btz471, (2019).
  • From start to finish: a framework for the production of small area official statistics, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/rssa.12364, 181, 4, (927-979), (2018).
  • Using the multivariate spatio-temporal Bayesian model to analyze traffic crashes by severity, Analytic Methods in Accident Research, 10.1016/j.amar.2018.02.001, 17, (14-31), (2018).
  • Flexible Bayesian Models for Inferences From Coarsened, Group-Level Achievement Data, Journal of Educational and Behavioral Statistics, 10.3102/1076998618795124, 43, 6, (663-692), (2018).
  • Loss function-based evaluation of physician report cards, Health Services and Outcomes Research Methodology, 10.1007/s10742-018-0179-2, 18, 2, (96-108), (2018).
  • A Comparison of Hierarchical Bayesian Models for Small Area Estimation of Counts, Open Journal of Statistics, 10.4236/ojs.2017.73036, 07, 03, (521-550), (2017).
  • Defining Program Effects: A Distribution-Based Perspective, Statistics and Public Policy, 10.1080/2330443X.2017.1369914, 4, 1, (1-10), (2017).
  • Variation in Hospital Risk–Adjusted Mortality Rates Following Transcatheter Aortic Valve Replacement in the United States, Circulation: Cardiovascular Quality and Outcomes, 10.1161/CIRCOUTCOMES.116.002756, 9, 5, (560-565), (2016).
  • Decision Theory Applied to Selecting the Winners, Ranking, and Classification, Journal of Educational and Behavioral Statistics, 10.3102/1076998616644991, 41, 4, (420-442), (2016).
  • League Tables for Hospital Comparisons, Annual Review of Statistics and Its Application, 10.1146/annurev-statistics-022513-115617, 3, 1, (21-50), (2016).
  • Uncertainty in Rank Estimation: Implications for Value-Added Modeling Accountability Systems, Journal of Educational and Behavioral Statistics, 10.3102/10769986027003255, 27, 3, (255-270), (2016).
  • Making the cut: improved ranking and selection for large‐scale inference, Journal of the Royal Statistical Society: Series B (Statistical Methodology), 10.1111/rssb.12131, 78, 4, (781-804), (2015).
  • Modeling Effects of Canopy and Roots on Soil Moisture and Deep Drainage, Vadose Zone Journal, 10.2136/vzj2014.09.0131, 14, 2, (1-18), (2015).
  • Modeling Heterogeneous Variance–Covariance Components in Two-Level Models, Journal of Educational and Behavioral Statistics, 10.3102/1076998614546494, 39, 5, (307-332), (2014).
  • Small-Area Estimation, Statistical Decision Theory, 10.1007/978-3-642-40433-7_7, (95-109), (2013).
  • Measuring Test Measurement Error, Journal of Educational and Behavioral Statistics, 10.3102/1076998613508584, 38, 6, (629-663), (2013).
  • Hierarchical Rank Aggregation with Applications to Nanotoxicology, Journal of Agricultural, Biological, and Environmental Statistics, 10.1007/s13253-013-0129-y, 18, 2, (159-177), (2013).
  • Moment adjusted imputation for multivariate measurement error data with applications to logistic regression, Computational Statistics & Data Analysis, 10.1016/j.csda.2013.04.017, 67, (15-24), (2013).
  • Geographical Distribution and Surveillance of Tuberculosis (TB) Using Spatial Statistics, International Journal of Applied Geospatial Research, 10.4018/jagr.2013040103, 4, 2, (39-53), (2013).
  • Classification loss function for parameter ensembles in Bayesian hierarchical models, Statistics & Probability Letters, 10.1016/j.spl.2011.12.015, 82, 4, (859-863), (2012).
  • Assessing community variation and randomness in public health indicators, Population Health Metrics, 10.1186/1478-7954-9-3, 9, 1, (2011).
  • Percentile‐based empirical distribution function estimates for performance evaluation of healthcare providers, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/j.1467-9876.2010.00760.x, 60, 4, (575-589), (2011).
  • Robust linear mixed models for Small Area Estimation, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2009.07.022, 140, 2, (433-443), (2010).
  • References, Applied Bayesian Hierarchical Methods, 10.1201/9781584887218, (495-500), (2010).
  • A Bayesian Approach to Ranking and Rater Evaluation, Journal of Educational and Behavioral Statistics, 10.3102/1076998609353116, 35, 2, (194-214), (2010).
  • Bayesian ranking and selection methods using hierarchical mixture models in microarray studies, Biostatistics, 10.1093/biostatistics/kxp047, 11, 2, (281-289), (2009).
  • Comparing and ranking hospitals based on outcome: results from The Netherlands Stroke Survey, QJM, 10.1093/qjmed/hcp169, 103, 2, (99-108), (2009).
  • Racial disparities in risks of mortality in a sample of the US Medicare population, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/j.1467-9876.2009.00691.x, 59, 2, (319-339), (2009).
  • References, Handbook of Statistics - Sample Surveys: Inference and Analysis, 10.1016/S0169-7161(09)70062-8, (559-594), (2009).
  • Confidence Intervals for Population Ranks in the Presence of Ties and Near Ties, Journal of the American Statistical Association, 10.1198/jasa.2009.0142, 104, 486, (775-788), (2009).
  • A comparison of methods for estimating the random effects distribution of a linear mixed model, Statistical Methods in Medical Research, 10.1177/0962280208091686, 19, 6, (575-600), (2008).
  • Ranking USRDS provider specific SMRs from 1998–2001, Health Services and Outcomes Research Methodology, 10.1007/s10742-008-0040-0, 9, 1, (22-38), (2008).
  • Market Share Constraints and the Loss Function in Choice-Based Conjoint Analysis, Marketing Science, 10.1287/mksc.1080.0369, 27, 6, (995-1011), (2008).
  • Flexible distributions for triple-goal estimates in two-stage hierarchical models, Computational Statistics & Data Analysis, 10.1016/j.csda.2005.05.008, 50, 11, (3243-3262), (2006).
  • Variations in Hospice Use Among Cancer Patients, JNCI: Journal of the National Cancer Institute, 10.1093/jnci/djj298, 98, 15, (1053-1059), (2006).
  • Comparing clinical data with administrative data for producing acute myocardial infarction report cards, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/j.1467-985X.2005.00380.x, 169, 1, (115-126), (2005).
  • Frailty Survival Model Analysis of the National Deceased Donor Kidney Transplant Dataset Using Poisson Variance Structures, Journal of the American Statistical Association, 10.1198/016214505000000123, 100, 471, (728-735), (2005).
  • Bayesian ranking of sites for engineering safety improvements: Decision parameter, treatability concept, statistical criterion, and spatial dependence, Accident Analysis & Prevention, 10.1016/j.aap.2005.03.012, 37, 4, (699-720), (2005).
  • Missing data and small area estimation in the UK Labour Force Survey, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1046/j.1467-985X.2003.00728.x, 167, 2, (341-373), (2004).
  • Interpreting Posterior Relative Risk Estimates in Disease-Mapping Studies, Environmental Health Perspectives, 10.1289/ehp.6740, 112, 9, (1016-1025), (2004).
  • Analysis of Multivariate Longitudinal Outcomes With Nonignorable Dropouts and Missing Covariates, Journal of the American Statistical Association, 10.1198/016214502753479211, 97, 457, (40-52), (2002).
  • Bayes/EB Ranking, Histogram and Parameter Estimation: Issues and Research Agenda, Empirical Bayes and Likelihood Inference, 10.1007/978-1-4613-0141-7_1, (1-16), (2001).
  • Discussion, The American Statistician, 10.1080/00031305.1999.10474458, 53, 3, (196-198), (1999).
  • Prediction of Spatial Cumulative Distribution Functions Using Subsampling, Journal of the American Statistical Association, 10.1080/01621459.1999.10473821, 94, 445, (86-97), (1999).
  • Bayesian Data Mining in Large Frequency Tables, with an Application to the FDA Spontaneous Reporting System, The American Statistician, 10.1080/00031305.1999.10474456, 53, 3, (177-190), (1999).
  • Empirical Bayes Estimation via the Smoothing by Roughening Approach, Journal of Computational and Graphical Statistics, 10.1080/10618600.1999.10474850, 8, 4, (800-823), (1999).