Triple‐goal estimates in two‐stage hierarchical models
Abstract
The beauty of the Bayesian approach is its ability to structure complicated models, inferential goals and analyses. To take full advantage of it, methods should be linked to an inferential goal via a loss function. For example, in the two‐stage, compound sampling model the posterior means are optimal under squared error loss. However, they can perform poorly in estimating the histogram of the parameters or in ranking them. ‘Triple‐goal’ estimates are motivated by the desire to have a set of estimates that produce good ranks, a good parameter histogram and good co‐ordinate‐specific estimates. No set of estimates can simultaneously optimize these three goals and we seek a set that strikes an effective trade‐off. We evaluate and compare three candidate approaches: the posterior means, the constrained Bayes estimates of Louis and Ghosh, and a new approach that optimizes estimation of the histogram and the ranks. Mathematical and simulation‐based analyses support the superiority of the new approach and document its excellent performance for the three inferential goals.
Citing Literature
Number of times cited according to CrossRef: 49
- Stephen W. Raudenbush, Daniel Schwartz, Randomized Experiments in Education, with Implications for Multilevel Causal Inference, Annual Review of Statistics and Its Application, 10.1146/annurev-statistics-031219-041205, 7, 1, (177-208), (2020).
- Martin Klein, Tommy Wright, Jerzy Wieczorek, A joint confidence region for an overall ranking of populations, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/rssc.12402, 69, 3, (589-606), (2020).
- Nicholas T. Longford, Performance assessment as an application of causal inference, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/rssa.12529, 183, 4, (1363-1385), (2019).
- John Ferguson, Joseph Chang, An empirical Bayesian ranking method, with applications to high throughput biology, Bioinformatics, 10.1093/bioinformatics/btz471, (2019).
- Nikos Tzavidis, Li‐Chun Zhang, Angela Luna, Timo Schmid, Natalia Rojas‐Perilla, From start to finish: a framework for the production of small area official statistics, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/rssa.12364, 181, 4, (927-979), (2018).
- Chenhui Liu, Anuj Sharma, Using the multivariate spatio-temporal Bayesian model to analyze traffic crashes by severity, Analytic Methods in Accident Research, 10.1016/j.amar.2018.02.001, 17, (14-31), (2018).
- J. R. Lockwood, Katherine E. Castellano, Benjamin R. Shear, Flexible Bayesian Models for Inferences From Coarsened, Group-Level Achievement Data, Journal of Educational and Behavioral Statistics, 10.3102/1076998618795124, 43, 6, (663-692), (2018).
- Fernando Hoces de la Guardia, Jessica Hwang, John L. Adams, Susan M. Paddock, Loss function-based evaluation of physician report cards, Health Services and Outcomes Research Methodology, 10.1007/s10742-018-0179-2, 18, 2, (96-108), (2018).
- Matilde Trevisani, Nicola Torelli, A Comparison of Hierarchical Bayesian Models for Small Area Estimation of Counts, Open Journal of Statistics, 10.4236/ojs.2017.73036, 07, 03, (521-550), (2017).
- Jennifer L. Green, Walter W. Stroup, Pamela S. Fellers, Defining Program Effects: A Distribution-Based Perspective, Statistics and Public Policy, 10.1080/2330443X.2017.1369914, 4, 1, (1-10), (2017).
- Sean M. O’Brien, David J. Cohen, John S. Rumsfeld, J. Matthew Brennan, David M. Shahian, David Dai, David R. Holmes, Rosemarie B. Hakim, Vinod H. Thourani, Eric D. Peterson, Fred H. Edwards, Variation in Hospital Risk–Adjusted Mortality Rates Following Transcatheter Aortic Valve Replacement in the United States, Circulation: Cardiovascular Quality and Outcomes, 10.1161/CIRCOUTCOMES.116.002756, 9, 5, (560-565), (2016).
- Nicholas Tibor Longford, Decision Theory Applied to Selecting the Winners, Ranking, and Classification, Journal of Educational and Behavioral Statistics, 10.3102/1076998616644991, 41, 4, (420-442), (2016).
- Sharon-Lise T. Normand, Arlene S. Ash, Stephen E. Fienberg, Thérèse A. Stukel, Jessica Utts, Thomas A. Louis, League Tables for Hospital Comparisons, Annual Review of Statistics and Its Application, 10.1146/annurev-statistics-022513-115617, 3, 1, (21-50), (2016).
- J.R. Lockwood, Thomas A. Louis, Daniel F. McCaffrey, Uncertainty in Rank Estimation: Implications for Value-Added Modeling Accountability Systems, Journal of Educational and Behavioral Statistics, 10.3102/10769986027003255, 27, 3, (255-270), (2016).
- Nicholas C. Henderson, Michael A. Newton, Making the cut: improved ranking and selection for large‐scale inference, Journal of the Royal Statistical Society: Series B (Statistical Methodology), 10.1111/rssb.12131, 78, 4, (781-804), (2015).
- Junliang Fan, Thomas Baumgartl, Alexander Scheuermann, David A. Lockington, Modeling Effects of Canopy and Roots on Soil Moisture and Deep Drainage, Vadose Zone Journal, 10.2136/vzj2014.09.0131, 14, 2, (1-18), (2015).
- George Leckie, Robert French, Chris Charlton, William Browne, Modeling Heterogeneous Variance–Covariance Components in Two-Level Models, Journal of Educational and Behavioral Statistics, 10.3102/1076998614546494, 39, 5, (307-332), (2014).
- Nicholas T. Longford, Nicholas T. Longford, Small-Area Estimation, Statistical Decision Theory, 10.1007/978-3-642-40433-7_7, (95-109), (2013).
- Donald Boyd, Hamilton Lankford, Susanna Loeb, James Wyckoff, Measuring Test Measurement Error, Journal of Educational and Behavioral Statistics, 10.3102/1076998613508584, 38, 6, (629-663), (2013).
- Trina Patel, Donatello Telesca, Robert Rallo, Saji George, Tian Xia, André E. Nel, Hierarchical Rank Aggregation with Applications to Nanotoxicology, Journal of Agricultural, Biological, and Environmental Statistics, 10.1007/s13253-013-0129-y, 18, 2, (159-177), (2013).
- Laine Thomas, Leonard A. Stefanski, Marie Davidian, Moment adjusted imputation for multivariate measurement error data with applications to logistic regression, Computational Statistics & Data Analysis, 10.1016/j.csda.2013.04.017, 67, (15-24), (2013).
- Ila Agnihotri, PK Joshi, Neeraj Tiwari, Geographical Distribution and Surveillance of Tuberculosis (TB) Using Spatial Statistics, International Journal of Applied Geospatial Research, 10.4018/jagr.2013040103, 4, 2, (39-53), (2013).
- Cedric E. Ginestet, Nicky G. Best, Sylvia Richardson, Classification loss function for parameter ensembles in Bayesian hierarchical models, Statistics & Probability Letters, 10.1016/j.spl.2011.12.015, 82, 4, (859-863), (2012).
- Stephan Arndt, Laura Acion, Kristin Caspers, Ousmane Diallo, Assessing community variation and randomness in public health indicators, Population Health Metrics, 10.1186/1478-7954-9-3, 9, 1, (2011).
- Susan M. Paddock, Thomas A. Louis, Percentile‐based empirical distribution function estimates for performance evaluation of healthcare providers, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/j.1467-9876.2010.00760.x, 60, 4, (575-589), (2011).
- Enrico Fabrizi, Carlo Trivisano, Robust linear mixed models for Small Area Estimation, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2009.07.022, 140, 2, (433-443), (2010).
- Peter Congdon, References, Applied Bayesian Hierarchical Methods, 10.1201/9781584887218, (495-500), (2010).
- Jing Cao, S. Lynne Stokes, Song Zhang, A Bayesian Approach to Ranking and Rater Evaluation, Journal of Educational and Behavioral Statistics, 10.3102/1076998609353116, 35, 2, (194-214), (2010).
- H. Noma, S. Matsui, T. Omori, T. Sato, Bayesian ranking and selection methods using hierarchical mixture models in microarray studies, Biostatistics, 10.1093/biostatistics/kxp047, 11, 2, (281-289), (2009).
- H.F. Lingsma, E.W. Steyerberg, M.J.C. Eijkemans, D.W.J. Dippel, W.J.M. Scholte Op Reimer, H.C. Van Houwelingen, Comparing and ranking hospitals based on outcome: results from The Netherlands Stroke Survey, QJM, 10.1093/qjmed/hcp169, 103, 2, (99-108), (2009).
- Yijie Zhou, Francesca Dominici, Thomas A. Louis, Racial disparities in risks of mortality in a sample of the US Medicare population, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/j.1467-9876.2009.00691.x, 59, 2, (319-339), (2009).
- References, Handbook of Statistics - Sample Surveys: Inference and Analysis, 10.1016/S0169-7161(09)70062-8, (559-594), (2009).
- Minge Xie, Kesar Singh, Cun-Hui Zhang, Confidence Intervals for Population Ranks in the Presence of Ties and Near Ties, Journal of the American Statistical Association, 10.1198/jasa.2009.0142, 104, 486, (775-788), (2009).
- Wendimagegn Ghidey, Emmanuel Lesaffre, Geert Verbeke, A comparison of methods for estimating the random effects distribution of a linear mixed model, Statistical Methods in Medical Research, 10.1177/0962280208091686, 19, 6, (575-600), (2008).
- Rongheng Lin, Thomas A. Louis, Susan M. Paddock, Greg Ridgeway, Ranking USRDS provider specific SMRs from 1998–2001, Health Services and Outcomes Research Methodology, 10.1007/s10742-008-0040-0, 9, 1, (22-38), (2008).
- Timothy J. Gilbride, Peter J. Lenk, Jeff D. Brazell, Market Share Constraints and the Loss Function in Choice-Based Conjoint Analysis, Marketing Science, 10.1287/mksc.1080.0369, 27, 6, (995-1011), (2008).
- Susan M. Paddock, Greg Ridgeway, Rongheng Lin, Thomas A. Louis, Flexible distributions for triple-goal estimates in two-stage hierarchical models, Computational Statistics & Data Analysis, 10.1016/j.csda.2005.05.008, 50, 11, (3243-3262), (2006).
- Nancy L. Keating, Lisa J. Herrinton, Alan M. Zaslavsky, Liyan Liu, John Z. Ayanian, Variations in Hospice Use Among Cancer Patients, JNCI: Journal of the National Cancer Institute, 10.1093/jnci/djj298, 98, 15, (1053-1059), (2006).
- Peter C. Austin, Jack V. Tu, Comparing clinical data with administrative data for producing acute myocardial infarction report cards, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1111/j.1467-985X.2005.00380.x, 169, 1, (115-126), (2005).
- Shibao Feng, Robert A Wolfe, Friedrich K Port, Frailty Survival Model Analysis of the National Deceased Donor Kidney Transplant Dataset Using Poisson Variance Structures, Journal of the American Statistical Association, 10.1198/016214505000000123, 100, 471, (728-735), (2005).
- Shaw-Pin Miaou, Joon Jin Song, Bayesian ranking of sites for engineering safety improvements: Decision parameter, treatability concept, statistical criterion, and spatial dependence, Accident Analysis & Prevention, 10.1016/j.aap.2005.03.012, 37, 4, (699-720), (2005).
- Nicholas T. Longford, Missing data and small area estimation in the UK Labour Force Survey, Journal of the Royal Statistical Society: Series A (Statistics in Society), 10.1046/j.1467-985X.2003.00728.x, 167, 2, (341-373), (2004).
- Sylvia Richardson, Andrew Thomson, Nicky Best, Paul Elliott, Interpreting Posterior Relative Risk Estimates in Disease-Mapping Studies, Environmental Health Perspectives, 10.1289/ehp.6740, 112, 9, (1016-1025), (2004).
- Jason Roy, Xihong Lin, Analysis of Multivariate Longitudinal Outcomes With Nonignorable Dropouts and Missing Covariates, Journal of the American Statistical Association, 10.1198/016214502753479211, 97, 457, (40-52), (2002).
- T. A. Louis, Bayes/EB Ranking, Histogram and Parameter Estimation: Issues and Research Agenda, Empirical Bayes and Likelihood Inference, 10.1007/978-1-4613-0141-7_1, (1-16), (2001).
- Thomas A. Louis, Wei Shen, Discussion, The American Statistician, 10.1080/00031305.1999.10474458, 53, 3, (196-198), (1999).
- Soumendra N. Lahiri, Mark S. Kaiser, Noel Cressie, Nan-Jung Hsu, Prediction of Spatial Cumulative Distribution Functions Using Subsampling, Journal of the American Statistical Association, 10.1080/01621459.1999.10473821, 94, 445, (86-97), (1999).
- William Dumouchel, Bayesian Data Mining in Large Frequency Tables, with an Application to the FDA Spontaneous Reporting System, The American Statistician, 10.1080/00031305.1999.10474456, 53, 3, (177-190), (1999).
- Wei Shen, Thomas A. Louis, Empirical Bayes Estimation via the Smoothing by Roughening Approach, Journal of Computational and Graphical Statistics, 10.1080/10618600.1999.10474850, 8, 4, (800-823), (1999).




