Adjusting receiver operating characteristic curves and related indices for covariates
Abstract
Summary. Continuous markers are often used to discriminate between diseased and healthy populations. In this context, the receiver operating characteristic (ROC) curve is a popular graphical visualization of the discriminatory effectiveness of the marker. Several indices which summarize the discriminatory power of the marker are used, the most common being the area under the ROC curve and the Youden index. We examine covariate effects on these indices, assuming that the marker, possibly transformed, follows the normal distribution. The ROC curve adjusted for covariates is estimated and approximate adjusted confidence intervals for the area under the ROC curve are provided. Further, we investigate bootstrap confidence intervals for both the Youden index and the corresponding critical threshold value, both adjusted for covariates. We motivate this methodology with an example of fingerstick post‐prandial blood glucose as a marker for diabetes patients where age is known to be an important covariate for this marker, and we examine how age influences the discriminatory power of the marker.
Citing Literature
Number of times cited according to CrossRef: 15
- Seungbong Han, Adin-Cristian Andrei, Kam-Wah Tsui, Sung-Cheol Yun, Jong Ho Yoon, ROC analysis using covariate balancing propensity scores with an application to biochemical predictors for thyroid cancer, Communications in Statistics - Simulation and Computation, 10.1080/03610918.2019.1652317, (1-17), (2019).
- QingZhao Zhang, XiaoGang Duan, XiaoHua Zhou, A weighted Wilcoxon estimate for the covariate-specific ROC curve, Science China Mathematics, 10.1007/s11425-015-0158-0, 60, 9, (1705-1716), (2017).
- Motoki OE, Yoshimichi OCHI, Masashi GOTO, Semi-parametric Approach for Estimating Smoothing Receiver Operating Characteristic Curves with Covariates共変量を伴う平滑化ROC曲線のセミ・パラメトリック推測, Kodo Keiryogaku (The Japanese Journal of Behaviormetrics), 10.2333/jbhmk.44.167, 44, 2, (167-179), (2017).
- R. Burrows, P. Correa-Burrows, M. Reyes, E. Blanco, C. Albala, S. Gahagan, Healthy Chilean Adolescents with HOMA-IR ≥ 2.6 Have Increased Cardiometabolic Risk: Association with Genetic, Biological, and Environmental Factors , Journal of Diabetes Research, 10.1155/2015/783296, 2015, (1-8), (2015).
- Haochuan Zhou, Gengsheng Qin, Nonparametric Covariate Adjustment for the Youden Index, Applied Statistics in Biomedicine and Clinical Trials Design, 10.1007/978-3-319-12694-4_7, (109-132), (2015).
- Maria Filipa Mourão, Ana C. Braga, Alexandra Almeida, Gabriela Mimoso, Pedro Nuno Oliveira, Adjusting Covariates in CRIB Score Index Using ROC Regression Analysis, Computational Science and Its Applications -- ICCSA 2015, 10.1007/978-3-319-21407-8_12, (157-171), (2015).
- Maria Filipa Mourão, Ana Cristina Braga, Pedro Nuno Oliveira, CRIB conditional on gender: nonparametric ROC curve, International Journal of Health Care Quality Assurance, 10.1108/IJHCQA-04-2013-0047, 27, 8, (656-663), (2014).
- Maria Filipa Mourão, Ana C. Braga, Pedro Nuno Oliveira, Accommodating Maternal Age in CRIB Scale: Quantifying the Effect on the Classification, Computational Science and Its Applications – ICCSA 2014, 10.1007/978-3-319-09150-1_41, (566-579), (2014).
- X. Duan, X.-H. Zhou, Composite quantile regression for the receiver operating characteristic curve, Biometrika, 10.1093/biomet/ast025, 100, 4, (889-900), (2013).
- Margaret Sullivan Pepe, Jing Fan, Christopher W. Seymour, Estimating the Receiver Operating Characteristic Curve in Studies That Match Controls to Cases on Covariates, Academic Radiology, 10.1016/j.acra.2013.03.004, 20, 7, (863-873), (2013).
- Johan Lim, Woojoo Lee, Sin-Ho Jung, Kyeong Eun Lee, Sung-Cheol Yun, A Regression Model for the AUC of Clustered Ordinal Test Results and Working Independent Optimal Weights, Communications in Statistics - Simulation and Computation, 10.1080/03610918.2011.600501, 41, 8, (1397-1410), (2012).
- David R. Parker, Steven C. Gustafson, Mark E. Oxley, Timothy D. Ross, Development of a Bayesian Framework for Determining Uncertainty in Receiver Operating Characteristic Curve Estimates, IEEE Transactions on Knowledge and Data Engineering, 10.1109/TKDE.2009.50, 22, 1, (31-45), (2010).
- Vinod B. Patel, Ravesh Singh, Cathy Connolly, Yacoob Coovadia, Abdool K. C. Peer, Priyashini Parag, Victoria Kasprowicz, Alimuddin Zumla, Thumbi Ndung'u, Keertan Dheda, Cerebrospinal T-Cell Responses Aid in the Diagnosis of Tuberculous Meningitis in a Human Immunodeficiency Virus– and Tuberculosis-Endemic Population, American Journal of Respiratory and Critical Care Medicine, 10.1164/rccm.200912-1931OC, 182, 4, (569-577), (2010).
- C.L. Vandeleur, S. Rothen, N. Jeanprêtre, Y. Lustenberger, F. Gamma, E. Ayer, F. Ferrero, A. Fleischmann, J. Besson, F. Sisbane, M. Preisig, Inter-informant agreement and prevalence estimates for substance use disorders: Direct interview versus family history method, Drug and Alcohol Dependence, 10.1016/j.drugalcdep.2007.05.023, 92, 1-3, (9-19), (2008).
- Neil J. Perkins, Enrique F. Schisterman, The Inconsistency of “Optimal” Cutpoints Obtained using Two Criteria based on the Receiver Operating Characteristic Curve, American Journal of Epidemiology, 10.1093/aje/kwj063, 163, 7, (670-675), (2006).




