Volume 76, Issue 2
Original Article

The joint graphical lasso for inverse covariance estimation across multiple classes

Patrick Danaher

University of Washington, Seattle, USA

Search for more papers by this author
Pei Wang

Corresponding Author

Fred Hutchinson Cancer Research Center, Seattle, USA

Address for correspondence: Pei Wang, Public Health Sciences Division, Fred Hutchinson Cancer Research Center, M2‐B230, 1100 Fairview Avenue North, Seattle, WA 98109, USA. E‐mail: pwang@fhcrc.orgSearch for more papers by this author
Daniela M. Witten

University of Washington, Seattle, USA

Search for more papers by this author
First published: 12 August 2013
Citations: 248

Summary

We consider the problem of estimating multiple related Gaussian graphical models from a high dimensional data set with observations belonging to distinct classes. We propose the joint graphical lasso, which borrows strength across the classes to estimate multiple graphical models that share certain characteristics, such as the locations or weights of non‐zero edges. Our approach is based on maximizing a penalized log‐likelihood. We employ generalized fused lasso or group lasso penalties and implement a fast alternating directions method of multipliers algorithm to solve the corresponding convex optimization problems. The performance of the method proposed is illustrated through simulated and real data examples.

Number of times cited according to CrossRef: 248

  • Conditional score matching for high-dimensional partial graphical models, Computational Statistics & Data Analysis, 10.1016/j.csda.2020.107066, 153, (107066), (2021).
  • Estimating Linear and Nonlinear Gene Coexpression Networks by Semiparametric Neighborhood Selection, Genetics, 10.1534/genetics.120.303186, 215, 3, (597-607), (2020).
  • Multi-parameters Model Selection for Network Inference, Complex Networks and Their Applications VIII, 10.1007/978-3-030-36687-2_47, (566-577), (2020).
  • Stabilized Reconstruction of Signaling Networks from Single-Cell Cue-Response Data, Scientific Reports, 10.1038/s41598-019-56444-5, 10, 1, (2020).
  • Multiple and multilevel graphical models, WIREs Computational Statistics , 10.1002/wics.1497, 12, 5, (2020).
  • Joint Bayesian-Incorporating Estimation of Multiple Gaussian Graphical Models to Study Brain Connectivity Development in Adolescence, IEEE Transactions on Medical Imaging, 10.1109/TMI.2019.2926667, 39, 2, (357-365), (2020).
  • Fifty years of semi-dwarf spring wheat breeding at CIMMYT: Grain yield progress in optimum, drought and heat stress environments, Field Crops Research, 10.1016/j.fcr.2020.107757, 250, (107757), (2020).
  • undefined, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 10.1109/ICASSP40776.2020.9054566, (5955-5959), (2020).
  • High-dimensional statistical inference: Theoretical development to data analytics, , 10.1016/bs.host.2020.02.003, (2020).
  • Intellect is not that expensive: differential association of cultural and socio-economic factors with crystallized intelligence in a sample of Italian adolescents, Intelligence, 10.1016/j.intell.2020.101466, 81, (101466), (2020).
  • undefined, 2020 IEEE International Symposium on Information Theory (ISIT), 10.1109/ISIT44484.2020.9174062, (1319-1324), (2020).
  • Joint-Connectivity-Based Sparse Canonical Correlation Analysis of Imaging Genetics for Detecting Biomarkers of Parkinson’s Disease, IEEE Transactions on Medical Imaging, 10.1109/TMI.2019.2918839, 39, 1, (23-34), (2020).
  • Bayesian differential analysis of gene regulatory networks exploiting genetic perturbations, BMC Bioinformatics, 10.1186/s12859-019-3314-3, 21, 1, (2020).
  • Personality, Behavioral strengths and difficulties and performance of adolescents with high achievements in science, literature, art and sports, Personality and Individual Differences, 10.1016/j.paid.2020.109917, 160, (109917), (2020).
  • Differential co-expression analysis reveals early stage transcriptomic decoupling in alzheimer’s disease, BMC Medical Genomics, 10.1186/s12920-020-0689-y, 13, S5, (2020).
  • Joint estimation of heterogeneous exponential Markov Random Fields through an approximate likelihood inference, Journal of Statistical Planning and Inference, 10.1016/j.jspi.2020.04.003, (2020).
  • Typecasting Of Microarray Data Using Machine Learning Algorithms, Procedia Computer Science, 10.1016/j.procs.2020.04.279, 171, (2572-2580), (2020).
  • Inferring Two-Level Hierarchical Gaussian Graphical Models to Discover Shared and Context-Specific Conditional Dependencies from High-Dimensional Heterogeneous Data, SN Computer Science, 10.1007/s42979-020-00224-w, 1, 4, (2020).
  • GraphNet-based imaging biomarker model to explain levodopa-induced dyskinesia in Parkinson's disease, Computer Methods and Programs in Biomedicine, 10.1016/j.cmpb.2020.105713, (105713), (2020).
  • On the Sample Complexity of Graphical Model Selection From Non-Stationary Samples, IEEE Transactions on Signal Processing, 10.1109/TSP.2019.2956687, 68, (17-32), (2020).
  • Updating of the Gaussian graphical model through targeted penalized estimation, Journal of Multivariate Analysis, 10.1016/j.jmva.2020.104621, (104621), (2020).
  • A Proximal Point Dual Newton Algorithm for Solving Group Graphical Lasso Problems, SIAM Journal on Optimization, 10.1137/19M1267830, 30, 3, (2197-2220), (2020).
  • Joint estimation of multiple mixed graphical models for pan‐cancer network analysis, Stat, 10.1002/sta4.271, 9, 1, (2020).
  • Deviance Tests for Graph Estimation From Multi-Attribute Gaussian Data, IEEE Transactions on Signal Processing, 10.1109/TSP.2020.3023575, 68, (1-16), (2020).
  • Cross-cultural generalizability of the ICD-11 PGD symptom network: Identification of central symptoms and culturally specific items across German-speaking and Chinese bereaved, Comprehensive Psychiatry, 10.1016/j.comppsych.2020.152211, (152211), (2020).
  • Joint learning of multiple gene networks from single-cell gene expression data, Computational and Structural Biotechnology Journal, 10.1016/j.csbj.2020.09.004, 18, (2583-2595), (2020).
  • Alternative DSM-5 Model for Personality Disorders Through the Lens of an Empirical Network Model , Assessment, 10.1177/1073191119897118, (107319111989711), (2020).
  • Joint reconstruction of multiple gene networks by simultaneously capturing inter-tumor and intra-tumor heterogeneity, Bioinformatics, 10.1093/bioinformatics/btaa014, (2020).
  • Doubly functional graphical models in high dimensions, Biometrika, 10.1093/biomet/asz072, (2020).
  • Bayesian modeling of multiple structural connectivity networks during the progression of Alzheimer's disease, Biometrics, 10.1111/biom.13235, 0, 0, (2020).
  • The Network Constellation of Personality and Substance Use: Evolution from Early to Late Adolescence, European Journal of Personality, 10.1002/per.2245, 0, 0, (2020).
  • Differential network analysis: A statistical perspective, WIREs Computational Statistics , 10.1002/wics.1508, 0, 0, (2020).
  • Estimation and inference for the indirect effect in high-dimensional linear mediation models, Biometrika, 10.1093/biomet/asaa016, (2020).
  • Joint reconstruction of cis-regulatory interaction networks across multiple tissues using single-cell chromatin accessibility data, Briefings in Bioinformatics, 10.1093/bib/bbaa120, (2020).
  • Network Analyses of Maternal Pre- and Post-Partum Symptoms of Depression and Anxiety, Frontiers in Psychiatry, 10.3389/fpsyt.2020.00785, 11, (2020).
  • A random covariance model for bi‐level graphical modeling with application to resting‐state fMRI data, Biometrics, 10.1111/biom.13364, 0, 0, (2020).
  • A Network Analysis of Global Trust Across 11 Democratic Countries, International Journal of Public Opinion Research, 10.1093/ijpor/edaa002, (2020).
  • The network structure of core depressive symptom-domains in major depressive disorder following antidepressant treatment: a randomized clinical trial, Psychological Medicine, 10.1017/S0033291720001002, (1-15), (2020).
  • A shrinkage approach to joint estimation of multiple covariance matrices, Metrika, 10.1007/s00184-020-00781-3, (2020).
  • Analysis of Twitter data with the Bayesian fused graphical lasso, PLOS ONE, 10.1371/journal.pone.0235596, 15, 7, (e0235596), (2020).
  • Factors Influencing Consumers’ Intention to Adopt Fashion Robot Advisors: Psychological Network Analysis, Clothing and Textiles Research Journal, 10.1177/0887302X20941261, (0887302X2094126), (2020).
  • Bayesian Joint Modeling of Multiple Brain Functional Networks, Journal of the American Statistical Association, 10.1080/01621459.2020.1796357, (1-13), (2020).
  • Testing Differential Gene Networks under Nonparanormal Graphical Models with False Discovery Rate Control, Genes, 10.3390/genes11020167, 11, 2, (167), (2020).
  • Joint Estimation of the Two-Level Gaussian Graphical Models Across Multiple Classes, Journal of Computational and Graphical Statistics, 10.1080/10618600.2019.1694522, (1-18), (2020).
  • Integrating approximate single factor graphical models, Statistics in Medicine, 10.1002/sim.8408, 39, 2, (146-155), (2019).
  • Identifying disease‐associated biomarker network features through conditional graphical model, Biometrics, 10.1111/biom.13201, 76, 3, (995-1006), (2019).
  • A Cross‐Cultural Comparison of ICD‐11 Complex Posttraumatic Stress Disorder Symptom Networks in Austria, the United Kingdom, and Lithuania, Journal of Traumatic Stress, 10.1002/jts.22361, 33, 1, (41-51), (2019).
  • Zoom‐in–out joint graphical lasso for different coarseness scales, Journal of the Royal Statistical Society: Series C (Applied Statistics), 10.1111/rssc.12378, 69, 1, (47-67), (2019).
  • MDiNE: a model to estimate differential co-occurrence networks in microbiome studies, Bioinformatics, 10.1093/bioinformatics/btz824, 36, 6, (1840-1847), (2019).
  • Direct estimation of differential networks under high‐dimensional nonparanormal graphical models, Canadian Journal of Statistics, 10.1002/cjs.11526, 48, 2, (187-203), (2019).
  • Enantioselective Total Synthesis of Cymoside through a Bioinspired Oxidative Cyclization of a Strictosidine Derivative, Angewandte Chemie International Edition, 10.1002/anie.201912812, 59, 4, (1527-1531), (2019).
  • undefined, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 10.1109/ICASSP.2019.8682867, (2952-2956), (2019).
  • Learning of Tree-Structured Gaussian Graphical Models on Distributed Data Under Communication Constraints, IEEE Transactions on Signal Processing, 10.1109/TSP.2018.2876325, 67, 1, (17-28), (2019).
  • Stability and variability of personality networks. A tutorial on recent developments in network psychometrics, Personality and Individual Differences, 10.1016/j.paid.2017.06.011, 136, (68-78), (2019).
  • An Integrated Gaussian Graphical Model to evaluate the impact of exposures on metabolic networks, Computers in Biology and Medicine, 10.1016/j.compbiomed.2019.103417, (103417), (2019).
  • Changes in the Network Structure of Posttraumatic Stress Disorder Symptoms at Different Time Points Among Youth Survivors: A Network Analysis, Journal of Affective Disorders, 10.1016/j.jad.2019.08.065, (2019).
  • A Statistical Test for Differential Network Analysis Based on Inference of Gaussian Graphical Model, Scientific Reports, 10.1038/s41598-019-47362-7, 9, 1, (2019).
  • Group variable selection via regularization and application to optimal scoring , Neural Networks, 10.1016/j.neunet.2019.05.011, (2019).
  • Pathologic gene network rewiring implicates PPP1R3A as a central regulator in pressure overload heart failure, Nature Communications, 10.1038/s41467-019-10591-5, 10, 1, (2019).
  • Edge Exclusion Tests for Improper Complex Gaussian Graphical Model Selection, IEEE Transactions on Signal Processing, 10.1109/TSP.2019.2916068, 67, 13, (3547-3560), (2019).
  • Joint Learning of Multiple Differential Networks With Latent Variables, IEEE Transactions on Cybernetics, 10.1109/TCYB.2018.2845838, 49, 9, (3494-3506), (2019).
  • Inferring Gene Network Rewiring by Combining Gene Expression and Gene Mutation Data, IEEE/ACM Transactions on Computational Biology and Bioinformatics, 10.1109/TCBB.2018.2834529, 16, 3, (1042-1048), (2019).
  • Regularized joint estimation of related vector autoregressive models, Computational Statistics & Data Analysis, 10.1016/j.csda.2019.05.007, (2019).
  • undefined, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 10.1109/ICASSP.2019.8682199, (5292-5296), (2019).
  • Integrating gene regulatory pathways into differential network analysis of gene expression data, Scientific Reports, 10.1038/s41598-019-41918-3, 9, 1, (2019).
  • Grandiose and entitled, but still fragile: A network analysis of pathological narcissistic traits, Personality and Individual Differences, 10.1016/j.paid.2018.04.003, 140, (15-20), (2019).
  • Analysis of Distributed ADMM Algorithm for Consensus Optimization in Presence of Node Error, IEEE Transactions on Signal Processing, 10.1109/TSP.2019.2896266, 67, 7, (1774-1784), (2019).
  • Statistical Network Inference for Time-Varying Molecular Data with Dynamic Bayesian Networks, Gene Regulatory Networks, 10.1007/978-1-4939-8882-2_2, (25-48), (2019).
  • undefined, 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP), 10.1109/MLSP.2019.8918691, (1-6), (2019).
  • undefined, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), 10.1109/BHI.2019.8834551, (1-4), (2019).
  • Edge Exclusion Tests for Graphical Model Selection: Complex Gaussian Vectors and Time Series, IEEE Transactions on Signal Processing, 10.1109/TSP.2019.2935898, 67, 19, (5062-5077), (2019).
  • undefined, ICC 2019 - 2019 IEEE International Conference on Communications (ICC), 10.1109/ICC.2019.8761058, (1-6), (2019).
  • Inferring Regulatory Programs Governing Region Specificity of Neuroepithelial Stem Cells during Early Hindbrain and Spinal Cord Development, Cell Systems, 10.1016/j.cels.2019.05.012, (2019).
  • Asymptotic properties of concave -norm group penalties , Statistics & Probability Letters, 10.1016/j.spl.2019.108631, (108631), (2019).
  • Common reducing subspace model and network alternation analysis, Biometrics, 10.1111/biom.13099, 75, 4, (1109-1120), (2019).
  • Learning Overlapping Community-based Networks, IEEE Transactions on Signal and Information Processing over Networks, 10.1109/TSIPN.2019.2936361, (1-1), (2019).
  • Spatial Auto-regressive Dependency Interpretable Learning Based on Spatial Topological Constraints, ACM Transactions on Spatial Algorithms and Systems, 10.1145/3339823, 5, 3, (1-28), (2019).
  • undefined, 2019 IEEE International Symposium on Information Theory (ISIT), 10.1109/ISIT.2019.8849254, (1307-1311), (2019).
  • Gaussian and Mixed Graphical Models as (multi-)omics data analysis tools, Biochimica et Biophysica Acta (BBA) - Gene Regulatory Mechanisms, 10.1016/j.bbagrm.2019.194418, (194418), (2019).
  • undefined, ICC 2019 - 2019 IEEE International Conference on Communications (ICC), 10.1109/ICC.2019.8761975, (1-6), (2019).
  • A Novel Joint Brain Network Analysis Using Longitudinal Alzheimer’s Disease Data, Scientific Reports, 10.1038/s41598-019-55818-z, 9, 1, (2019).
  • undefined, 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 10.1109/BIBM47256.2019.8983024, (2729-2734), (2019).
  • A Network-based Comparison between Molecular Apocrine Breast Cancer Tumor and Basal and Luminal Tumors by Joint Graphical Lasso, IEEE/ACM Transactions on Computational Biology and Bioinformatics, 10.1109/TCBB.2019.2911074, (1-1), (2019).
  • Direct interaction network and differential network inference from compositional data via lasso penalized D-trace loss, PLOS ONE, 10.1371/journal.pone.0207731, 14, 7, (e0207731), (2019).
  • Estimation of joint directed acyclic graphs with lasso family for gene networks, Communications in Statistics - Simulation and Computation, 10.1080/03610918.2019.1618869, (1-15), (2019).
  • Fast hybrid Bayesian integrative learning of multiple gene regulatory networks for type 1 diabetes, Biostatistics, 10.1093/biostatistics/kxz027, (2019).
  • Weighted Fused Pathway Graphical Lasso for Joint Estimation of Multiple Gene Networks, Frontiers in Genetics, 10.3389/fgene.2019.00623, 10, (2019).
  • Inference of differential gene regulatory networks based on gene expression and genetic perturbation data, Bioinformatics, 10.1093/bioinformatics/btz529, (2019).
  • Two-Way Horizontal and Vertical Omics Integration for Disease Subtype Discovery, Statistics in Biosciences, 10.1007/s12561-019-09242-6, (2019).
  • Automatic Response Category Combination in Multinomial Logistic Regression, Journal of Computational and Graphical Statistics, 10.1080/10618600.2019.1585258, (1-9), (2019).
  • Structured learning of time-varying networks with application to PM 2.5 data , Communications in Statistics - Simulation and Computation, 10.1080/03610918.2019.1582780, (1-19), (2019).
  • DiffNetFDR: differential network analysis with false discovery rate control, Bioinformatics, 10.1093/bioinformatics/btz051, (2019).
  • NExUS: Bayesian simultaneous network estimation across unequal sample sizes, Bioinformatics, 10.1093/bioinformatics/btz636, (2019).
  • Estimating Time-Varying Graphical Models, Journal of Computational and Graphical Statistics, 10.1080/10618600.2019.1647848, (1-12), (2019).
  • Estimation of Dynamic Networks for High-Dimensional Nonstationary Time Series, Entropy, 10.3390/e22010055, 22, 1, (55), (2019).
  • Microbiome Multi-Omics Network Analysis: Statistical Considerations, Limitations, and Opportunities, Frontiers in Genetics, 10.3389/fgene.2019.00995, 10, (2019).
  • Moderated Network Models, Multivariate Behavioral Research, 10.1080/00273171.2019.1677207, (1-32), (2019).
  • Parameter Estimation with the Ordered ℓ2 Regularization via an Alternating Direction Method of Multipliers, Applied Sciences, 10.3390/app9204291, 9, 20, (4291), (2019).
  • Symptom structure of PTSD and co-morbid depressive symptoms – a network analysis of combat veteran patients, Psychological Medicine, 10.1017/S0033291719002034, (1-17), (2019).
  • Functional Graphical Models, Journal of the American Statistical Association, 10.1080/01621459.2017.1390466, 114, 525, (211-222), (2018).
  • See more