On High-Dimensional Constrained Maximum Likelihood Inference.

Yunzhang Zhu, Xiaotong Shen, Wei Pan
Author Information
  1. Yunzhang Zhu: Department of Statistics, Ohio State University, Columbus, OH.
  2. Xiaotong Shen: School of Statistics, University of Minnesota, Minneapolis, MN.
  3. Wei Pan: Division of Biostatistics, University of Minnesota, Minneapolis, MN.

Abstract

Inference in a high-dimensional situation may involve regularization of a certain form to treat overparameterization, imposing challenges to inference. The common practice of inference uses either a regularized model, as in inference after model selection, or bias-reduction known as "debias." While the first ignores statistical uncertainty inherent in regularization, the second reduces the bias inbred in regularization at the expense of increased variance. In this article, we propose a constrained maximum likelihood method for hypothesis testing involving unspecific nuisance parameters, with a focus of alleviating the impact of regularization on inference. Particularly, for general composite hypotheses, we unregularize hypothesized parameters whereas regularizing nuisance parameters through a -constraint controlling the degree of sparseness. This approach is analogous to semiparametric likelihood inference in a high-dimensional situation. On this ground, for the Gaussian graphical model and linear regression, we derive conditions under which the asymptotic distribution of the constrained likelihood ratio is established, permitting parameter dimension increasing with the sample size. Interestingly, the corresponding limiting distribution is the chi-square or normal, depending on if the co-dimension of a test is finite or increases with the sample size, leading to asymptotic similar tests. This goes beyond the classical Wilks phenomenon. Numerically, we demonstrate that the proposed method performs well against it competitors in various scenarios. Finally, we apply the proposed method to infer linkages in brain network analysis based on MRI data, to contrast Alzheimer's disease patients against healthy subjects. Supplementary materials for this article are available online.

Keywords

References

  1. J Multivar Anal. 2013 Apr 1;116:365-381 [PMID: 23687392]
  2. Ann Inst Stat Math. 2013 Oct;65(5):807-832 [PMID: 24465052]
  3. Biostatistics. 2008 Jul;9(3):432-41 [PMID: 18079126]
  4. J Am Stat Assoc. 2012 Jan 1;107(497):152-167 [PMID: 24574574]
  5. Cereb Cortex. 2016 Jun;26(6):2650-62 [PMID: 25994962]
  6. J Am Stat Assoc. 2012 Jan 1;107(497):223-232 [PMID: 22736876]
  7. Neuroimage. 2006 Jul 1;31(3):968-80 [PMID: 16530430]
  8. Proc Natl Acad Sci U S A. 2004 Mar 30;101(13):4637-42 [PMID: 15070770]
  9. J Neurosci. 2008 Apr 30;28(18):4756-66 [PMID: 18448652]
  10. J Am Stat Assoc. 2014 Oct;109(508):1683-1696 [PMID: 25642006]
  11. Ann Appl Stat. 2009 Jun 1;3(2):521-541 [PMID: 21643444]
  12. Biometrics. 2017 Sep;73(3):769-779 [PMID: 28099997]

Grants

  1. R01 GM081535/NIGMS NIH HHS
  2. R01 GM126002/NIGMS NIH HHS
  3. R01 HL065462/NHLBI NIH HHS
  4. R01 HL105397/NHLBI NIH HHS

Word Cloud

Created with Highcharts 10.0.0inferenceregularizationmodellikelihoodmethodparametersInferencehigh-dimensionalsituationarticleconstrainednuisanceasymptoticdistributionsamplesizetestsWilksphenomenonproposedmayinvolvecertainformtreatoverparameterizationimposingchallengescommonpracticeuseseitherregularizedselectionbias-reductionknown"debias"firstignoresstatisticaluncertaintyinherentsecondreducesbiasinbredexpenseincreasedvarianceproposemaximumhypothesistestinginvolvingunspecificfocusalleviatingimpactParticularlygeneralcompositehypothesesunregularizehypothesizedwhereasregularizing-constraintcontrollingdegreesparsenessapproachanalogoussemiparametricgroundGaussiangraphicallinearregressionderiveconditionsratioestablishedpermittingparameterdimensionincreasingInterestinglycorrespondinglimitingchi-squarenormaldependingco-dimensiontestfiniteincreasesleadingsimilargoesbeyondclassicalNumericallydemonstrateperformswellcompetitorsvariousscenariosFinallyapplyinferlinkagesbrainnetworkanalysisbasedMRIdatacontrastAlzheimer'sdiseasepatientshealthysubjectsSupplementarymaterialsavailableonlineHigh-DimensionalConstrainedMaximumLikelihoodpn-asymptoticsBrainnetworksGeneralizedHigh-dimensionalityL0-regularizationSimilar

Similar Articles

Cited By