Scalable Bayesian nonparametric measures for exploring pairwise dependence via Dirichlet Process Mixtures.

Sarah Filippi, Chris C Holmes, Luis E Nieto-Barajas
Author Information
  1. Sarah Filippi: Department of Statistics, University of Oxford, England.
  2. Chris C Holmes: Department of Statistics, University of Oxford, England.
  3. Luis E Nieto-Barajas: Department of Statistics, University of Oxford, England.

Abstract

In this article we propose novel Bayesian nonparametric methods using Dirichlet Process Mixture (DPM) models for detecting pairwise dependence between random variables while accounting for uncertainty in the form of the underlying distributions. A key criteria is that the procedures should scale to large data sets. In this regard we find that the formal calculation of the Bayes factor for a dependent-vs.-independent DPM joint probability measure is not feasible computationally. To address this we present Bayesian diagnostic measures for characterising evidence against a "null model" of pairwise independence. In simulation studies, as well as for a real data analysis, we show that our approach provides a useful tool for the exploratory nonparametric Bayesian analysis of large multivariate data sets.

Keywords

References

  1. J Stat Softw. 2011 Apr 1;40(5):1-30 [PMID: 21796263]
  2. Proc Natl Acad Sci U S A. 2014 Mar 4;111(9):3354-9 [PMID: 24550517]

Grants

  1. G0701810/Medical Research Council
  2. MC_UP_A390_1107/Medical Research Council

Word Cloud

Created with Highcharts 10.0.0BayesiannonparametricpairwisedependencedataDirichletProcessDPMlargesetsBayesmeasuremeasuresanalysisarticleproposenovelmethodsusingMixturemodelsdetectingrandomvariablesaccountinguncertaintyformunderlyingdistributionskeycriteriaproceduresscaleregardfindformalcalculationfactordependent-vs-independentjointprobabilityfeasiblecomputationallyaddresspresentdiagnosticcharacterisingevidence"nullmodel"independencesimulationstudieswellrealshowapproachprovidesusefultoolexploratorymultivariateScalableexploringviaMixturesnonparametricscontingencytablehypothesistestingmixturemodelmutualinformation

Similar Articles

Cited By