Deep generative models in DataSHIELD.

Stefan Lenz, Moritz Hess, Harald Binder
Author Information
  1. Stefan Lenz: Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany. lenz@imbi.uni-freiburg.de. ORCID
  2. Moritz Hess: Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany. ORCID
  3. Harald Binder: Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany. ORCID

Abstract

BACKGROUND: The best way to calculate statistics from medical data is to use the data of individual patients. In some settings, this data is difficult to obtain due to privacy restrictions. In Germany, for example, it is not possible to pool routine data from different hospitals for research purposes without the consent of the patients.
METHODS: The DataSHIELD software provides an infrastructure and a set of statistical methods for joint, privacy-preserving analyses of distributed data. The contained algorithms are reformulated to work with aggregated data from the participating sites instead of the individual data. If a desired algorithm is not implemented in DataSHIELD or cannot be reformulated in such a way, using artificial data is an alternative. Generating artificial data is possible using so-called generative models, which are able to capture the distribution of given data. Here, we employ deep Boltzmann machines (DBMs) as generative models. For the implementation, we use the package "BoltzmannMachines" from the Julia programming language and wrap it for use with DataSHIELD, which is based on R.
RESULTS: We present a methodology together with a software implementation that builds on DataSHIELD to create artificial data that preserve complex patterns from distributed individual patient data. Such data sets of artificial patients, which are not linked to real patients, can then be used for joint analyses. As an exemplary application, we conduct a distributed analysis with DBMs on a synthetic data set, which simulates genetic variant data. Patterns from the original data can be recovered in the artificial data using hierarchical clustering of the virtual patients, demonstrating the feasibility of the approach. Additionally, we compare DBMs, variational autoencoders, generative adversarial networks, and multivariate imputation as generative approaches by assessing the utility and disclosure of synthetic data generated from real genetic variant data in a distributed setting with data of a small sample size.
CONCLUSIONS: Our implementation adds to DataSHIELD the ability to generate artificial data that can be used for various analyses, e.g., for pattern recognition with deep learning. This also demonstrates more generally how DataSHIELD can be flexibly extended with advanced algorithms from languages other than R.

Keywords

References

  1. Stat Med. 2020 Apr 15;39(8):1183-1198 [PMID: 31944335]
  2. Nature. 2015 Oct 1;526(7571):75-81 [PMID: 26432246]
  3. Bioinformatics. 2017 Oct 15;33(20):3173-3180 [PMID: 28655145]
  4. Brief Bioinform. 2020 Oct 02;: [PMID: 33003196]
  5. Public Health Genomics. 2015;18(2):87-96 [PMID: 25532061]
  6. PLoS Genet. 2009 Jun;5(6):e1000529 [PMID: 19543373]
  7. Science. 2006 Jul 28;313(5786):504-7 [PMID: 16873662]
  8. BMC Med Res Methodol. 2020 May 7;20(1):108 [PMID: 32381039]
  9. Nature. 2015 Oct 1;526(7571):68-74 [PMID: 26432245]
  10. Int J Epidemiol. 2014 Dec;43(6):1929-44 [PMID: 25261970]
  11. Int J Epidemiol. 2017 Oct 1;46(5):1372-1378 [PMID: 29025122]
  12. Neural Comput. 2012 Aug;24(8):1967-2006 [PMID: 22509963]
  13. Methods Inf Med. 2018 Jul;57(S 01):e82-e91 [PMID: 30016814]

Grants

  1. FKZ 01ZZ1801B/Bundesministerium für Bildung und Forschung
  2. FKZ 031L0250A/Bundesministerium für Bildung und Forschung

MeSH Term

Algorithms
Disclosure
Germany
Humans
Software

Word Cloud

Created with Highcharts 10.0.0dataDataSHIELDartificialpatientsgenerativedistributedcanuseindividualanalysesusingmodelsDBMsimplementationwaypossiblesoftwaresetjointalgorithmsreformulateddeepRrealusedsyntheticgeneticvariantlearningDeepBACKGROUND:bestcalculatestatisticsmedicalsettingsdifficultobtaindueprivacyrestrictionsGermanyexamplepoolroutinedifferenthospitalsresearchpurposeswithoutconsentMETHODS:providesinfrastructurestatisticalmethodsprivacy-preservingcontainedworkaggregatedparticipatingsitesinsteaddesiredalgorithmimplementedalternativeGeneratingso-calledablecapturedistributiongivenemployBoltzmannmachinespackage"BoltzmannMachines"JuliaprogramminglanguagewrapbasedRESULTS:presentmethodologytogetherbuildscreatepreservecomplexpatternspatientsetslinkedexemplaryapplicationconductanalysissimulatesPatternsoriginalrecoveredhierarchicalclusteringvirtualdemonstratingfeasibilityapproachAdditionallycomparevariationalautoencodersadversarialnetworksmultivariateimputationapproachesassessingutilitydisclosuregeneratedsettingsmallsamplesizeCONCLUSIONS:addsabilitygeneratevariousegpatternrecognitionalsodemonstratesgenerallyflexiblyextendedadvancedlanguagesBiomedicalresearch/methodsDistributedsystemPrivacy/statisticsnumerical

Similar Articles

Cited By