HypMix: Hyperbolic Representation Learning for Graphs with Mixed Hierarchical and Non-hierarchical Structures.

Eric W Lee, Bo Xiong, Carl Yang, Joyce C Ho
Author Information
  1. Eric W Lee: Emory University, Atlanta, GA, USA.
  2. Bo Xiong: University of Stuttgart, Stuttgart, Germany.
  3. Carl Yang: Emory University, Atlanta, GA, USA.
  4. Joyce C Ho: Emory University, Atlanta, GA, USA.

Abstract

Heterogeneous networks contain multiple types of nodes and links, with some link types encapsulating hierarchical structure over entities. Hierarchical relationships can codify information such as subcategories or one entity being subsumed by another and are often used for organizing conceptual knowledge into a tree-structured graph. Hyperbolic embedding models learn node representations in a hyperbolic space suitable for preserving the hierarchical structure. Unfortunately, current hyperbolic embedding models only implicitly capture the hierarchical structure, failing to distinguish between node types, and they only assume a single tree. In practice, many networks contain a mixture of hierarchical and non-hierarchical structures, and the hierarchical relations may be represented as multiple trees with complex structures, such as sharing certain entities. In this work, we propose a new hyperbolic representation learning model that can handle complex hierarchical structures and also learn the representation of both hierarchical and non-hierarchic structures. We evaluate our model on several datasets, including identifying relevant articles for a systematic review, which is an essential tool for evidence-driven medicine and node classification.

Keywords

References

  1. Adv Neural Inf Process Syst. 2019 Dec;32:4869-4880 [PMID: 32256024]
  2. J Am Med Inform Assoc. 2006 Mar-Apr;13(2):206-19 [PMID: 16357352]
  3. Proc Mach Learn Res. 2019 Apr;89:1832-1840 [PMID: 32832915]
  4. BMJ Open. 2017 Feb 27;7(2):e012545 [PMID: 28242767]
  5. Eval Health Prof. 2002 Mar;25(1):12-37 [PMID: 11868442]
  6. Proc Mach Learn Res. 2018;80:4460-4469 [PMID: 31131375]
  7. Syst Rev. 2016 May 23;5:87 [PMID: 27216467]
  8. IEEE Trans Pattern Anal Mach Intell. 2022 Dec;44(12):10023-10044 [PMID: 34932472]

Grants

  1. K25 DK135913/NIDDK NIH HHS

Word Cloud

Created with Highcharts 10.0.0hierarchicalHyperbolicstructurestypesstructureHierarchicalnodehyperbolicRepresentationLearningnetworkscontainmultipleentitiescanembeddingmodelslearncomplexrepresentationmodelHeterogeneousnodeslinkslinkencapsulatingrelationshipscodifyinformationsubcategoriesoneentitysubsumedanotheroftenusedorganizingconceptualknowledgetree-structuredgraphrepresentationsspacesuitablepreservingUnfortunatelycurrentimplicitlycapturefailingdistinguishassumesingletreepracticemanymixturenon-hierarchicalrelationsmayrepresentedtreessharingcertainworkproposenewlearninghandlealsonon-hierarchicevaluateseveraldatasetsincludingidentifyingrelevantarticlessystematicreviewessentialtoolevidence-drivenmedicineclassificationHypMix:GraphsMixedNon-hierarchicalStructuresGraphStructureSpace

Similar Articles

Cited By

No available data.