A Good View for Graph Contrastive Learning.

Xueyuan Chen, Shangzhe Li
Author Information
  1. Xueyuan Chen: State Key Laboratory of Software Development Environment, Beihang University, Beijing 100191, China.
  2. Shangzhe Li: School of Statistics and Mathematics, Central University of Finance and Economics, Beijing 100081, China.

Abstract

Due to the success observed in deep neural networks with contrastive learning, there has been a notable surge in research interest in graph contrastive learning, primarily attributed to its superior performance in graphs with limited labeled data. Within contrastive learning, the selection of a "view" dictates the information captured by the representation, thereby influencing the model's performance. However, assessing the quality of information in these views poses challenges, and determining what constitutes a good view remains unclear. This paper addresses this issue by establishing the definition of a good view through the application of graph information bottleneck and structural entropy theories. Based on theoretical insights, we introduce CtrlGCL, a novel method for achieving a beneficial view in graph contrastive learning through coding tree representation learning. Extensive experiments were conducted to ascertain the effectiveness of the proposed view in unsupervised and semi-supervised learning. In particular, our approach, via CtrlGCL-H, yields an average accuracy enhancement of 1.06% under unsupervised learning when compared to GCL. This improvement underscores the efficacy of our proposed method.

Keywords

References

  1. Entropy (Basel). 2022 May 03;24(5): [PMID: 35626528]
  2. Entropy (Basel). 2023 Oct 07;25(10): [PMID: 37895542]
  3. Entropy (Basel). 2022 Apr 14;24(4): [PMID: 35455214]
  4. KDD. 2016 Aug;2016:855-864 [PMID: 27853626]
  5. Phys Rev E Stat Nonlin Soft Matter Phys. 2009 Mar;79(3 Pt 2):036114 [PMID: 19392025]
  6. Nat Commun. 2018 Aug 15;9(1):3265 [PMID: 30111883]
  7. Entropy (Basel). 2023 Oct 10;25(10): [PMID: 37895553]
  8. Proc Int Conf Web Search Data Min. 2022 Feb;2022:1300-1309 [PMID: 35647617]

Grants

  1. 61932002/NSFC (Grant No. 61932002).

Word Cloud

Created with Highcharts 10.0.0learningcontrastivegraphviewinformationrepresentationperformancegoodstructuralentropymethodcodingtreeproposedunsupervisedDuesuccessobserveddeepneuralnetworksnotablesurgeresearchinterestprimarilyattributedsuperiorgraphslimitedlabeleddataWithinselection"view"dictatescapturedtherebyinfluencingmodel'sHoweverassessingqualityviewsposeschallengesdeterminingconstitutesremainsunclearpaperaddressesissueestablishingdefinitionapplicationbottlenecktheoriesBasedtheoreticalinsightsintroduceCtrlGCLnovelachievingbeneficialExtensiveexperimentsconductedascertaineffectivenesssemi-supervisedparticularapproachviaCtrlGCL-Hyieldsaverageaccuracyenhancement106%comparedGCLimprovementunderscoresefficacyGoodViewGraphContrastiveLearning

Similar Articles

Cited By