Multisource Deep Transfer Learning Based on Balanced Distribution Adaptation.

Peng Gao, Jingmei Li, Guodong Zhao, Changhong Ding
Author Information
  1. Peng Gao: College of Computer Science and Technology, Harbin Engineering University, Harbin, China. ORCID
  2. Jingmei Li: College of Computer Science and Technology, Harbin Engineering University, Harbin, China. ORCID
  3. Guodong Zhao: College of Computer Science and Technology, Harbin Engineering University, Harbin, China. ORCID
  4. Changhong Ding: Heilongjiang University of Chinese Medicine, Harbin, China. ORCID

Abstract

The current traditional unsupervised transfer learning assumes that the sample is collected from a single domain. From the aspect of practical application, the sample from a single-source domain is often not enough. In most cases, we usually collect labeled data from multiple domains. In recent years, multisource unsupervised transfer learning with deep learning has focused on aligning in the common feature space and then seeking to minimize the distribution difference between the source and target domains, such as marginal distribution, conditional distribution, or both. Moreover, conditional distribution and marginal distribution are often treated equally, which will lead to poor performance in practical applications. The existing algorithms that consider balanced distribution are often based on a single-source domain. To solve the above-mentioned problems, we propose a multisource transfer learning algorithm based on distribution adaptation. This algorithm considers adjusting the weights of two distributions to solve the problem of distribution adaptation in multisource transfer learning. A large number of experiments have shown that our method MTLBDA has achieved significant results in popular image classification datasets such as Office-31.

References

  1. IEEE Trans Neural Netw. 2011 Feb;22(2):199-210 [PMID: 21095864]
  2. IEEE Trans Image Process. 2016 Dec;25(12):5552-5562 [PMID: 27654485]
  3. IEEE Trans Neural Netw Learn Syst. 2021 Apr;32(4):1713-1722 [PMID: 32365037]
  4. Appl Intell (Dordr). 2021;51(11):8451-8465 [PMID: 34764591]

MeSH Term

Algorithms
Machine Learning

Word Cloud

Created with Highcharts 10.0.0distributionlearningtransferdomainoftenmultisourceunsupervisedsamplepracticalsingle-sourcedomainsmarginalconditionalbasedsolvealgorithmadaptationcurrenttraditionalassumescollectedsingleaspectapplicationenoughcasesusuallycollectlabeleddatamultiplerecentyearsdeepfocusedaligningcommonfeaturespaceseekingminimizedifferencesourcetargetMoreovertreatedequallywillleadpoorperformanceapplicationsexistingalgorithmsconsiderbalancedabove-mentionedproblemsproposeconsidersadjustingweightstwodistributionsproblemlargenumberexperimentsshownmethodMTLBDAachievedsignificantresultspopularimageclassificationdatasetsOffice-31MultisourceDeepTransferLearningBasedBalancedDistributionAdaptation

Similar Articles

Cited By

No available data.