A Fast, Efficient Domain Adaptation Technique for Cross-Domain Electroencephalography(EEG)-Based Emotion Recognition.

Xin Chai, Qisong Wang, Yongping Zhao, Yongqiang Li, Dan Liu, Xin Liu, Ou Bai
Author Information
  1. Xin Chai: School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001, China. 11b901011@hit.edu.cn.
  2. Qisong Wang: School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001, China. wangqisong@hit.edu.cn.
  3. Yongping Zhao: School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001, China. zhaoyp2590@hit.edu.cn.
  4. Yongqiang Li: School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001, China. liyongqiang@hit.edu.cn.
  5. Dan Liu: School of Electrical Engineering and Automation, Harbin Institute of Technology, Harbin 150001, China. liudan@hit.edu.cn.
  6. Xin Liu: Department of Traffic Information and Control Engineering, School of Transportation Science and Engineering, Harbin Institute of Technology, Harbin 150001, China. xinliu@hit.edu.cn.
  7. Ou Bai: Department of Electrical and Computer Engineering, Florida International University, Miami, FL 33199, USA. obai@fiu.edu.

Abstract

Electroencephalography (EEG)-based emotion recognition is an important element in psychiatric health diagnosis for patients. However, the underlying EEG sensor signals are always non-stationary if they are sampled from different experimental sessions or subjects. This results in the deterioration of the classification performance. Domain adaptation methods offer an effective way to reduce the discrepancy of marginal distribution. However, for EEG sensor signals, both marginal and conditional distributions may be mismatched. In addition, the existing domain adaptation strategies always require a high level of additional computation. To address this problem, a novel strategy named adaptive subspace feature matching (ASFM) is proposed in this paper in order to integrate both the marginal and conditional distributions within a unified framework (without any labeled samples from target subjects). Specifically, we develop a linear transformation function which matches the marginal distributions of the source and target subspaces without a regularization term. This significantly decreases the time complexity of our domain adaptation procedure. As a result, both marginal and conditional distribution discrepancies between the source domain and unlabeled target domain can be reduced, and logistic regression (LR) can be applied to the new source domain in order to train a classifier for use in the target domain, since the aligned source domain follows a distribution which is similar to that of the target domain. We compare our ASFM method with six typical approaches using a public EEG dataset with three affective states: positive, neutral, and negative. Both offline and online evaluations were performed. The subject-to-subject offline experimental results demonstrate that our component achieves a mean accuracy and standard deviation of 80.46% and 6.84%, respectively, as compared with a state-of-the-art method, the subspace alignment auto-encoder (SAAE), which achieves values of 77.88% and 7.33% on average, respectively. For the online analysis, the average classification accuracy and standard deviation of ASFM in the subject-to-subject evaluation for all the 15 subjects in a dataset was 75.11% and 7.65%, respectively, gaining a significant performance improvement compared to the best baseline LR which achieves 56.38% and 7.48%, respectively. The experimental results confirm the effectiveness of the proposed method relative to state-of-the-art methods. Moreover, computational efficiency of the proposed ASFM method is much better than standard domain adaptation; if the numbers of training samples and test samples are controlled within certain range, it is suitable for real-time classification. It can be concluded that ASFM is a useful and effective tool for decreasing domain discrepancy and reducing performance degradation across subjects and sessions in the field of EEG-based emotion recognition.

Keywords

References

  1. Sensors (Basel). 2013 Jun 26;13(7):8199-221 [PMID: 23803789]
  2. IEEE Trans Neural Syst Rehabil Eng. 2006 Jun;14(2):164-8 [PMID: 16792284]
  3. Front Neuroinform. 2014 Feb 21;8:14 [PMID: 24600388]
  4. Annu Int Conf IEEE Eng Med Biol Soc. 2013;2013:6627-30 [PMID: 24111262]
  5. J Neural Eng. 2012 Feb;9(1):016003 [PMID: 22156069]
  6. Front Neurosci. 2014 Jun 12;8:114 [PMID: 24971046]
  7. IEEE Trans Biomed Eng. 2010 Jun;57(6):1318-24 [PMID: 20172795]
  8. Front Neurorobot. 2017 Apr 10;11:19 [PMID: 28443015]
  9. IEEE Trans Neural Netw. 2011 Feb;22(2):199-210 [PMID: 21095864]
  10. Comput Biol Med. 2016 Aug 1;75:45-53 [PMID: 27253616]
  11. Neuroimage. 2015 May 1;111:167-78 [PMID: 25682943]
  12. IEEE Trans Biomed Eng. 2014 Dec;61(12):2840-7 [PMID: 24967979]
  13. Sensors (Basel). 2016 Sep 22;16(10): [PMID: 27669247]
  14. Comput Biol Med. 2016 Dec 1;79:205-214 [PMID: 27810626]

MeSH Term

Algorithms
Electroencephalography
Emotions
Humans
Logistic Models

Word Cloud

Created with Highcharts 10.0.0domainEEGadaptationmarginalASFMtargetsubjectssourcemethodrespectivelyElectroencephalographyemotionrecognitionexperimentalresultsclassificationperformancedistributionconditionaldistributionsproposedsamplescanachievesstandard7HoweversensorsignalsalwayssessionsDomainmethodseffectivediscrepancysubspaceorderwithinwithoutLRdatasetofflineonlinesubject-to-subjectaccuracydeviationcomparedstate-of-the-artaverage-basedimportantelementpsychiatrichealthdiagnosispatientsunderlyingnon-stationarysampleddifferentdeteriorationofferwayreducemaymismatchedadditionexistingstrategiesrequirehighleveladditionalcomputationaddressproblemnovelstrategynamedadaptivefeaturematchingpaperintegrateunifiedframeworklabeledSpecificallydeveloplineartransformationfunctionmatchessubspacesregularizationtermsignificantlydecreasestimecomplexityprocedureresultdiscrepanciesunlabeledreducedlogisticregressionappliednewtrainclassifierusesincealignedfollowssimilarcomparesixtypicalapproachesusingpublicthreeaffectivestates:positiveneutralnegativeevaluationsperformeddemonstratecomponentmean8046%684%alignmentauto-encoderSAAEvalues7788%33%analysisevaluation157511%65%gainingsignificantimprovementbestbaseline5638%48%confirmeffectivenessrelativeMoreovercomputationalefficiencymuchbetternumberstrainingtestcontrolledcertainrangesuitablereal-timeconcludedusefultooldecreasingreducingdegradationacrossfieldEEG-basedFastEfficientAdaptationTechniqueCross-Domain-BasedEmotionRecognition

Similar Articles

Cited By