Robust principal component analysis based on maximum correntropy criterion.

Ran He, Bao-Gang Hu, Wei-Shi Zheng, Xiang-Wei Kong
Author Information
  1. Ran He: National Laboratory of Pattern Recognition, Institute of Automation Chinese Academy of Sciences, Beijing 100190, China. rhe@nlpr.ia.ac.cn

Abstract

Principal component analysis (PCA) minimizes the mean square error (MSE) and is sensitive to outliers. In this paper, we present a new rotational-invariant PCA based on maximum correntropy criterion (MCC). A half-quadratic optimization algorithm is adopted to compute the correntropy objective. At each iteration, the complex optimization problem is reduced to a quadratic problem that can be efficiently solved by a standard optimization method. The proposed method exhibits the following benefits: 1) it is robust to outliers through the mechanism of MCC which can be more theoretically solid than a heuristic rule based on MSE; 2) it requires no assumption about the zero-mean of data for processing and can estimate data mean during optimization; and 3) its optimal solution consists of principal eigenvectors of a robust covariance matrix corresponding to the largest eigenvalues. In addition, kernel techniques are further introduced in the proposed method to deal with nonlinearly distributed data. Numerical results demonstrate that the proposed method can outperform robust rotational-invariant PCAs based on L(1) norm when outliers occur.

MeSH Term

Algorithms
Data Interpretation, Statistical
Entropy
Image Enhancement
Image Interpretation, Computer-Assisted
Models, Statistical
Pattern Recognition, Automated
Principal Component Analysis
Reproducibility of Results
Sensitivity and Specificity

Word Cloud

Created with Highcharts 10.0.0basedoptimizationcanmethodoutlierscorrentropyproposedrobustdatacomponentanalysisPCAmeanMSErotational-invariantmaximumcriterionMCCproblem1principalPrincipalminimizessquareerrorsensitivepaperpresentnewhalf-quadraticalgorithmadoptedcomputeobjectiveiterationcomplexreducedquadraticefficientlysolvedstandardexhibitsfollowingbenefits:mechanismtheoreticallysolidheuristicrule2requiresassumptionzero-meanprocessingestimate3optimalsolutionconsistseigenvectorscovariancematrixcorrespondinglargesteigenvaluesadditionkerneltechniquesintroduceddealnonlinearlydistributedNumericalresultsdemonstrateoutperformPCAsLnormoccurRobust

Similar Articles

Cited By